What is Ollama?

Ollama is a lightweight framework that allows you to run large language models locally. It's the AI engine that powers Local Assistant.

Download Ollama

Visit the official Ollama website to download the installer for your operating system:

Download Ollama

Installation Steps

Windows

  1. Download the Windows installer from ollama.ai
  2. Run the installer and follow the prompts
  3. Ollama will start automatically and run in the system tray

macOS

  1. Download the macOS app from ollama.ai
  2. Drag Ollama to your Applications folder
  3. Launch Ollama from Applications

Linux

curl -fsSL https://ollama.ai/install.sh | sh

Verify Installation

Open a terminal and run:

ollama --version

Download Your First Model

Once Ollama is installed, download a model:

ollama pull llama3.2

This downloads the Llama 3.2 model, which is a great starting point.