中EN Submit a tool

Ollama

LLMs

Ollama is a free open-source tool for running large language models locally, supporting 40+ models such as Llama, DeepSeek-R1 and Mistral. It provides a CLI, a REST API and Docker images, keeping all interactions on your own machine.

Human verified · · Submit a correction

Visit website
Editor's note

Best for developers and researchers who need to run and experiment with LLMs locally and offline; not suitable for non-technical users wanting a ready-made chat app.

Verified facts

CategoryLLMs
Human verified

What is Ollama

Ollama is a free open-source tool for running large language models locally, supporting 40+ models such as Llama, DeepSeek-R1 and Mistral. It provides a CLI, a REST API and Docker images, keeping all interactions on your own machine.

Key features of Ollama

  • Running open models like Llama and DeepSeek locally
  • Integrating local models into apps via the REST API
  • Deploying private model services with Docker
  • Testing LLM capabilities offline

Good for

  • Free and open source; private data stays on-device
  • Rich and growing model library
  • CLI, API and Docker deployment options

Watch out

  • Requires command-line familiarity
  • Large models demand significant local RAM/VRAM
  • Limited graphical interface

How to use Ollama

  1. Download the installer for your OS
  2. Open a terminal after installation
  3. Run ollama run plus a model name
  4. Wait for the model to download
  5. Chat in the CLI or call the API

Who Ollama is for

Difficulty: Intermediate

  • Running open models like Llama and DeepSeek locally
  • Integrating local models into apps via the REST API
  • Deploying private model services with Docker
  • Testing LLM capabilities offline

FAQ

Which operating systems does Ollama support?

macOS, Windows and Linux, plus an official Docker image.

Is Ollama free?

Yes, Ollama is free and open source, and the models are open source as well.

Which models are supported?

40+ models including Llama, DeepSeek-R1, Mistral and Code Llama, with more added over time.

Sources and verification

Sources: ollama.ai (opens in a new tab)
Verified: · Submit a correction →

Alternatives to Ollama

All in this category
MMLU Best for: researchers and engineers measuring an English model's general knowledge; not for: assessing generation quality, dialogue experience, or Chinese ability. Watsonx.ai Best for mid-to-large enterprises and development teams needing full-lifecycle model management with enterprise governance and compliance; not for individual developers, lightweight experiments or budget-sensitive small projects. DeepFloyd IF Best for developers and researchers who want to self-host and study an image generation model in depth; not suitable for casual users who just want to type a prompt on a webpage and get an image. HELM Suited to researchers and engineering teams needing multi-dimensional, reproducible LLM evaluation; not for users who only want a quick single-score leaderboard. PaLM 2 Suited to AI developers, researchers, and enterprise teams in the Google ecosystem; not for everyday users seeking a ready-made consumer chatbot.