Run Ollama in Docker

  1. Install Docker on your host (Linux, macOS, or Windows with WSL2)
  2. Pull the image: docker pull ollama/ollama
  3. Start the container: docker run -d -v ollama:/root/.ollama -p 11434:11434 --name ollama ollama/ollama
  4. Pull a model inside the container: docker exec -it ollama ollama pull llama3.2
  5. Test: docker exec -it ollama ollama run llama3.2
  6. API available at http://localhost:11434 on the host

Back to catalog