Ollama
Install Ollama, pull models, and run them locally. All guides include copy-paste commands.
Install guides
- Run Ollama in Docker
- Install Ollama on Ubuntu
- Install Ollama on macOS
- Install Ollama on Windows
- Run Ollama on a VPS
Comparisons
Models (12)
| Model | Ollama tag | Min VRAM | Guide |
|---|---|---|---|
| Codestral | codestral | 8 GB | Run guide |
| DeepSeek R1 | deepseek-r1 | 8 GB | Run guide |
| Gemma 4 | gemma2 | 8 GB | Run guide |
| Llama 3.1 | llama3.1 | 8 GB | Run guide |
| Llama 3.2 | llama3.2 | 4 GB | Run guide |
| Llama 3.3 | llama3.3 | 48 GB | Run guide |
| LLaVA | llava | 8 GB | Run guide |
| Mistral | mistral | 8 GB | Run guide |
| Mixtral 8x7B | mixtral | 26 GB | Run guide |
| Phi-4 | phi4 | 8 GB | Run guide |
| Qwen 2.5 | qwen2.5 | 8 GB | Run guide |
| Qwen3 | qwen3 | 8 GB | Run guide |