Llama 3.1 on Ollama
Min VRAM: 8 GB
Pull
ollama pull llama3.1
Run
ollama run llama3.1
API
After running, Ollama serves an OpenAI-compatible API at http://localhost:11434/v1.
Min VRAM: 8 GB
ollama pull llama3.1
ollama run llama3.1
After running, Ollama serves an OpenAI-compatible API at http://localhost:11434/v1.