LLaVA on Ollama
Min VRAM: 8 GB
Pull
ollama pull llava
Run
ollama run llava
API
After running, Ollama serves an OpenAI-compatible API at http://localhost:11434/v1.
Min VRAM: 8 GB
ollama pull llava
ollama run llava
After running, Ollama serves an OpenAI-compatible API at http://localhost:11434/v1.