Open Source Models
Run a model
Section titled “Run a model”ollama run llama3.2 # download and start chattingollama pull mistral # download without runningollama list # list installed modelsollama rm llama3.2 # remove a modelModel quick reference
Section titled “Model quick reference”llama3.2 3B Meta General purpose, fast, runs on most laptopsllama3.1 8B Meta Stronger reasoning, needs ~16GB RAMmistral 7B Mistral Fast, good instruction followingmixtral 47B Mistral Very capable, needs high-end hardwareqwen2.5-coder 7B Alibaba Best local option for code generationphi4 14B Microsoft Strong performance for its sizegemma2 9B Google Efficient, good on Apple Silicondeepseek-coder 6.7B DeepSeek Solid for code, fastHardware guide
Section titled “Hardware guide”3B–4B model → 8GB RAM runs on most modern laptops7B–8B model → 16GB RAM comfortable on M-series Mac or 16GB PC13B model → 32GB RAM needs a well-specced machine70B model → 64GB+ RAM desktop GPU or Apple Silicon Max/UltraApple Silicon tip
Section titled “Apple Silicon tip”# Ollama uses Metal GPU acceleration on Apple Silicon automatically.# An M2 Pro (16GB) runs 7B models well.# An M3 Max (36GB) runs 13B models comfortably.Useful flags
Section titled “Useful flags”ollama run mistral --verbose # show token speed and model infoOLLAMA_NUM_PARALLEL=2 ollama serve # allow 2 concurrent requestsBrowse models
Section titled “Browse models”Find more at: https://ollama.com/library