Models that run on 32 GB

986 models with published weights that fit in 32 GB — a well-specified laptop. Counted at four-bit quantisation, weights only, leaving the machine about a third of its memory and a gigabyte for context: room for roughly 33 billion parameters. A mixture of experts is counted in full, because it is held in full even though only a few experts compute. 986 in all, a hundred to a page; this is page 5 of 10.

Enough for a thirty-billion-parameter model at four-bit with a long context, or a smaller one at higher precision if quality matters more than size. A practical ceiling for a laptop that also has to be a laptop.

• OpenCoder-8B-Instructinftech.ai7.8B≈5.1 GB at 4-bit
• internlm2_5-7b-chatinternlm7.7B≈5.0 GB at 4-bit
• Qwen-7B-ChatAlibaba7.7B≈5.0 GB at 4-bit
• Qwen1.5-7B-ChatAlibaba7.7B≈5.0 GB at 4-bit
• DeepHat-V1-7BDeepHat7.6B≈5.0 GB at 4-bit
• Marco-o1ATH-MaaS7.6B≈5.0 GB at 4-bit
• Qwen2.5 7B InstructAlibaba7.6B≈5.0 GB at 4-bit8 also selling it hosted
• Qwen2.5-7B-Instruct-1MAlibaba7.6B≈5.0 GB at 4-bit
• VulnLLM-R-7BVirtueAI7.6B≈5.0 GB at 4-bit
• falcon-H1R-7BTechnology Innovation Institute7.6B≈4.9 GB at 4-bit
• llava-v1.6-mistral-7bliuhaotian7.6B≈4.9 GB at 4-bit
• starvector-8b-im2svgstarvector7.5B≈4.9 GB at 4-bit
• Ovis-Image-7BATH-MaaS7.4B≈4.8 GB at 4-bit
• falcon-mamba-7bTechnology Innovation Institute7.3B≈4.7 GB at 4-bit
• CodeQwen1.5-7B-ChatAlibaba7.3B≈4.7 GB at 4-bit
• Ruyi-Mini-7BIamCreateAI7.2B≈4.7 GB at 4-bit
• Starling-LM-7B-alphaBerkeley-Nest7.2B≈4.7 GB at 4-bit
• Starling-LM-7B-betaNexusflow7.2B≈4.7 GB at 4-bit
• dolphin-2.1-mistral-7bDolphin7.2B≈4.7 GB at 4-bit
• dolphin-2.2.1-mistral-7bDolphin7.2B≈4.7 GB at 4-bit
• dolphin-2.8-mistral-7b-v02Dolphin7.2B≈4.7 GB at 4-bit
• openchat-3.5-0106openchat7.2B≈4.7 GB at 4-bit
• Mistral-7B-v0.1Mistral AI7.2B≈4.7 GB at 4-bit
• neural-chat-7b-v3-1Intel7.2B≈4.7 GB at 4-bit
• zephyr-7b-alphaHugging Face H47.2B≈4.7 GB at 4-bit
• zephyr-7b-betaHugging Face H47.2B≈4.7 GB at 4-bit1 also selling it hosted
• falcon-7bTechnology Innovation Institute7.2B≈4.7 GB at 4-bit
• falcon-7b-instructTechnology Innovation Institute7.2B≈4.7 GB at 4-bit
• starcoder2-7bbigcode7.2B≈4.7 GB at 4-bit1 also selling it hosted
• bloom-7b1BigScience Workshop7.1B≈4.6 GB at 4-bit
• llava-1.5-7b-hfLlava Hugging Face7.1B≈4.6 GB at 4-bit
• DeciLM-7BDeci AI7.0B≈4.6 GB at 4-bit
• chameleon-7bfacebook7.0B≈4.6 GB at 4-bit
• ALLaM-7B-Instruct-previewHUMAIN7.0B≈4.6 GB at 4-bit
• AlphaMonarch-7Bmlabonne7.0B≈4.5 GB at 4-bit
• BELLE-7B-2MBelleGroup7.0B≈4.5 GB at 4-bit
• BioMistral-7BBioMistral7.0B≈4.5 GB at 4-bit
• Chinese-Llama-2-7bLinkSoul7.0B≈4.5 GB at 4-bit
• CodeLlama-7b-Python-hfCode Llama7.0B≈4.5 GB at 4-bit
• Cosmos-1.0-Diffusion-7B-Text2WorldNVIDIA7.0B≈4.5 GB at 4-bit
• DeepSeek-R1-Distill-QWEN-7BDeepSeek7.0B≈4.5 GB at 4-bit3 also selling it hosted
• Dream-v0-Instruct-7BDream-org7.0B≈4.5 GB at 4-bit
• FastVLM-7BApple7.0B≈4.5 GB at 4-bit
• GritLM-7BGritLM7.0B≈4.5 GB at 4-bit
• Hy-MT2-7BTencent Hunyuan7.0B≈4.5 GB at 4-bit1 also selling it hosted
• Janus-Pro-7BDeepSeek7.0B≈4.5 GB at 4-bit1 also selling it hosted
• K2-Horizon-7BInstitute of Foundation Models7.0B≈4.5 GB at 4-bit
• Lily-Cybersecurity-7B-v0.2segolilylabs7.0B≈4.5 GB at 4-bit
• Llama-2-7bMeta Llama7.0B≈4.5 GB at 4-bit
• Llama-2-7b-chatMeta Llama7.0B≈4.5 GB at 4-bit
• Llama2-Chinese-7b-ChatFlagAlpha7.0B≈4.5 GB at 4-bit
• MiMo-7B-RLXiaomiMiMo7.0B≈4.5 GB at 4-bit
• MiMo-Audio-7B-InstructXiaomiMiMo7.0B≈4.5 GB at 4-bit
• MiMo-VL-7B-RLXiaomiMiMo7.0B≈4.5 GB at 4-bit
• Mistral-7B-Instruct-v0.1Mistral AI7.0B≈4.5 GB at 4-bit3 also selling it hosted
• Mistral-7B-Instruct-v0.2Mistral AI7.0B≈4.5 GB at 4-bit2 also selling it hosted
• Mistral-7B-Instruct-v0.3Mistral AI7.0B≈4.5 GB at 4-bit2 also selling it hosted
• Mistral-7B-OpenOrcaOpenOrca7.0B≈4.5 GB at 4-bit
• Mistral-Trismegistus-7Bteknium7.0B≈4.5 GB at 4-bit
• Molmo-7B-O-0924Allen Institute for AI (Ai2)7.0B≈4.5 GB at 4-bit
• NeuralBeagle14-7Bmlabonne7.0B≈4.5 GB at 4-bit
• NeuralHermes-2.5-Mistral-7Bmlabonne7.0B≈4.5 GB at 4-bit
• Nxcode-CQ-7B-orpoNTQAI7.0B≈4.5 GB at 4-bit
• OLMoE-1B-7B-0924Allen Institute for AI (Ai2)7.0B≈4.5 GB at 4-bit
• OlympicCoder-7Bopen-r17.0B≈4.5 GB at 4-bit
• OpenHermes-2-Mistral-7Bteknium7.0B≈4.5 GB at 4-bit1 also selling it hosted
• Openhermes2.5 Mistral 7Bteknium7.0B≈4.5 GB at 4-bit2 also selling it hosted
• Orca-2-7bMicrosoft7.0B≈4.5 GB at 4-bit
• Qwen 2 7B InstructAlibaba7.0B≈4.5 GB at 4-bit4 also selling it hosted
• Qwen2-7BAlibaba7.0B≈4.5 GB at 4-bit
• Qwen2.5-Coder-7BAlibaba7.0B≈4.5 GB at 4-bit2 also selling it hosted
• Qwen2.5-Coder-7B-InstructAlibaba7.0B≈4.5 GB at 4-bit4 also selling it hosted
• Seed-X-PPO-7BByteDance Seed7.0B≈4.5 GB at 4-bit
• TAIDE-LX-7B-Chattaide7.0B≈4.5 GB at 4-bit
• UI-TARS-7B-SFTByteDance Seed7.0B≈4.5 GB at 4-bit
• Vistral-7B-ChatViet-Mistral7.0B≈4.5 GB at 4-bit
• WizardLM-7B-UncensoredQuixi AI7.0B≈4.5 GB at 4-bit
• chinese-alpaca-2-7bJoint Laboratory of HIT and iFLYTEK Research (HFL)7.0B≈4.5 GB at 4-bit
• codegemma-7b-itGoogle7.0B≈4.5 GB at 4-bit1 also selling it hosted
• deepseek-coder-7b-instruct-v1.5deepseek-ai7.0B≈4.5 GB at 4-bit1 also selling it hosted
• deepseek-llm-7b-basedeepseek-ai7.0B≈4.5 GB at 4-bit
• deepseek-llm-7b-chatdeepseek-ai7.0B≈4.5 GB at 4-bit
• deepseek-math-7b-instructdeepseek-ai7.0B≈4.5 GB at 4-bit
• deepseek-vl-7b-chatdeepseek-ai7.0B≈4.5 GB at 4-bit
• e5-mistral-7b-instructintfloat7.0B≈4.5 GB at 4-bit
• gemma-1.1-7b-itGoogle7.0B≈4.5 GB at 4-bit1 also selling it hosted
• gte-Qwen2-7B-instructAlibaba-NLP7.0B≈4.5 GB at 4-bit
• internlm-xcomposer2d5-7binternlm7.0B≈4.5 GB at 4-bit
• llava-v1.6-mistral-7b-hfLlava Hugging Face7.0B≈4.5 GB at 4-bit
• mixtral-7b-8expertDiscoResearch7.0B≈4.5 GB at 4-bit
• olmOCR-2-7B-1025Allen Institute for AI (Ai2)7.0B≈4.5 GB at 4-bit1 also selling it hosted
• olmOCR-7B-0725-FP8Allen Institute for AI (Ai2)7.0B≈4.5 GB at 4-bit1 also selling it hosted
• olmOCR-7B-0825Allen Institute for AI (Ai2)7.0B≈4.5 GB at 4-bit1 also selling it hosted
• open-calm-7bCyberAgent7.0B≈4.5 GB at 4-bit
• rwkv-4-pile-7bBlinkDL7.0B≈4.5 GB at 4-bit
• speed-embedding-7b-instructHaon-Chen7.0B≈4.5 GB at 4-bit
• stablelm-base-alpha-7bStability AI7.0B≈4.5 GB at 4-bit
• stablelm-tuned-alpha-7bStability AI7.0B≈4.5 GB at 4-bit
• vicuna-7b-v1.5Large Model Systems Organization7.0B≈4.5 GB at 4-bit
• xgen-7b-8k-baseSalesforce7.0B≈4.5 GB at 4-bit