Models that run on 256 GB

1161 models with published weights that fit in 256 GB — a Mac Studio with 256. Counted at four-bit quantisation, weights only, leaving the machine about a third of its memory and a gigabyte for context: room for roughly 274 billion parameters. A mixture of experts is counted in full, because it is held in full even though only a few experts compute. 1,161 in all, a hundred to a page; this is page 7 of 12.

A Mac Studio at the top of its configuration, or a serious machine. Almost everything openly published fits, including the large mixtures of experts. At this point the constraint is no longer whether the model loads but whether it generates fast enough to be worth waiting for.

• zephyr-7b-betaHugging Face H47.2B≈4.7 GB at 4-bit1 also selling it hosted
• falcon-7bTechnology Innovation Institute7.2B≈4.7 GB at 4-bit
• falcon-7b-instructTechnology Innovation Institute7.2B≈4.7 GB at 4-bit
• starcoder2-7bbigcode7.2B≈4.7 GB at 4-bit1 also selling it hosted
• bloom-7b1BigScience Workshop7.1B≈4.6 GB at 4-bit
• llava-1.5-7b-hfLlava Hugging Face7.1B≈4.6 GB at 4-bit
• DeciLM-7BDeci AI7.0B≈4.6 GB at 4-bit
• chameleon-7bfacebook7.0B≈4.6 GB at 4-bit
• ALLaM-7B-Instruct-previewHUMAIN7.0B≈4.6 GB at 4-bit
• AlphaMonarch-7Bmlabonne7.0B≈4.5 GB at 4-bit
• BELLE-7B-2MBelleGroup7.0B≈4.5 GB at 4-bit
• BioMistral-7BBioMistral7.0B≈4.5 GB at 4-bit
• Chinese-Llama-2-7bLinkSoul7.0B≈4.5 GB at 4-bit
• CodeLlama-7b-Python-hfCode Llama7.0B≈4.5 GB at 4-bit
• Cosmos-1.0-Diffusion-7B-Text2WorldNVIDIA7.0B≈4.5 GB at 4-bit
• DeepSeek-R1-Distill-QWEN-7BDeepSeek7.0B≈4.5 GB at 4-bit3 also selling it hosted
• Dream-v0-Instruct-7BDream-org7.0B≈4.5 GB at 4-bit
• FastVLM-7BApple7.0B≈4.5 GB at 4-bit
• GritLM-7BGritLM7.0B≈4.5 GB at 4-bit
• Hy-MT2-7BTencent Hunyuan7.0B≈4.5 GB at 4-bit1 also selling it hosted
• Janus-Pro-7BDeepSeek7.0B≈4.5 GB at 4-bit1 also selling it hosted
• K2-Horizon-7BInstitute of Foundation Models7.0B≈4.5 GB at 4-bit
• Lily-Cybersecurity-7B-v0.2segolilylabs7.0B≈4.5 GB at 4-bit
• Llama-2-7bMeta Llama7.0B≈4.5 GB at 4-bit
• Llama-2-7b-chatMeta Llama7.0B≈4.5 GB at 4-bit
• Llama2-Chinese-7b-ChatFlagAlpha7.0B≈4.5 GB at 4-bit
• MiMo-7B-RLXiaomiMiMo7.0B≈4.5 GB at 4-bit
• MiMo-Audio-7B-InstructXiaomiMiMo7.0B≈4.5 GB at 4-bit
• MiMo-VL-7B-RLXiaomiMiMo7.0B≈4.5 GB at 4-bit
• Mistral-7B-Instruct-v0.1Mistral AI7.0B≈4.5 GB at 4-bit3 also selling it hosted
• Mistral-7B-Instruct-v0.2Mistral AI7.0B≈4.5 GB at 4-bit2 also selling it hosted
• Mistral-7B-Instruct-v0.3Mistral AI7.0B≈4.5 GB at 4-bit2 also selling it hosted
• Mistral-7B-OpenOrcaOpenOrca7.0B≈4.5 GB at 4-bit
• Mistral-Trismegistus-7Bteknium7.0B≈4.5 GB at 4-bit
• Molmo-7B-O-0924Allen Institute for AI (Ai2)7.0B≈4.5 GB at 4-bit
• NeuralBeagle14-7Bmlabonne7.0B≈4.5 GB at 4-bit
• NeuralHermes-2.5-Mistral-7Bmlabonne7.0B≈4.5 GB at 4-bit
• Nxcode-CQ-7B-orpoNTQAI7.0B≈4.5 GB at 4-bit
• OLMoE-1B-7B-0924Allen Institute for AI (Ai2)7.0B≈4.5 GB at 4-bit
• OlympicCoder-7Bopen-r17.0B≈4.5 GB at 4-bit
• OpenHermes-2-Mistral-7Bteknium7.0B≈4.5 GB at 4-bit1 also selling it hosted
• Openhermes2.5 Mistral 7Bteknium7.0B≈4.5 GB at 4-bit2 also selling it hosted
• Orca-2-7bMicrosoft7.0B≈4.5 GB at 4-bit
• Qwen 2 7B InstructAlibaba7.0B≈4.5 GB at 4-bit4 also selling it hosted
• Qwen2-7BAlibaba7.0B≈4.5 GB at 4-bit
• Qwen2.5-Coder-7BAlibaba7.0B≈4.5 GB at 4-bit2 also selling it hosted
• Qwen2.5-Coder-7B-InstructAlibaba7.0B≈4.5 GB at 4-bit4 also selling it hosted
• Seed-X-PPO-7BByteDance Seed7.0B≈4.5 GB at 4-bit
• TAIDE-LX-7B-Chattaide7.0B≈4.5 GB at 4-bit
• UI-TARS-7B-SFTByteDance Seed7.0B≈4.5 GB at 4-bit
• Vistral-7B-ChatViet-Mistral7.0B≈4.5 GB at 4-bit
• WizardLM-7B-UncensoredQuixi AI7.0B≈4.5 GB at 4-bit
• chinese-alpaca-2-7bJoint Laboratory of HIT and iFLYTEK Research (HFL)7.0B≈4.5 GB at 4-bit
• codegemma-7b-itGoogle7.0B≈4.5 GB at 4-bit1 also selling it hosted
• deepseek-coder-7b-instruct-v1.5deepseek-ai7.0B≈4.5 GB at 4-bit1 also selling it hosted
• deepseek-llm-7b-basedeepseek-ai7.0B≈4.5 GB at 4-bit
• deepseek-llm-7b-chatdeepseek-ai7.0B≈4.5 GB at 4-bit
• deepseek-math-7b-instructdeepseek-ai7.0B≈4.5 GB at 4-bit
• deepseek-vl-7b-chatdeepseek-ai7.0B≈4.5 GB at 4-bit
• e5-mistral-7b-instructintfloat7.0B≈4.5 GB at 4-bit
• gemma-1.1-7b-itGoogle7.0B≈4.5 GB at 4-bit1 also selling it hosted
• gte-Qwen2-7B-instructAlibaba-NLP7.0B≈4.5 GB at 4-bit
• internlm-xcomposer2d5-7binternlm7.0B≈4.5 GB at 4-bit
• llava-v1.6-mistral-7b-hfLlava Hugging Face7.0B≈4.5 GB at 4-bit
• mixtral-7b-8expertDiscoResearch7.0B≈4.5 GB at 4-bit
• olmOCR-2-7B-1025Allen Institute for AI (Ai2)7.0B≈4.5 GB at 4-bit1 also selling it hosted
• olmOCR-7B-0725-FP8Allen Institute for AI (Ai2)7.0B≈4.5 GB at 4-bit1 also selling it hosted
• olmOCR-7B-0825Allen Institute for AI (Ai2)7.0B≈4.5 GB at 4-bit1 also selling it hosted
• open-calm-7bCyberAgent7.0B≈4.5 GB at 4-bit
• rwkv-4-pile-7bBlinkDL7.0B≈4.5 GB at 4-bit
• speed-embedding-7b-instructHaon-Chen7.0B≈4.5 GB at 4-bit
• stablelm-base-alpha-7bStability AI7.0B≈4.5 GB at 4-bit
• stablelm-tuned-alpha-7bStability AI7.0B≈4.5 GB at 4-bit
• vicuna-7b-v1.5Large Model Systems Organization7.0B≈4.5 GB at 4-bit
• xgen-7b-8k-baseSalesforce7.0B≈4.5 GB at 4-bit
• granite-4.0-h-tinyIBM Granite6.9B≈4.5 GB at 4-bit
• NuminaMath-7B-TIRProject-Numina6.9B≈4.5 GB at 4-bit
• OLMo-7BAi26.9B≈4.5 GB at 4-bit
• Magicoder-S-DS-6.7BIntellligent Software Engineering (iSE)6.7B≈4.4 GB at 4-bit
• deepseek-coder-6.7b-instructDeepSeek6.7B≈4.4 GB at 4-bit
• meditron-7bEPFL LLM Team6.7B≈4.4 GB at 4-bit
• CodeLlama-7b-Instruct-hfCode Llama6.7B≈4.4 GB at 4-bit
• CodeLlama-7b-hfCode Llama6.7B≈4.4 GB at 4-bit
• sqlcoder-7b-2Defog.ai6.7B≈4.4 GB at 4-bit
• Llama-2-7b-chat-hfMeta Llama6.7B≈4.4 GB at 4-bit
• Llama-2-7b-hfMeta Llama6.7B≈4.4 GB at 4-bit
• llama-7bhuggyllama6.7B≈4.4 GB at 4-bit
• llama2_7b_chat_uncensoredgeorgesung6.7B≈4.4 GB at 4-bit
• LlamaGuard-7bMeta Llama6.7B≈4.4 GB at 4-bit1 also selling it hosted
• dinov3-vit7b16-pretrain-lvd1689mfacebook6.7B≈4.4 GB at 4-bit
• YuE-s1-7B-anneal-en-cotMultimodal Art Projection6.2B≈4.0 GB at 4-bit
• Z-ImageTongyi-MAI6.2B≈4.0 GB at 4-bit
• Z-Image-TurboTongyi-MAI6.2B≈4.0 GB at 4-bit
• Yi-6B01-ai6.1B≈3.9 GB at 4-bit1 also selling it hosted
• Yi-6B-200K01-ai6.0B≈3.9 GB at 4-bit
• gpt-j-6bEleutherAI6.0B≈3.9 GB at 4-bit
• pygmalion-6bPygmalion6.0B≈3.9 GB at 4-bit
• Chroma-4BFlashLabs5.9B≈3.8 GB at 4-bit
• higgs-tts-2-3b-baseBoson AI5.8B≈3.8 GB at 4-bit
• DeciLM-6bDeci AI5.7B≈3.7 GB at 4-bit