Models that run on 16 GB

846 models with published weights that fit in 16 GB — the common laptop. Counted at four-bit quantisation, weights only, leaving the machine about a third of its memory and a gigabyte for context: room for roughly 16 billion parameters. A mixture of experts is counted in full, because it is held in full even though only a few experts compute. 846 in all, a hundred to a page; this is page 9 of 9.

The commonest laptop configuration, and the point where a genuinely useful model runs locally: fourteen billion parameters at four-bit fits with room to spare for the context. Expect a capable general assistant that will not match the frontier, and remember that anything else the machine is doing competes for the same memory.

• bert-base-multilingual-casedBERT community0.2B≈0.1 GB at 4-bit
• Audio8-TTS-Preview-0.1bEdge00.2B≈0.1 GB at 4-bit
• jina-embeddings-v2-base-zhJina AI0.2B≈0.1 GB at 4-bit
• gpt-neo-125mEleutherAI0.2B≈0.1 GB at 4-bit
• ModernBERT-baseAnswer.AI0.1B≈0.1 GB at 4-bit
• gte-modernbert-baseAlibaba-NLP0.1B≈0.1 GB at 4-bit
• modernbert-embed-baseNomic AI0.1B≈0.1 GB at 4-bit
• bart-basefacebook0.1B≈0.1 GB at 4-bit
• jina-embeddings-v2-base-enJina AI0.1B≈0.1 GB at 4-bit
• MagicPrompt-Stable-DiffusionGustavosta0.1B≈0.1 GB at 4-bit
• gpt2OpenAI community0.1B≈0.1 GB at 4-bit
• nomic-embed-text-v1Nomic AI0.1B≈0.1 GB at 4-bit
• distilbert-base-multilingual-caseddistilbert0.1B≈0.1 GB at 4-bit
• distiluse-base-multilingual-cased-v2sentence-transformers0.1B≈0.1 GB at 4-bit
• SmolLM2-135MHuggingFaceTB0.1B≈0.1 GB at 4-bit
• roberta-baseFacebook AI community0.1B≈0.1 GB at 4-bit
• roberta-base-squad2deepset0.1B≈0.1 GB at 4-bit
• openjourneyprompthero0.1B≈0.1 GB at 4-bit
• paraphrase-multilingual-MiniLM-L12-v2sentence-transformers0.1B≈0.1 GB at 4-bit
• bert-base-uncasedBERT community0.1B≈0.1 GB at 4-bit
• pubmedbert-base-embeddingsNeuML0.1B≈0.1 GB at 4-bit
• bert-base-casedBERT community0.1B≈0.1 GB at 4-bit
• bert-base-chineseBERT community0.1B≈0.1 GB at 4-bit
• BEN2Prama LLC0.1B≈0.1 GB at 4-bit
• wav2vec2-base-960hAI at Meta0.1B≈0.1 GB at 4-bit
• nomic-embed-vision-v1.5Nomic AI0.1B≈0.1 GB at 4-bit
• distilgpt2DistilBERT community0.1B≈0.1 GB at 4-bit
• ast-finetuned-audioset-10-10-0.4593Massachusetts Institute of Technology0.1B≈0.1 GB at 4-bit
• dinov2-basefacebook0.1B≈0.1 GB at 4-bit
• vit-base-patch16-224Google0.1B≈0.1 GB at 4-bit
• vit-base-patch16-224-in21kGoogle0.1B≈0.1 GB at 4-bit
• nsfw_image_detectionFalcons.ai0.1B≈0.1 GB at 4-bit
• Soprano-1.1-80Mekwek0.1B≈0.1 GB at 4-bit
• distilbert-base-uncasedDistilBERT community0.1B≈0.0 GB at 4-bit
• t5-smallT5 community0.1B≈0.0 GB at 4-bit
• RMBG-1.4BRIA AI0.0B≈0.0 GB at 4-bit
• detr-resnet-50AI at Meta0.0B≈0.0 GB at 4-bit
• whisper-tinyOpenAI0.0B≈0.0 GB at 4-bit
• gte-smallthenlper0.0B≈0.0 GB at 4-bit
• table-transformer-structure-recognitionMicrosoft0.0B≈0.0 GB at 4-bit
• table-transformer-detectionMicrosoft0.0B≈0.0 GB at 4-bit
• segformer_b2_clothesmattmdjaga0.0B≈0.0 GB at 4-bit
• dinov3-vits16-pretrain-lvd1689mfacebook0.0B≈0.0 GB at 4-bit
• segformer-b0-finetuned-ade-512-512NVIDIA0.0B≈0.0 GB at 4-bit
• Ornith-1.0-9BOrnith0.0B≈0.0 GB at 4-bit
• AutoGLM-Phone-9BZ.ai0.0B≈0.0 GB at 4-bit