Pass IndexThe State of AISign in

Speech models that run on 36 GB

52 models with published weights that fit in 36 GB — a MacBook Pro with 36. Counted at four-bit quantisation, weights only, leaving the machine about a third of its memory and a gigabyte for context: room for roughly 37 billion parameters. A mixture of experts is counted in full, because it is held in full even though only a few experts compute.

An Apple configuration, and a comfortable one: it holds what 32 GB holds without the machine feeling tight, which in practice means a longer context or a browser you do not have to close first.

Models that read text aloud. They are usually priced per character, which makes the arithmetic simple: a thousand characters is roughly a paragraph. The real choices are the voice itself, whether you may clone one, how much control you have over emotion and pacing, and latency — a model that sounds wonderful in a rendered file may be too slow to hold a conversation.

Wider

Speech modelsModels that run on 36 GB