Video models that run on 96 GB

28 models with published weights that fit in 96 GB — a MacBook Pro with 96. Counted at four-bit quantisation, weights only, leaving the machine about a third of its memory and a gigabyte for context: room for roughly 102 billion parameters. A mixture of experts is counted in full, because it is held in full even though only a few experts compute.

An Apple configuration for people who intend to run models rather than occasionally try one. Comfortably holds the seventy-billion class with a very long context, or a mixture-of-experts model whose active parameters are few but whose weights are all resident.

Models that generate moving footage, most of them now with sound. Priced by the second of output, sometimes doubled for higher resolution, which makes this the most expensive thing in the catalogue to experiment with — a minute of 1080p can cost more than a million tokens of text. Check the maximum clip length and whether it will continue from an image you supply.

Wider

Video models Models that run on 96 GB