Translation models that run on 128 GB

18 models with published weights that fit in 128 GB — a large Mac or a server card. Counted at four-bit quantisation, weights only, leaving the machine about a third of its memory and a gigabyte for context: room for roughly 136 billion parameters. A mixture of experts is counted in full, because it is held in full even though only a few experts compute.

A large Mac or a server card. This is where the biggest openly published models come within reach — and where the distinction between total and active parameters starts to decide everything, because a mixture of experts computes with a fraction of itself and must still be held whole.

Models and services aimed at moving text between languages. A general chat model will translate too, and often well; a dedicated one earns its place with glossaries, formality control, document formats it keeps intact, and rates that assume volume. Check which direction was measured — most quality figures are for translating into English, and the other direction is harder.

Wider

Translation models Models that run on 128 GB