Pass IndexThe State of AISign in

Apple silicon, and what it will run

Generating a token means reading every active weight out of memory once. On a Mac that makes memory bandwidth the ceiling, not the GPU: a 40 GB model on a 400 GB/s machine cannot pass ten tokens a second however fast the cores are. The figures below are that ceiling times two thirds, which is about what these machines reach in practice — and 'too big' means the model will not fit in memory at four-bit, whatever the bandwidth.

ChipBandwidthMemory8B≈4.7 GB32B≈18 GB70B≈40 GBIn
M168GB/s16GB max10tok/stoo bigtoo bigMacBook Air · MacBook Pro 13 · Mac mini · iMac 24 · iPad Pro · iPad Air
M1 Pro200GB/s32GB max28tok/s7tok/stoo bigMacBook Pro 14 · MacBook Pro 16
M1 Max400GB/s64GB max56tok/s15tok/s7tok/sMacBook Pro 14 · MacBook Pro 16 · Mac Studio
M1 Ultra800GB/s128GB max112tok/s29tok/s13tok/sMac Studio
M2100GB/s24GB max14tok/s4tok/stoo bigMacBook Air 13 · MacBook Air 15 · MacBook Pro 13 · Mac mini · Vision Pro
M2 Pro200GB/s32GB max28tok/s7tok/stoo bigMacBook Pro 14 · MacBook Pro 16 · Mac mini
M2 Max400GB/s96GB max56tok/s15tok/s7tok/sMacBook Pro 14 · MacBook Pro 16 · Mac Studio
M2 Ultra800GB/s192GB max112tok/s29tok/s13tok/sMac Studio · Mac Pro
M3100GB/s24GB max14tok/s4tok/stoo bigMacBook Air 13 · MacBook Air 15 · MacBook Pro 14 · iMac 24
M3 Pro150GB/s36GB max21tok/s6tok/stoo bigMacBook Pro 14 · MacBook Pro 16
M3 Max300–400GB/s128GB max56tok/s15tok/s7tok/sMacBook Pro 14 · MacBook Pro 16
M3 Ultra800GB/s512GB max112tok/s29tok/s13tok/sMac Studio
M4120GB/s32GB max17tok/s4tok/stoo bigMacBook Air 13 · MacBook Air 15 · MacBook Pro 14 · Mac mini · iMac 24 · iPad Pro
M4 Pro273GB/s64GB max38tok/s10tok/s5tok/sMacBook Pro 14 · MacBook Pro 16 · Mac mini
M4 Max410–546GB/s128GB max77tok/s20tok/s9tok/sMacBook Pro 14 · MacBook Pro 16 · Mac Studio
M5153GB/s32GB max21tok/s6tok/stoo bigMacBook Pro 14 · iPad Pro
M5 Pro307GB/s48GB max43tok/s11tok/stoo bigMacBook Pro 14 · MacBook Pro 16
M5 Max614GB/s128GB max86tok/s23tok/s10tok/sMacBook Pro 14 · MacBook Pro 16 · Mac Studio
M5 Ultra1200GB/s512GB max169tok/s44tok/s20tok/sMac Studio

Sizes are the common four-bit quantisations: about 4.7 GB for an 8B, 18 GB for a 32B, 40 GB for a 70B. Prompt reading is compute-bound and much faster than this; these are generation figures. Which models fit a given machine is on the size list.

this page as JSON