Parameters
The trained numbers that constitute a model, counted in billions.
what it is made of · the vocabulary
7B70Bweights
A rough guide to capability and a precise guide to what it takes to run: at four-bit precision reckon about 0.65 GB of memory per billion. For a mixture of experts the total tells you the memory and the active count tells you the speed.