GPU hour

One hour of one accelerator, the unit underneath every per-token price.

what you are billed for · the vocabulary

Renting the card yourself makes sense when you can keep it busy; a token price is somebody else solving that problem and taking a margin for it. Comparing the two honestly means knowing your utilisation, which is usually far lower than assumed.

Nearby