Batch
A queue: you hand over the work, the seller runs it when there is room, and you pay about half.
how it is sold · the vocabulary
batch queueasync
The trade is time — a batch job returns within hours rather than seconds. It suits anything nobody is waiting for: classification over an archive, evaluation runs, bulk translation. It is a different product from the live rate, which is why this site never quotes a batch price as the price of a model.