Pass IndexThe State of AISign in

Conditionally licensed evaluation models

7 in the catalogue today, and the list grows as the market does. Every one with what it costs, who sells it and where it stands.

Tools for judging what a model produced: scoring runs, tracing a chain of calls, catching a regression before a user does. Priced per trace or per evaluation. Most use a model as the judge, which is worth knowing, because it means your evaluation has a bill and an opinion of its own.

Weights you can download, under a licence that asks for something in return: an acceptable-use policy, a naming requirement, a revenue ceiling above which you must ask, a restriction on training other models. The Llama and Gemma families are the familiar cases. Read the actual licence before you build on one of these — the condition is usually easy to meet and occasionally fatal, and which it is depends on your product rather than on the model.

Wider

Conditionally licensed modelsEvaluation models