Pass IndexThe State of AISign in

Open-weight evaluation models

11 in the catalogue today. Every one with what it costs, who sells it and where it stands.

Tools for judging what a model produced: scoring runs, tracing a chain of calls, catching a regression before a user does. Priced per trace or per evaluation. Most use a model as the judge, which is worth knowing, because it means your evaluation has a bill and an opinion of its own.

Weights published under a licence that lets you run them where you like and sell what you build — Apache 2.0, MIT and their kin impose little beyond keeping the notice. This is the list to start from if you need the model on your own hardware, in your own region, or simply want no third party between you and it. The trade is that hosting is now your problem, and the prices shown beside each one are what somebody else charges to do it for you.

Wider

Open-weight modelsEvaluation models