Pass IndexThe State of AISign in

Evaluation models, tools and agents

54 in the catalogue today. Every one with what it costs, who sells it and where it stands.

Tools for judging what a model produced: scoring runs, tracing a chain of calls, catching a regression before a user does. Priced per trace or per evaluation. Most use a model as the judge, which is worth knowing, because it means your evaluation has a bill and an opinion of its own.