Pass IndexThe State of AISign in

phi-2

Phi-2 is a Transformer with 2.7 billion parameters.

text → text · made by Microsoft

Sold by

Nobody in the catalogue publishes a price for this yet.

Measured 8 standings

PlaceBoardMetricScore
9thof 15Adversarial nli — Epoch AIScore42.5
12thof 70Open book qa — Epoch AIAccuracy73.6
19thof 88Bbh — Epoch AIAverage0.594
22ndof 134Arc ai2 — Epoch AIChallenge score0.759
105thof 113Hella swag — Epoch AIOverall accuracy0.536
114thof 115Trivia qa — Epoch AIEM0.452
126thof 217Mmlu — Epoch AIEM0.584
134thof 137Wino grande — Epoch AIAccuracy54.7

About

phi-2 — a text model from Microsoft, placed 22nd of 134 on Arc ai2 — Epoch AI.

It takes text and returns text. It was published in December 2023. The catalogue files it under chat. Its weights are published under MIT, so you may run it on your own machine, or buy it from whoever serves it cheapest. It has been measured on 8 boards, and stands best at 22nd of 134 on Arc ai2 — Epoch AI.

Every current figure

Maker
Microsoft
Register
model
Takes
text
Returns
text
Published
December 2023
Parameters
2.8 billion · read from its own weights
Licence
mit
Boards
8
Best place
22nd of 134 — Arc ai2 — Epoch AI

Known as 1 name

microsoft/phi-2