gemma-2b
Access to model google/gemma-2b is restricted.
text → text · made by Google
Sold by
Nobody in the catalogue publishes a price for this yet.
Measured 9 standings
| Place | Board | Metric | Score |
|---|---|---|---|
| 72ndof 88 | Bbh — Epoch AI | Average | 0.352 |
| 82ndof 113 | Hella swag — Epoch AI | Overall accuracy | 0.714 |
| 95thof 113 | Piqa — Epoch AI | Score | 77.3 |
| 109thof 136 | Bool q — Epoch AI | Score | 69.4 |
| 111thof 134 | Arc ai2 — Epoch AI | Challenge score | 0.421 |
| 111thof 115 | Trivia qa — Epoch AI | EM | 0.532 |
| 113thof 137 | Wino grande — Epoch AI | Accuracy | 65.4 |
| 128thof 170 | Gsm8k — Epoch AI | EM | 0.177 |
| 174thof 217 | Mmlu — Epoch AI | EM | 0.423 |
About
gemma-2b — a text model from Google, placed 82nd of 113 on Hella swag — Epoch AI.
It takes text and returns text. It was published in February 2024. The catalogue files it under chat. Its weights are published under the gemma licence, which attaches conditions the plain open licences do not. It has been measured on 9 boards, and stands best at 82nd of 113 on Hella swag — Epoch AI.
Every current figure
- Maker
- Register
- model
- Takes
- text
- Returns
- text
- Published
- February 2024
- Parameters
- 2.5 billion · read from its own weights
- Licence
- gemma
- Boards
- 9
- Best place
- 82nd of 113 — Hella swag — Epoch AI
Known as 1 name
google/gemma-2b