phixtral-4x2_8
phixtral-4x2_8 is the first Mixure of Experts (MoE) made with four microsoft/phi-2 models, inspired by the mistralai/Mixtral-8x7B-v0.1 architecture.
text → text · made by mlabonne
Sold by
Nobody in the catalogue publishes a price for this yet.
About
phixtral-4x2_8 — a text model from mlabonne.
It takes text and returns text. It was published in January 2024. The catalogue files it under chat. Its weights are published under MIT, so you may run it on your own machine, or buy it from whoever serves it cheapest.
Every current figure
- Maker
- mlabonne
- Register
- model
- Takes
- text
- Returns
- text
- Published
- January 2024
- Parameters
- 7.8 billion · read from its own weights
- Licence
- mit
Known as 1 name
mlabonne/phixtral-4x2_8