Mixtral 8x22B
llmMistral AI's second open sparse mixture-of-experts model, using only 39B of its 141B parameters per token. Scores are for the base model.
Metadata
| org | Mistral AI |
| released | 2024-04-17 |
| params | 141B-A39B |
| license | apache-2.0 |
| kind | llm |
| hf id | mistralai/Mixtral-8x22B-v0.1 |
Benchmarks
| MMLU | 77.75 | source ↗ |
| HumanEval | 45.1 | source ↗ |
Lineage
No recorded lineage — root or standalone model.
view in full graph →