3 ms·
Meta Llama 3 8B vs Claude Haiku according to their press releases if anyone else was curious | Benchmark | Llama3 8B | Claude Haiku | | ------------- | ------
by barrell 2y ago
Meta Llama 3 8B vs Claude Haiku according to their press releases if anyone else was curious
| Benchmark | Llama3 8B | Claude Haiku |
| ------------- | ----------- | ------------ |
| MMLU ____ | 68.4 ____ | 75.2 _______ |
| GPQA ____ | 34.2 ____ | 33.3 _______ |
| HumanEval | 62.2 ____ | 75.9 _______ |
| GSM-8K __ | 79.6 ____ | 88.9 _______ |
| MATH ____ | 30.0 ____ | 40.9 _______ |
- gliched_robot 2y agoThis llama model some made it run on an iphone. https://x.com/1littlecoder/status/1781076849335861637?s=46 https://x.com/1littlecoder/status/1781076849335861637?s=46