3 ms·
According to the linked PDF which includes a report from AWS professional services, the PoC was originally devised in September 2023 and conducted in January/Fe
by a2128 2y ago
According to the linked PDF which includes a report from AWS professional services, the PoC was originally devised in September 2023 and conducted in January/February of 2024, before the release of Llama 3. They tested Llama2-70B, Mistral-7b and MistralLite. They didn't evaluate proprietary models such as GPT4 probably because they would've wanted to be able to deploy it within Australia or with an Australian company
- brrrrrm 2y agoperhaps the title should be "Llama2-70B worse than humans ..."