3 ms·
If you want to run the 405B model without spending thousands of dollars on dedicated hardware, you rent compute from a datacenter. Meta lists AWS, Google and M
by loudmax 2y ago
If you want to run the 405B model without spending thousands of dollars on dedicated hardware, you rent compute from a datacenter. Meta lists AWS, Google and Microsoft among others as cloud partners.
But also check out the 8B and 70B Llama-3.1 models which show improved benchmarks over the Llama-3 models released in April.
- TechDebtDevin 2y agoFor sure, I don't really have a need to self host the 405b anyways. But if I did want to rent that compute we're talking $5+ /hr so you'd need to have a really good reason.