3 ms·
Good luck hosting 2.8T params yourself. A box capable of this at a useful performance level is at least $100k.
by baq 3mo ago
Good luck hosting 2.8T params yourself. A box capable of this at a useful performance level is at least $100k.
- Sanzig 3mo agoMore like $500k, but that's not an unreasonable price for a medium sized enterprise to pay. I have an RF engineering background, a nice mmWave vector network analyzer can easily land in that ballpark. If the business value is there, companies will pay for it.
- jfaat 3mo agoNot to mention the bill you would be paying anthropic could be way higher at that scale
- unethical_ban 3mo agoHow much would it cost to run a 2.8T model with long context for 1000 developers, plus 30,000 non-dev employees with short session memory?