3 ms·
This is not a real world goal though because a real world user would just rent a GitHub Copilot or similar.
by koakuma-chan 2y ago
This is not a real world goal though because a real world user would just rent a GitHub Copilot or similar.
- fxtentacle 2y agoUnless, of course, NDAs prevent you from using outside cloud compute. I'm benchmarking possible on-prem solutions because I know that I'll need an on-prem AI. But yeah, I'm not a normal user.
- tmpz22 2y agoPrices keep going up, if you're getting value from LLMs it is valuable expertise to be able to self-host. Right now everything is VC subsidized and so cost-benefit-analysis is warped.