3 ms·
most teams don't want to self-host, and definitely don't want to have to run on-device eating up their ram
by willsmith72 3y ago
most teams don't want to self-host, and definitely don't want to have to run on-device eating up their ram
- whimsicalism 3y agoThere is no reason these models will be selfhost only.
- willsmith72 3y agoagreed, and I can't wait for gpt4 to have great competition in terms of ease, price and performance. I was responding to this > something that should just be completely on-device or self-hosted if you don't trust cloud-based AI models like ChatGPT Enterprise and want it all private and low cost
- lancesells 3y agoI get the self-host part, but if you had a dedicated machine would the ram be an issue? Can you run it on a machine with like 128GB of ram or the GPU equivalent?