3 ms·
I've been arguing this is the way AI should be deployed. Rather than trying to sell ai as an end to end solution, just let it do the small part that it can reli
by demarq 3y ago
I've been arguing this is the way AI should be deployed. Rather than trying to sell ai as an end to end solution, just let it do the small part that it can reliably do. It's cost effective for the host, and valuable for the user. win win engineering!
- deleted 3y ago[deleted]
- apozem 3y agoI mean, I get why all these startups are trying to sell AI as a panacea. It’s an exciting technology and someone has to figure out its limits. That said, as a user, it is nice to see LLMs used in a small, discrete, undeniably useful way like this. No flashy promises, nothing new for me to learn- it’s just autocorrect, but better.
- tempaccount420 3y agoIt makes a lot more economical sense to cloud-host big models like GPT-4 and optimize them for the hardware they run on. But for small models, sure, let the user run them locally, eliminating network latency.
- rgbrgb 3y agoI wouldn’t want to send everything I type to apple’s auto suggest server. For me it’s quite important that this is not apple’s approach to privacy.