5 ms·
yeah many people don't understand how cheap it is to use the chatgpt API not to mention all of the other benefits of delegating all the work of setting up the
by jhatemyjob 2y ago
yeah many people don't understand how cheap it is to use the chatgpt API
not to mention all of the other benefits of delegating all the work of setting up the GPUs, public HTTP server, designing the API, security, keeping the model up-to-date with the state of the art, etc
reminds me of the people in the 2000s / early 2010s who would build their own linux boxes back when the platform was super unstable, constantly fighting driver issues etc instead of just getting a mac.
roll-your-own-LLM makes even less sense. at least for those early 2000s linux guys, even if you spent an ungodly amount of time going through the arch wiki or compiling gentoo or whatever, at least those skills are somewhat transferrable to sysadmin/SRE. i dont see how setting up your own instance of ollama has any transferable skills
the only way i could see it making sense is if you're doing super cutting edge stuff that necessitates owning a tinybox, or if you're trying to get a job at openAI or anysphere
- eikenberry 2y agoDepends on what you value. Many people value keeping general purpose computing free/libre and available to as many as possible. This means using free systems and helping those systems mature.
- jhatemyjob 2y agoIf you're in a position like mitchellh or antirez then more power to you
- grahamj 2y agoI would agree with that if I didn't mind handing over my prompts/data to big tech companies. But I do.
- deleted 2y ago[deleted]
- deleted 2y ago[deleted]
- jhatemyjob 2y agoThere are similar superstitions around proprietary software, I hope one day you are able to overcome it before you waste too much of your precious time
- grahamj 2y agoIn what way is wanting to keep my prompts and data private superstition?