6 ms·
Ive used GPT 4 for pretty much all of my programming needs and the convenience of a 20 dollar subscription taking care of everything and letting me use a LLM wi
by rikafurude21 3y ago
Ive used GPT 4 for pretty much all of my programming needs and the convenience of a 20 dollar subscription taking care of everything and letting me use a LLM without having to set up any models or servers has been just so simple, is the 2 percent gain worth looking into running a local model again? I tried running a local model a couple months ago but the perfomance was bad. I know code llama came out very recently but does anyone have any thoughts on perfomance regardi g programming tasks compared to GPT
- konschubert 3y agoI think for them it's about de-risking their business.
- redox99 3y agoIf all you care about is convenience, then anything cloud or SaaS will be better for you.
- ilaksh 3y agoPersonally I doubt that GPT-4 is really still at 67%. I would love to see some head-to-head examples. Is anyone hosting this somewhere that can be accessed for free right now?
- datameta 3y agoFor me the use case is asking a local LLM questions about an invention I'm working on, as with ChatGPT I can't be confident the ideas don't make their way into the model. I'm able to run some 13B 5Q models, in my opinion the utility and complexity is somewhere between GPT3 and GPT3.5, which doesn't quite cut it for this purpose. That's not to say anything of the lacking coding abilities. I'm on the fence of getting a 3090. If I do so I think I'll set up a server on the PC so I can query the LLM from my phone just like one can use ChatGPT.