5 ms·
Who cares, just check back in a year and see how its going.
by wilg 3y ago
Who cares, just check back in a year and see how its going.
- nvy 3y agoYep, the progress will be slow but inexorable on this front. Sooner or later we'll arrive at what I see as the optimum point for "AI", which is when I can put an ATX case in my basement with a few GPUs in it and run my own private open source GPT-6 (or whatever), without needing to get into bed with the lesser of two ShitCos, (edit: and while deriving actual utility from the installation). That's the milestone that will really get my attention.
- nsvd 3y agoYou already can run a local llama instance on a high-end graphics card (6+ GB VRAM).
- tpmx 3y agoAnd it's hilariously bad (in comparison to regular chatgpt).
- Der_Einzige 3y agoAnd slow. They never tell you that quantization of many LLMs slows down your inference, sometimes by orders of magnitude.
- arugulum 3y agoIt depends on the quantization method, but yes some of the most commonly used ones are extremely slow.
- nvy 3y agoYes, I can, but (see my edit) there's very little utility because the quality of output is very low. Frankly anything worse than the ChatGPT-3.5 that runs on the "open"AI free demo isn't much of a tool.
- TX81Z 3y agoPrecisely my point I don’t think a lot of people will go back. Even somebody like me who’s willing to put several hours into trying to see how both work won’t do that for every blog post about an “improvement”. Bard was rushed, and it shows. You only get one chance to make the first impression and they blew it.
- wilg 3y agoI don't think so for stuff like this, it kinda has to be built in public, and iteratively. If it gets good enough they'll surface it more in search and that'll be that.
- TX81Z 3y agoPartially agree with that sentiment but I don’t think it negates my point that they released something inferior because they were caught flat footed.
- LightBug1 3y agoCompetition is competition and I respect that. I'll use whatever is best in the moment. And if chatgpt start trying to network effect me into staying locked with them, I'll drop them like a bad date. Been there, done that. Never again. Ymmv
- jejeyyy77 3y agoWhat? After a year, they'll hear that Bard is really good at code assistance now and then they can try it again.