4 ms·
There's no way this doesn't backfire. OpenAI has no moat, so making the bot/api a shill just means people are going to use something else. GPT5 would have to
by CuriouslyC 3y ago
There's no way this doesn't backfire. OpenAI has no moat, so making the bot/api a shill just means people are going to use something else.
GPT5 would have to be an order of magnitude better on the price/performance scale for me to even get close to this.
- yborg 3y agoEverything else is going to be a shill, too. 'People' will eventually have to pay for these valuations.
- CuriouslyC 3y agoThat's exactly what Yann LeCunn @ Meta is fighting against, and it seems Mark Zuckerberg has his back.
- baobabKoodaa 3y agoI already have llama on my local machine, nothing anyone can do will make it shill products to me.
- MrDarcy 3y agoLet me test this hypothesis. I run a small business that pays for Google workspace. I pay for a ChatGPT subscription and use it daily as a coding copilot. Is there any reason I shouldn’t switch to Gemini and cancel ChatGPT? If no reason, I’ll try it this afternoon.
- fwlr 3y agoNo financial incentive or relationships to disclose, just a satisfied user: I found that SuperMaven was a better “coding copilot”. If you happen to use VSCode I’d check that one out this afternoon.
- CuriouslyC 3y agoLlama3 and Claude also work well, they're good at different types of code and problem solving. The only thing ChatGPT does clearly better than the rest is infer meaning from poorly worded/written prompts.
- int_19h 3y agoThe main reason is that GPT-4 is still significantly better than everything else. Time will tell if OpenAI will be able to retain the lead in the race, though. While there's no public competing model with equal power yet, competitors are definitely much closer than they were before, and keep advancing. But, of course, GPT-5 might be another major leap.
- CuriouslyC 3y agoThat's not true really. With well written prompts GPT4 is better at some things and worse at others than Claude/Llama3. GPT4 only appears to be the best by a wide margin if your benchmark suite is vague, poorly specified prompts and your metric for evaluation is "did it guess what I wanted accurately"
- int_19h 3y agoMy benchmark is giving it novel (i.e. guaranteed to not be in the training set) logical puzzles that require actual reasoning ability, and seeing how it performs. By that benchmark, GPT-4 significantly outperforms both LLaMA 3 and Claude in my personal experience.
- CuriouslyC 3y agoThat's occurring because you're giving it weak prompts, like I said. GPT4 has been trained to do things like chain of thought by default, where as you have to tell Llama/Claude to do some of that stuff. If you update your prompts to suggest reasoning strategies and tell it to perform some chain of thought before hand the difference between models should disappear.
- int_19h 3y agoYou are assuming a great deal of things. No, you can absolutely come up with puzzles where no amount of forced CoT will make the others perform on GPT-4 level. Hell, there are puzzles where you can literally point out where the answer is wrong and ask the model to correct itself, and it will just keep walking in circles making the same mistakes over and over again.
- tsunamifury 3y agoIt will drive up the value of the "un-tainted" API.