3 ms·

I use a Claude and Gemini a lot for coding and I realized there is no good or best model. Every model has it's upside and downside. I was trying to get authenti

I use a Claude and Gemini a lot for coding and I realized there is no good or best model. Every model has it's upside and downside. I was trying to get authentication working according to the newer guidelines of Manifest V3 for browser extensions and every model is terrible. It is one use case where there is not much information or right documentation so every model makesup stuff. But this is my experience and I don't speak for everyone.

copperx 2y ago
That's when having a huge context is valuable. Dump all of the new documentation into the model along with your query and the chances of success hugely increase.
huijzer 2y ago
Relatedly, I start to think more and more the AI is great for mediocre stuff. If you just need to do the 1000th website, it can do that. Do you want to build a new framework? Then there will probably be less many useful suggestions. (Still not useless though. I do like it a lot for refactoring while building xrcf.) EDIT: One reason that lead me to think it's better for mediocre stuff was seeing the Sora model generate videos. Yes it can create semi-novel stuff through combinations of existing stuff, but it can't stick to a coherent "vision" throughout the video. It's not like a movie by a great director like Tarantino where every detail is right and all details point to the same vision. Instead, Sora is just flailing around. I see the same in software. Sometimes the suggestions go towards one style and the next moment into another. I guess AI currently is just way lower in their context length. Tarantino has been refining his style for 30 years now. And always he has been tuning his model towards his vision. AI in comparison seems to always just take everything and turn it into one mediocre blob. It's not useless but currently good to keep in mind I think. That you can only use it to generate mediocre stuff.
- meiraleal 2y ago
  We got to the point that AI isn't great because it is not like a Tarantino movie. What a time to be alive.
  - huijzer 2y ago
    We got to the point that AI CEOs pretend AI can make a Tarantino movie and get away with it.
monkmartinez 2y ago
This is true for all newish code bases. You need to provide the context it needs to get the problem right. It has been my experience that one or two examples with new functions or new requirements will suffice for a correction.
xnx 2y ago
> I use a Claude and Gemini a lot for coding and I realized there is no good or best model. True to a point, but is anyone using GPT2 for anything still? Sometimes the better model completely supplants others.

copperx 2y ago

That's when having a huge context is valuable. Dump all of the new documentation into the model along with your query and the chances of success hugely increase.

huijzer 2y ago

Relatedly, I start to think more and more the AI is great for mediocre stuff. If you just need to do the 1000th website, it can do that. Do you want to build a new framework? Then there will probably be less many useful suggestions. (Still not useless though. I do like it a lot for refactoring while building xrcf.) EDIT: One reason that lead me to think it's better for mediocre stuff was seeing the Sora model generate videos. Yes it can create semi-novel stuff through combinations of existing stuff, but it can't stick to a coherent "vision" throughout the video. It's not like a movie by a great director like Tarantino where every detail is right and all details point to the same vision. Instead, Sora is just flailing around. I see the same in software. Sometimes the suggestions go towards one style and the next moment into another. I guess AI currently is just way lower in their context length. Tarantino has been refining his style for 30 years now. And always he has been tuning his model towards his vision. AI in comparison seems to always just take everything and turn it into one mediocre blob. It's not useless but currently good to keep in mind I think. That you can only use it to generate mediocre stuff.

meiraleal 2y ago
We got to the point that AI isn't great because it is not like a Tarantino movie. What a time to be alive.
- huijzer 2y ago
  We got to the point that AI CEOs pretend AI can make a Tarantino movie and get away with it.

monkmartinez 2y ago

This is true for all newish code bases. You need to provide the context it needs to get the problem right. It has been my experience that one or two examples with new functions or new requirements will suffice for a correction.

xnx 2y ago

> I use a Claude and Gemini a lot for coding and I realized there is no good or best model. True to a point, but is anyone using GPT2 for anything still? Sometimes the better model completely supplants others.