3 ms·
Our company has development documents, guidelines, api's going back almost 20 years. If you follow them, life is good, if you don't, things don't work. The 20 y
by anonzzzies 1y ago
Our company has development documents, guidelines, api's going back almost 20 years. If you follow them, life is good, if you don't, things don't work. The 20 years is relevant because this is a lot of text + code. When we give this to o3, o4-mini, claude 3.5/7 it just ignores rules randomly; when we give it to gemini 2.5 pro preview, it just works. And after prompting multiple times in chat, the other models just start going into complete nonsense land. We often have cases where it even starts generating code in python while we were working in TS; apparently it compressed it's context so much it forget the actual basics? Not gemini. Haven't been able to mess it up in any practical case yet, which is why, maybe erroneously, attributed that to the context.
- killerstorm 1y ago"Context compression" is something a tool like Cursor does, not the model itself. It seems like the tool you're using works better with Gemini. From my experience, pretty much all coding tools have their quirks. I generally agree that Gemini is a very strong model, but I don't think we can at this point we can conclusively say Google would win because of the long context. It's too much to extrapolate from a single case. E.g. I see Gemini struggling with editing files a bit more than other models, but I'd say it's just growing pains rather than something fundamental