2 ms·
Confirmed. I asked both Gemini and GPT4 to assist with a proto3 rpc service I'm working on. The initial prompt was well specified. Both provided nearly exact
by MrDarcy 2y ago
Confirmed. I asked both Gemini and GPT4 to assist with a proto3 rpc service I'm working on. The initial prompt was well specified. Both provided nearly exactly the same proto file, which was correct and idiomatic.
However, I then asked both, "Update the resource.spec.model field to represent any valid JSON object."
Gemini told me to use a google.protobuf.Any type.
GPT4 told me to use a google.protobuf.Struct type.
Both are valid, but the Struct is more correct and avoids a ton of issues with middle boxes.
Anyway, sample size of 1 but it does seem like GPT4 is better, even for as well-specified prompts as I can muster.
- CuriouslyC 2y agoYou need to specify a perspective to write code from (e.g. software architect who values maintainability and extensibility over performance or code terseness), and prompt models to use the most idiomatic or correct technique. GPT4 is tuned to avoid some of this but it will improve answers there as well.