3 ms·
This might be a controversial take, but this approach is just plain old engineering applied to LLMs. Instead of making an LLM perform both an accurate code edi
by thegeomaster 1y ago
This might be a controversial take, but this approach is just plain old engineering applied to LLMs.
Instead of making an LLM perform both an accurate code edit AND follow a strict output schema, you split that into two problems: accurate code edit with a lax output schema, then application of that lax output schema to the original file. You can then use different models for the two tasks, reducing your probability of failure.
- conartist6 1y agoYeah, it's just that I'm building things to last the next 50 years. Of course you can build a skyscraper on a foundation of wet noodles and it would still be (impressive) engineering, but the structure would not stand the test of time. So yeah, it's a clever approach, and useful even, but there's no way I can see that that such a noodl-y hack could become the bedrock for all other infrastructure