3 ms·
I agree that sorting something that messy can't easily be done with a heuristic expert system, but I'm registering my concern that the whole approach is predica
by conartist6 1y ago
I agree that sorting something that messy can't easily be done with a heuristic expert system, but I'm registering my concern that the whole approach is predicated on first making a huge mess with one LLM then cleaning up the mess with another.
The classical approach is more like "change the definition of the problem until you don't need to make a big mess in the first place"
- thegeomaster 1y agoThis might be a controversial take, but this approach is just plain old engineering applied to LLMs. Instead of making an LLM perform both an accurate code edit AND follow a strict output schema, you split that into two problems: accurate code edit with a lax output schema, then application of that lax output schema to the original file. You can then use different models for the two tasks, reducing your probability of failure.
- conartist6 1y agoYeah, it's just that I'm building things to last the next 50 years. Of course you can build a skyscraper on a foundation of wet noodles and it would still be (impressive) engineering, but the structure would not stand the test of time. So yeah, it's a clever approach, and useful even, but there's no way I can see that that such a noodl-y hack could become the bedrock for all other infrastructure