4 ms·
I don't see how "they improved the models" is related to the bitter lesson. You are still injecting human-level expertise (whether it is by prompts or a structu
by j2kun 11mo ago
I don't see how "they improved the models" is related to the bitter lesson. You are still injecting human-level expertise (whether it is by prompts or a structured API) to compensate for the model's failures. A "bitter lesson" would be that the model can do better without any injection, but more compute power, than it could with human interference.
- idle_zealot 11mo ago> A "bitter lesson" would be that the model can do better without any injection, but more compute power, than it could with human interference. This is what I expected the post to be about before clicking.
- marshall300791 11mo agoThe bitter lesson here is that it all goes back to natural language rather than lower level of abstractions
- j2kun 11mo agoI would contest that this is not a "bitter lesson" in the sense that it has not been demonstrated repeatedly over decades as a truism of computer science.