You can't do better than perfect. But if the default is sufficiently bad, you can seem to violate conservation by putting more effort in. Similarly to when a m

You can't do better than perfect. But if the default is sufficiently bad, you can seem to violate conservation by putting more effort in. Similarly to when a machine has an efficiency of 1%, optimizing it to 10% does not violate thermodynamics. There is a limit to what you can learn from limited knowledge. Every bit of information you learn can only divide the space of possible theories by half. However, current LLMs are ludicrously far from that limit.