How are we determining it's a dead end here? Recently things like GPT-4 have come out which have improved on that technique. Why would specialization necessaril

How are we determining it's a dead end here? Recently things like GPT-4 have come out which have improved on that technique. Why would specialization necessarily reduce hallucination and improve accuracy?