Im not an expert in this field, but I think things have actually gone in the other direction. Look at IBM’s Watson (which won on jeopardy), and it was a system

Im not an expert in this field, but I think things have actually gone in the other direction. Look at IBM’s Watson (which won on jeopardy), and it was a system which consisted of diverse agents which would all evaluate the question in their own way and report back a result and a confidence score. Now look at GPT, it is transformers all the way down and it is doing much more diverse things than Watson could ever do. So I think the key is not in the diversity of agents, but in the diversity of data representations. GPT is limited by the text representing language, but what if you could train on data even more fundamental and expressive