FWIW, there's a lot of chatter in the AI world right now about the need for another "big" discovery like transformers were in order to take things to the next l

FWIW, there's a lot of chatter in the AI world right now about the need for another "big" discovery like transformers were in order to take things to the next level. There could well be a paper out right now that points us to the future, the dots just haven't been connected yet.. For those of us non-academic types working with what we have, though, we'll just have to wait and continue to experiment with the tools at hand. There's no shortage of things to explore, though, such as LLM as judge, eval techniques, and novel prompting approaches.