I personally think research and improved methods to produce input data is where AI will improve the most in the near term. Mistral AI sent shockwaves in the com

I personally think research and improved methods to produce input data is where AI will improve the most in the near term. Mistral AI sent shockwaves in the community as their 7B model seemed to outperform Llama 2’s 13B model and I think there is still much to do here. Both in terms of bias but also discovering what is the optimal representation of input data to produce the desired results from the AI in an optimal model size. This pressure will only grow as the enterprise takes on AI and wants to fine tune their own models in order to not rely on the cloud as they need to fulfill privacy regulations and deal with sensitive documents. And in this regard, I think we have been underestimating just how much the input data influences the result.