The last 10 years of deep learning progress are all thanks to Open Source and Open Research. 95% of LLM progress in the past year is also thanks to open models,

The last 10 years of deep learning progress are all thanks to Open Source and Open Research. 95% of LLM progress in the past year is also thanks to open models, which allowed the field to work on things like QLoRa, long context lenghts, RAG and etc. Big Cos benefit the most from this since they have the resources and data to scale up these methods and a large user base to deploy it to.