> They are doing things with $100 and 13B params Not that I disagree with the general belief that OSS community is catching up, but this specific data point is

> They are doing things with $100 and 13B params Not that I disagree with the general belief that OSS community is catching up, but this specific data point is not as impactful as it sounds. Llama cannot be used for commercial purposes, and that $100 was spent on ChatGPT, which means we still depended on proprietary information of OpenAI. It looks to me that the OSS community needs a solid foundation model and a really comprehensive and huge dataset. Both require continuous heavy investment.