4 ms·
50B still seems reasonable compared to the revenue of the Big AI companies.
by throw5959 2y ago
50B still seems reasonable compared to the revenue of the Big AI companies.
- mentalgear 2y agowhat revenues? If by big AI companies you mean llm service providers (OpenAI, ...), their revenues are far from high or profitable. https://www.cnbc.com/2024/09/27/openai-sees-5-billion-loss-this-year-on-3point7-billion-in-revenue.html https://www.cnbc.com/2024/09/27/openai-sees-5-billion-loss-t... Maybe Nvidia, but they are a chip / hardware maker first. And even for them 50B training run with no exponential gains seems unreasonable. Better to optimize the architecture / approach first, which also is what most companies are doing now before scaling out.
- throw5959 2y agoIt's not unusual to make infrastructure investments that will pay off in 30-50 years. I don't see why not an AI model - unless it's not true that we're at the end of scaling.