3 ms·
[Author] I see it differently. I see that Anyscale built some really great infrastructure for scaling AI that could be applied to many domains. What we've seen
by waleedk 3y ago
[Author] I see it differently. I see that Anyscale built some really great infrastructure for scaling AI that could be applied to many domains. What we've seen is the market shift to LLMs, and we've been able to adapt our tech to new domains.
Our prices are competitive (starting at 25c per million tokens) because of the tech we've built that maximizes GPU utilization. That's what we do better than anyone else.
I still think GPT-4 is best LLM out there. It's just very expensive and you don't need all that horsepower you can save bucketloads of money.