3 ms·
More like LLMs are near commodity at the common tier the ones who wins are those who can inference the cheapest and google is easily thr best positioned to do t
by johnsmith1840 2mo ago
More like LLMs are near commodity at the common tier the ones who wins are those who can inference the cheapest and google is easily thr best positioned to do that with many years of custom chip model optimization.
Google is going to be able to push cost down further and for longer than anyone else. They also rightfully believe this is a company ending gamble if they fail they could be a second tier player for decades.
So better inference margins, far better operation experience serving cheap AI at massive scale, a massive warchest, and the fear of complete company irrelevence.
That's going to be one hell of a company to beat for free tier LLMs. Also chatgpt is impressive but it's notthing like google search quite yet. On top of that AI labs must use google's product for their AI.
They also own more data by an exponential margin. Anything but dominance of free AI on google's side would mean they are just so incompetent they deserve to fail.