3 ms·
The running costs will drop precipitously with time. Especially in Googles position - they can afford to design custom silicon for their search engine, and po
by londons_explore 4y ago
The running costs will drop precipitously with time. Especially in Googles position - they can afford to design custom silicon for their search engine, and potentially save money compared to having hundreds of copies of every page on the whole internet sitting in RAM, just waiting for some user query to maybe need to see it, which they currently do.
Language models are only a few terabytes of RAM, which is small chips in comparison.