3 ms·
If you watch Google’s keynote, the majority of LLM inference they showed happens on their cloud. (Also called private cloud to borrow apples term) They activel
by dagmx 2y ago
If you watch Google’s keynote, the majority of LLM inference they showed happens on their cloud. (Also called private cloud to borrow apples term)
They actively call out only a few areas that run locally.
Almost all their summary features are in the cloud for example. Unlike Apple, they haven’t figured out API to let apps vend data to their AI system.