5 ms·

I don’t know if Google has GPUs on the computers in their massive server farms. I expect they have the resources to make a large language model comparable to t

I don’t know if Google has GPUs on the computers in their massive server farms. I expect they have the resources to make a large language model comparable to the best out there. I agree they didn’t come out with that as technology for sale since monetizing tech requires a special kind of genius. The old faithful process of advertising, selling, buying, and delivering, doesn’t require fancy intelligence so much as consistency and persistence

Legend2440 3y ago
They actually have their own custom neural network accelerator called a TPU. They're one of the only companies not reliant on NVidia at the moment. Until OpenAI showed up, they were widely considered the leader in AI research.
- grobbyy 3y ago
  It's a huge Google disadvantage. Everyone reliant on NVidia has an ecosystem. Google has internal systems which are expensive to maintain and generally worse than best-of-breed systems. Google can't leverage the progress everyone else makes. Google might even reach above average, but they'll still be behind market leaders. AMD and Intel are playing on this space too and it's hard for Google to beat all of them. Everyone else can just use the current winner.