4 ms·
No GPU-accelerated search-engine yet ?
by ddorian43 10y ago
No GPU-accelerated search-engine yet ?
- Katydid 10y agoWould be pretty expensive at scale and much has been done to optimize CPU only for search.
- iced0wn 10y agoGoogle is TPU accelerated. Gpu is last generation.
- viggity 10y agowhile it isn't a GPU exactly, Bing is built on top of FPGAs. https://blogs.microsoft.com/next/2016/10/17/the_moonshot_that_succeeded/ https://blogs.microsoft.com/next/2016/10/17/the_moonshot_tha...
- deepnotderp 10y agoGoogle uses neural nets extensively for search, those run on TPUs and Bing uses fpga for acceleration, presumably also for neural networks. Both are more efficient than a gpu.
- arcanus 10y agoThat is for inference. The neural networks are trained using GPUs.
- deepnotderp 10y agoWell yes, but I would assume that this case would be for inference, since GPUs are pretty much train once and deploy everywhere (granted, hyperparameter tuning is still a point).