4 ms·
It all sounds good as a consumer but there are a few questions which are by no means clear to me: * How does getting recommendations from a chatbot (what TV to
by gerash 4y ago
It all sounds good as a consumer but there are a few questions which are by no means clear to me:
* How does getting recommendations from a chatbot (what TV to buy) play with websites that produce such content (TV reviews)
* How does it play with websites that rely on ad impression
* How can you monetize a chatbot? (there's an easy way: free tier + monthly subscription)
* How to reduce the massive compute cost of a good chatbot without making it bad (this also seems more straightforward)
- visarga 4y agoApparently Google is capable of doing cool things. DeepMind’s speculative sampling achieves 2–2.5x decoding speedups in LLM. That brings cost down significantly, without degradation in quality.