4 ms·
"They're also small, which makes them perfect for edge applications and phone integration." - you can't locally install or onprem Gemini right, so why does sma
by indigodaddy 2y ago
"They're also small, which makes them perfect for edge applications and phone integration."
- you can't locally install or onprem Gemini right, so why does small make it better for edge applications, essentially because small means light and fast, so it will respond quicker and with less latency? Requests are still going out over the network to Google though right?
- bagacrap 2y agoWrong, Android and Chrome infer locally
- indigodaddy 2y agoSo Gemini on Android isn't sending requests to the Internet? Highly unlikely
- bagacrap 2y agoI didn't mean to imply that all inference is local. A dynamic combination of server and local inference is called "hybrid".
- noname120 2y agoYou probably missed the news: https://news.ycombinator.com/item?id=43632049 https://news.ycombinator.com/item?id=43632049