2 ms·
I would very much like not to have to download 22 GB for some inference capability that is way worse than API calls both in terms of quality and speed. I would
by fg137 6mo ago
I would very much like not to have to download 22 GB for some inference capability that is way worse than API calls both in terms of quality and speed.
I would rather pay money than seeing this thing running in my browser that only prints 5 tps on high-end consumer hardware.
- jfoster 6mo agoWhy are you pretending those are the options? The options are: 1. 22GB per website 2. 22GB per browser 3. 0GB / No AI capabilities By having this in Chrome they are simply ensuring that option 2 replaces option 1. You still have option 3.
- fg137 6mo agoNo. The real options are 1. No AI 2. AI that works and is actually useful 3. AI that is slow, crappy and hallucinates all the time I choose 1 and 2.
- jfoster 6mo agoFair, but actually you'd surely want your choice of those three, right? And what's being discussed here is what the better implementation of option 3 is. My point is that if you're going with one of the possible implementations of option 3, then 22GB per browser is objectively a lot better than 22GB per website.