2 ms·
These models are autoregressive so I doubt they are running them across multiple clouds. And besides, a pause button is useful from a user's pov.
by amelius 7mo ago
These models are autoregressive so I doubt they are running them across multiple clouds. And besides, a pause button is useful from a user's pov.
- stainablesteel 7mo agoi'm not sure it is, what's so useful about it?
- amelius 7mo agoLike I said in another comment: It often happens that the interesting information is in the first paragraph or so, and the remainder is all just the LLM not knowing when to stop. This is super annoying as a conversation then ends up being 90% noise.