4 ms·
I really want this for Whisper, particularly in some kind of a power-efficient, portable form factor. I think people underestimate how much of a revolution hav
by miki123211 2mo ago
I really want this for Whisper, particularly in some kind of a power-efficient, portable form factor.
I think people underestimate how much of a revolution having an always-on, privacy-preserving personal notetaker / secretary would be.
- mike_hearn 2mo agoAI is bigger than just LLMs. The real place model-hardwired chips will find value is in robotics. There you need very local, low latency inferencing with relatively stable models to handle motor control and navigation tasks. Higher level reasoning can be delegated to LLMs and run asynchronously.
- walthamstow 2mo agoI don't think any underestimates how powerful it would be. It's the social aspect that is difficult. I wouldn't want to be sat in a pub with you and your always-on notetaker.