3 ms·
It looks cool, and I'm 100% behind the idea, but I'm more curious about what could be done on hardware that we all have broader access to, without requiring a s
by digdugdirk 10mo ago
It looks cool, and I'm 100% behind the idea, but I'm more curious about what could be done on hardware that we all have broader access to, without requiring a standalone custom purpose device.
What are the options for midlevel (or older flagship) smartphones? Used PCs? Macbooks with broken screens?
- neuphonic 10mo agoTTS models can be deployed on most devices (we do a lot of CPU work), but the real bottleneck for these on-device deployments is on the LLM side. Even a "small" 700m parameter LLM was problematic. Also running 3 models in parallel on a single device is not super straightforward.