4 ms·
Wholeheartedly agree. Latency is good, nice tech (Rust! Running at the edge on a consumer grade laptop!). I guess a natural question is: are there options to tr
by 08d319d7 2y ago
Wholeheartedly agree. Latency is good, nice tech (Rust! Running at the edge on a consumer grade laptop!). I guess a natural question is: are there options to transplant a “better llm” into moshi without degrading the experience.
- dsmurrell 2y agoSame question here.
- aversis_ 2y agoBut tbh "better" is subjective here. Does the new LLM improve user interactions significantly? Seems like people get obsessed with shiny new models without asking if it’s actually adding value.
- Kerbonut 2y agoWith flux, they have been able to separate out the unet. I wonder if something similar could be done here so parts of it can be swapped.