2 ms·
There are people trying to frankenstain-merge Mistral and Whisper in a single multimodal model [1]. I wonder if this could improve the latency. [1] : https://
by gpderetta 3y ago
There are people trying to frankenstain-merge Mistral and Whisper in a single multimodal model [1]. I wonder if this could improve the latency.
[1] : https://paul.mou.dev/posts/2023-12-31-listening-with-llm/ https://paul.mou.dev/posts/2023-12-31-listening-with-llm/
- huac 3y agoyes (you skip a decoding step) but also no (when do you start emitting?)