3 ms·
why does this imply theyve moved beyond next token? is it a throughput issue?
by disconcision 2y ago
why does this imply theyve moved beyond next token? is it a throughput issue?
- valine 2y agoI assume so, you can’t really tokenize audio, at least not high fidelity audio. Audio models like Bark don’t output logits from what I understand. For true multimodal output you’d need a model that can output both logits and audio embeddings.