3 ms·
>> Small models, slightly improved, probably still not good enough for the same use as online models. Nothing wrong with incremental progress, however. An even
by phkahler 2y ago
>> Small models, slightly improved, probably still not good enough for the same use as online models. Nothing wrong with incremental progress, however.
An even smaller language model should still be useful as part of a speech-to-text system. These should benefit from using the language model to narrow down what word is spoken in the face of ambiguity or noise.
- woodson 2y agoASR systems already use language models during decoding, though mostly not large decoder-only LLMs. However, incorporating LLMs into ASR is currently at the center of a lot of research, e.g. using a speech encoder like wav2vec 2.0 or the whisper encoder with a Qformer etc. and a LoRA adapter on an LLM trained for ASR.
- omarelb 2y agoReally interested in this! Do you know of some good reading in this area?