3 ms·
> Firstly, it's pretty crazy they allow words to be associated like this. ... I mean, this is what LLMs are. They're word association machines (or more pedanti
by rsynnott 2y ago
> Firstly, it's pretty crazy they allow words to be associated like this.
... I mean, this is what LLMs are. They're word association machines (or more pedantically token-association machines). What we're seeing here is almost certainly an initial speech recognition model followed by another model correcting the output to what it 'thinks' is most likely/reasonable. AIUI this is how most LLMish transcription things work; this is why they sometimes produce weird results where the topic is _unlikely_.
- bArray 2y ago> ... I mean, this is what LLMs are. I suspect it's not an LLM for dictation? It's probably a network that converts sound to some phonetic tokens, then some kind of probabilistic matching like a Markov chain (which would be computationally cheap locally)?