4 ms·
I think the other thing that matters is that the relative proportions of vowel tones correspond to a word the listener expects to hear given the sentence/situat
by notahacker 4y ago
I think the other thing that matters is that the relative proportions of vowel tones correspond to a word the listener expects to hear given the sentence/situation. A word pronounced so unconventionally it's been turned into a homophone for another word will still generally be understood, even if the listener notices the "wrong" vowel tone. Which is where the 2bn parameters comes in...
- IIAOPSW 4y agoI fully agree that context the semantic content itself primes the listenerrs expectations of the next rabbit. But that sort of language model need not be GPT-level good. It just needs to identify which words/letters are unlikely to be next to each other and which ones they might be mistaken for. An unsophisticated Markov chain could do that. Is this really a 2B parameter problem, or do we do things this way because parameters are currently cheaper than expertise?