Is the problem in guessing phonemes or guessing which word is being said based on the phonemes? I'd assume that phonemes are easy to guess at since it's such a

Is the problem in guessing phonemes or guessing which word is being said based on the phonemes? I'd assume that phonemes are easy to guess at since it's such a small set compared to the number of possible words.