2 ms·
> Maybe it's just me, but talking to toddlers often reminds me of interacting with LLMs It's not just you. It hit me almost a year ago, when I realized my then
by TeMPOraL 3y ago
> Maybe it's just me, but talking to toddlers often reminds me of interacting with LLMs
It's not just you. It hit me almost a year ago, when I realized my then 3.5yo daughter has a noticeable context window of about 30 seconds - whenever she went on her random rant/story, anything she didn't repeat within 30 seconds would permanently fall out of the story and never be mentioned again.
It also made me realize why small kids talk so repetitively - what they don't repeat they soon forget, and what they feel like repeating remains, so over the course of couple minutes, their story kind of knots itself in a loop, being mostly made of the thoughts they feel compelled to carry forward.