3 ms·
> is achingly small don't agree. the amount of written words we feed in, yes. but a tottler is a multimodal system including not only audio/images but actually
by anonyfox 3y ago
> is achingly small
don't agree. the amount of written words we feed in, yes. but a tottler is a multimodal system including not only audio/images but actually video, plus other senses like touch or smell. This complex input 24/7 is a lot of data that happens, and some brain relations to classify the world in form before it can spell out a label (word) for it.
Even just looking at a simple word (like "apple"), the human already has a lot of contextual information about it, mostly how its presented and how the presenter frames it (like yummy, tasty fruit! like other foods in the fridge, ...), and then people say the word physically pointing at the thing.
My guess thats an order of magnitude more total input than our LLMs get solely via text or other standalone channels for training.
- gizajob 3y agoI show you three unknown fruit, next to them are labels indicating they’re called glaxxghhhcht, shlooom, murv. You have to eat one. Which one do you eat? Which one does an LLM eat?