4 ms·
Larger models are more robust reasoners. Is there a limit? What if you make a 5 TB model trained on a lot of multimodal data where the language information was
by ilaksh 2y ago
Larger models are more robust reasoners. Is there a limit? What if you make a 5 TB model trained on a lot of multimodal data where the language information was fully grounded in videos and images etc. Could more robust reasoning be that simple?
- ryoshu 2y agoIt could be simpler. Humans don't need 5TB of data to reason.
- Workaccount2 2y agoThe amount of data needed to train a human brain is enormous.
- Philpax 2y agoThink about the sheer amount of data that you receive through your five senses over 570,000,000 seconds/18 years. It's a lot, lot more than 5TB.