4 ms·
> The next step is multi-modal data. Think videos, sounds, touch, etc. Remember that the data must be annotated. This puts limits on what can be usefully inges
by PaulDavisThe1st 4y ago
> The next step is multi-modal data. Think videos, sounds, touch, etc.
Remember that the data must be annotated. This puts limits on what can be usefully ingested.
- stevenhuang 4y agoNot necessarily, see the developments in self supervised learning. It's what's relied on for the majority of the RLHF phase in current LLMs.
- mlboss 4y agoWhat if it can annotate itself ? With some feedback loop it can learn the correct annotation by experiments like a child. Earlier there was a comment of an agent learning to run a python program by itself and in the process of writing code to file and install python interpreter.