Understand instruction in natural language. For example: 1.'grab that red ball' 2.'turn the handle on the door 90 degree then pull it out'. Just like how pe

Understand instruction in natural language. For example: 1.'grab that red ball' 2.'turn the handle on the door 90 degree then pull it out'. Just like how people would do it, a video and a piece of instruction listed and a label to indicate whether this task is a success or not. Then you show a different setting and a new instruction, if the model successfully generalize and understand the semantics behind it, it should carry out the instruction successfully.