3 ms·

because the amount of data you can train any model on is limited. After training your AI model on the 1st quadrillion images, trillion videos, where do you find

because the amount of data you can train any model on is limited. After training your AI model on the 1st quadrillion images, trillion videos, where do you find the next quadrillion? This is going to be the limitation on top of law of diminishing returns

echelon 2y ago
> After training your AI model on the 1st quadrillion images, trillion videos, As far as images and video are concerned, we're done. Frame generation is almost perfect, and we don't really need any more training data. Now it's time to build product and enhance how the models work. LLMs, though? That field appears to have hit a wall for now. AI for media is going to be a rocket ship. AI for knowledge and text and reasoning will take longer. People will recognize this soon.
- vineyardmike 2y ago
  > AI for media is going to be a rocket ship. Is there actually enough data to train an AI on? Photos seem to be a success, like you say, but everything else? I’ve heard many people make claims about where AI content will be most useful. A persistent theme is an AI made VR world, customized video games, and endless AI generated TikTok videos. I genuinely question if the training data exists for these use cases. Photos are cheap and easy, but quality annotated 3D models? Short form videos? What about long form video? Are we really there (assuming inference was cheap)?
  - echelon 2y ago
    > Short form videos? What about long form video? These are being solved as we speak. I'm working on this problem directly and the level of control and consistency achievable is incredible. Video is just a special case of images. Take a look at the ComfyUI space and the authors of plugins and papers. > quality annotated 3D models The research is progressing at a fast pace. We can get good surface topologies, textures, and there are teams working on everything from rigging to animation.
falcor84 2y ago
You release the agents into the wild as robots, to interact with the environment and continue collecting data of all modalities.
- rvnx 2y ago
  Totally, the next stage is that Tesla is copying to copy Unitree G1 robots, and let them loose, and learn and listen from the real world, and this where we are going to make very very interesting discoveries.
  - renegade-otter 2y ago
    Yes, robots will be just walking/crawling/driving "in the wild", on sidewalks and streets. Think about what you are saying.

echelon 2y ago

> After training your AI model on the 1st quadrillion images, trillion videos, As far as images and video are concerned, we're done. Frame generation is almost perfect, and we don't really need any more training data. Now it's time to build product and enhance how the models work. LLMs, though? That field appears to have hit a wall for now. AI for media is going to be a rocket ship. AI for knowledge and text and reasoning will take longer. People will recognize this soon.

vineyardmike 2y ago
> AI for media is going to be a rocket ship. Is there actually enough data to train an AI on? Photos seem to be a success, like you say, but everything else? I’ve heard many people make claims about where AI content will be most useful. A persistent theme is an AI made VR world, customized video games, and endless AI generated TikTok videos. I genuinely question if the training data exists for these use cases. Photos are cheap and easy, but quality annotated 3D models? Short form videos? What about long form video? Are we really there (assuming inference was cheap)?
- echelon 2y ago
  > Short form videos? What about long form video? These are being solved as we speak. I'm working on this problem directly and the level of control and consistency achievable is incredible. Video is just a special case of images. Take a look at the ComfyUI space and the authors of plugins and papers. > quality annotated 3D models The research is progressing at a fast pace. We can get good surface topologies, textures, and there are teams working on everything from rigging to animation.

falcor84 2y ago

You release the agents into the wild as robots, to interact with the environment and continue collecting data of all modalities.

rvnx 2y ago
Totally, the next stage is that Tesla is copying to copy Unitree G1 robots, and let them loose, and learn and listen from the real world, and this where we are going to make very very interesting discoveries.
- renegade-otter 2y ago
  Yes, robots will be just walking/crawling/driving "in the wild", on sidewalks and streets. Think about what you are saying.