2 ms·
According to [0]: - Books3 dataset - 700B text-image pairs from Laion-2B-en, filtered to only keep images with at least 256 resolution - 400M text-image pair
by agnosticmantis 3y ago
According to [0]:
- Books3 dataset
- 700B text-image pairs from Laion-2B-en, filtered to only keep images with at least 256 resolution
- 400M text-image pairs from COYO-700M, filtered to only keep images with at least 256 resolution
- 10M text-video pairs from WebVid10M
- 3M text-video pairs from a subset of InternVid10M
- 73K text-video chat pairs from Valley-Instruct-73K
- 100K text-video chat pairs from Video-ChatGPT
0: https://huggingface.co/LargeWorldModel/LWM-Chat-1M-Jax#training-dataset https://huggingface.co/LargeWorldModel/LWM-Chat-1M-Jax#train...