7 ms·
>Conveniently, the U.S. has been supplying infinite tokens to China through Tiktok How is this not FUD? What competitive advantage is China seeing in LLM train
by nemothekid 2y ago
>Conveniently, the U.S. has been supplying infinite tokens to China through Tiktok
How is this not FUD? What competitive advantage is China seeing in LLM training through dancing videos on TikTok?
- nextworddev 2y agoyou get video tokens through those seemingly dumb tiktok shorts
- nl 2y agoOf all the types of tokens in the world video is not the one that comes to mind as having a shortage. By setting a a few thousand security cameras in various high traffic places you can get almost infinite footage. Instagram, Youtube and Snapchat have no shortage of data too.
- nextworddev 2y agoexcept 1) tiktok is video stream data many orders of magnitude larger than any security cam data, that's attached to real identity 2) china doesn't have direct access to Instagram reels and shorts, so yeah
- nl 2y agoWhy does tying it to identity help LLM training? It's pretty unclear that having orders of magnitude more video data of dancing is useful. Diverse data is much useful!