4 ms·

Shouldn't this be the other way around? TikTok has the most user data for any LLM to train with. I bet they will make a killing with it, unless of course the CC

• nomel 2y ago
  What useful textual user data do you see coming from TikTok? All the text seems very low quality, to the point where I naively assume that including it in training data would decrease performance.
  • nextworddev 2y ago
    arguably video data is more valuable
    • cwmoore 2y ago
      whoosh
  • vineyardmike 2y ago
    As the sibling commenter mentioned, the video data itself is useful as we see a rise in multimodal models, but also.. (1) all videos are captioned, automatically then often again by the content creator manually. This data alone is extremely valuable for training purposes. (2) the videos contain great information about slang terms, and youth vernacular. Which is unique data that is harder to find elsewhere. (3) young people seem to use TikTok as a search engine, so presumably some of the videos' content must be explicitly valuable enough as an information source, similar to YouTube.
• aboardRat4 2y ago
  Firstly, Bytedance is far more than just Tiktok. Secondly, most data in China is shared among most companies anyway, because, firstly, the government (not necessarily CCP) orders most companies to share data with "technological leaders" and "strategically important" companies, and secondly because computer security is mostly an alien concept to Chinese. Copyright (broadly speaking, most restrictions on unrestricted dissemination if data) is what is killing the US economy.
  • suraci 2y ago
    > computer security is mostly an alien concept to Chinese. that's the main reason i don't know how the situation is elsewhere, but in China, 2/3 of startups expose their databases on public network with a password 'abc123'
    • frontfor 2y ago
      How do you know that?
      • suraci 2y ago
        i'm the one who set the password security is not a requirement for many startups, velocity is
        • nwiswell 2y ago
          > i'm the one who set the password You, personally, set the password to a public internet-facing database to 'abc123'? And if you really did, how much do you estimate that increased your 'velocity'?
          • suraci 2y ago
            you built a internal project, co-hosted with a database, with a password 'abc123' a month later, your manager decided to share it with other teams, the decision was made in a meeting which you're not invited when the manager came to you, you asked: - how about give me a week to make it a saas, with authn/authz - no, we don't have the time, just tell them the endpoint and the password another month later, something changed, your company built a partership with another company, your manager decided to share the project with teams in the other company you asked: - how about we do something like virtual network peering so that we can share a connected network with our parter - it's complex, we can not change the network status of our partner, and we don't have a responsible role for this work, just give them the endpoint and the password password 'abc123' is just a analogy, in this case, there's no password at all