3 ms·

Why would gpt train from search engine data instead of the actual documents being indexed?

• ge96 3y ago
  Not just documents, everything, every website that becomes searchable information. How would that work in the future if people don't use search engines, how does the gpt/llm bring that info in. Not saying it's not possible, would there be an API people submit their content into... Edit: actually I wonder if wikipedia will make one (model) they have so much info
  • wfvr 3y ago
    The whole text of wikipedia has been included in training data for basically all LLMs since the start.
    • ge96 3y ago
      That's cool real Hitch Hiker's Guide book