6 ms·

Man, its knowledge is insane. I run a dying forum. I first prompted with "Who is <creator pseudonym> at <my website>?" and it gave me a very endearing, weirdly

Man, its knowledge is insane. I run a dying forum. I first prompted with "Who is <creator pseudonym> at <my website>?" and it gave me a very endearing, weirdly knowledgeable bio of myself and my contributions to the forum including various innovations I made in the space back in the day. It summarized my role on my own forum better than I could have ever written it. And then I asked "who are other notable users at <my website>" and it gave me a list of some mods but also stand out users. It knew the types of posts they wrote and the subforums they spent time in. And without a single hallucination.

jprete 3y ago
I wonder if it's RAGing? Dying Internet forums are way, way into the tail of the data.
- gpderetta 3y ago
  I asked about gpderetta and he did hallucinate quite a bit (after some flattery).
- atemerev 3y ago
  No, I tested it, this is a pure model without RAG (at least no internet search)
  - swyx 3y ago
    please say what you tested, so that we can understand your effort without necessarily generalizing your conclusions beyond what you actually tried
    - atemerev 3y ago
      Asking for the information about non-public individuals, including myself. RAG-assisted GPT-4 easily provides such information. GPT2 output is consistent with a good model without RAG (it tries to speculate, but says it doesn’t have such information ultimately). I liked that it doesn’t try to hallucinate things.
      - zaptrem 3y ago
        You could also test this more easily with current events.
    - Kuinox 3y ago
      You can ask it's knowledge cutoff and it will respond November 2023. It have no idea of the big events of the beginning of 2024, like the earthquake in Japan.
      - david_allison 3y ago
        It's close to live-ingesting GitHub. I uploaded a text + translation into English on Sunday, and it's almost perfectly replicated the translation. 0 Google results.
        Kuinox 3y ago
        It's unable to know anything about the project I work on, so I don't think so.
        swyx 3y ago
        how is this proof of live ingesting github?
        brianjking 3y ago
        lol, clearly doesn't seem to be.
      - Jensson 3y ago
        > You can ask it's knowledge cutoff and it will respond November 2023 It probably just repeated something based on what common AI cutoffs there are, LLMs doesn't have a sense or self or thought process, they don't know more about themselves than the text given to them about themselves, and even then it is likely to default to some common text from the internet.
        jstanley 3y ago
        I think it's prompted with a bunch of context information (like, "you are a helpful, harmless, honest AI assistant created by OpenAI, your knowledge cutoff date is ..., please answer the user's questions"). If you really think it is just saying whatever it read on the web, how do you explain that not all LLM chatbots claim to be ChatGPT? Engineering is happening, it's not just a raw model of text from the web connected directly to the user.
- hombre_fatal 3y ago
  What database would it RAG from? The long tail in the model's data is also the long tail of any data. There are no google searches that have the information it provided about my forum nor is the info neatly collated anywhere on my own forum. Its knowledge about my forum isn't only obscure, it's also an itemization of obscure events over time to draw obscure conclusions that only a historian of my forum would know. That's what's so impressive. Granted, my forum was once the largest forum of its genre though that was almost 15 years ago, so it's not some dead proboards forum.
93po 3y ago
i just tested this too, really cool. i own a yaris have used an online forum for yaris cars for the past decade and had a vague memory of a user who deleted some of the most helpful guides. i asked about it and sure enough it knew exactly who i meant: who's a user on yaris forums that deleted a ton of their helpful guides and how-to posts?: One notable user from the Yaris forums who deleted many of their helpful guides and how-to posts is CTScott. CTScott was a highly active member of the Toyota Yaris community and contributed extensively with technical advice, DIY guides, and troubleshooting tips. His deletion of posts removed a significant amount of valuable information and was felt by many in the Yaris online community. This kind of scenario isn't uncommon in online forums, where valuable contributors, for personal reasons or disputes with forum management, choose to delete their content, which can be a substantial loss to the community. tell me more about ctscott: CTScott is a particularly well-remembered member of the Yaris community, primarily active on forums such as YarisWorld. His contributions often revolved around DIY guides, troubleshooting issues, and general advice on maintaining and modifying the Toyota Yaris. Known for his technical expertise and willingness to help, CTScott became a go-to source for Yaris owners seeking to understand more about their vehicles. ### Key Contributions: 1. *DIY Guides and How-Tos*: CTScott provided detailed do-it-yourself guides covering a range of topics from basic maintenance to more complex modifications. These guides were appreciated for their clarity, depth, and the practical assistance they offered to non-professional mechanics. 2. *Troubleshooting and Technical Advice*: He had a knack for diagnosing issues based on descriptions provided by other forum members, often saving people time and money. His advice frequently helped users fix problems on their own. 3. *Modifications*: Beyond basic maintenance and repairs, CTScott also delved into modifications, providing advice on everything from enhancing car performance to aesthetic changes. 4. *Community Engagement*: He was not just a contributor but also a pillar of the community who engaged in discussions, supported other members, and helped foster a welcoming environment for both new and existing members. ### Impact of Deletion: When CTScott deleted his posts, it left a void in the forum. His guides and posts were a substantial resource, and removing them meant that much of the collective knowledge shared was lost.
- PoignardAzur 3y ago
  Holy crap. Even if this is RAG-based, this is insanely good.
thequadehunter 3y ago
It actually knew info about an account of mine on Newgrounds I abandoned around 2011, and I wasn't famous on there or anything.
m3kw9 3y ago
If this isn’t Google, google stock may really go down hard
MyFirstSass 3y ago
Weird, it doesn't seem to have any info on reddit users or their writings. I tried asking about a bunch, also just about general "legendary users" from various subreddits and it seemingly just hallucinated.
- lelandfe 2y ago
  They may have put restrictions in place. I know they did after the NYT sued them over being able to reproduce paywalled articles. Which is different from not actually having that info.
- concurrentsquar 3y ago
  Reddit may have told OpenAI to pay (probably a lot of) money to legally use Reddit content for training, which is something Reddit is doing with other AI labs (https://www.cbsnews.com/news/google-reddit-60-million-deal-ai-training/ https://www.cbsnews.com/news/google-reddit-60-million-deal-a... ); but GPTBot is not banned under the Reddit robots.txt (https://www.reddit.com/robots.txt https://www.reddit.com/robots.txt). This is assuming that lmsys' GPT-2 is retained GPT-4t or a new GPT-4.5/5 though; I doubt that (one obvious issue: why name it GPT-2 and not something like 'openhermes-llama-3-70b-oai-tokenizer-test' (for maximum discreetness) or even 'test language model (please ignore)' (which would work well for marketing); GPT-2 (as a name) doesn't really work well for marketing or privacy (at least compared to the other options)). Lmsys has tested models with weird names for testing before: https://news.ycombinator.com/item?id=40205935 https://news.ycombinator.com/item?id=40205935
  - Tetou 3y ago
    robot.txt doesnt really mean anything, I used to work for a company that scraped the web and this was literally not a concern. That being said, using data for training LLMs is a new things and potential lawsuits going reddit's way are a possiblity, we can't really know. One note, its name is not gpt-2 it is gpt2 which could indicate its a "second version" of the previous gpt architecture, gpt-3, gpt-4 being gpt1-3, gpt1-4. I am just speculating and am not an expert whatsoever this could be total bullshit.
  - 3y ago
skerit 3y ago
It does seem to have more data. I asked it about some of my Github projects that don't have any stars, and it responded correctly. Wasn't able to use direct-chat, so I always chose it as the winner in battle mode! OpenAI has been crawling the web for quite a while, but how much of that data have they actually used during training? It seems like this might include all that data?
- SirMaster 3y ago
  Hmm, I asked it about my GitHub project that has been out for 4 years and it got everything completely wrong.
  - Bombthecat 3y ago
    Did you try increase the information a bit, like: can you give me more information about the GitHub project xxx written in xxx?

jprete 3y ago

I wonder if it's RAGing? Dying Internet forums are way, way into the tail of the data.

gpderetta 3y ago
I asked about gpderetta and he did hallucinate quite a bit (after some flattery).
atemerev 3y ago
No, I tested it, this is a pure model without RAG (at least no internet search)
- swyx 3y ago
  please say what you tested, so that we can understand your effort without necessarily generalizing your conclusions beyond what you actually tried
  - atemerev 3y ago
    Asking for the information about non-public individuals, including myself. RAG-assisted GPT-4 easily provides such information. GPT2 output is consistent with a good model without RAG (it tries to speculate, but says it doesn’t have such information ultimately). I liked that it doesn’t try to hallucinate things.
    - zaptrem 3y ago
      You could also test this more easily with current events.
  - Kuinox 3y ago
    You can ask it's knowledge cutoff and it will respond November 2023. It have no idea of the big events of the beginning of 2024, like the earthquake in Japan.
    - david_allison 3y ago
      It's close to live-ingesting GitHub. I uploaded a text + translation into English on Sunday, and it's almost perfectly replicated the translation. 0 Google results.
      - Kuinox 3y ago
        It's unable to know anything about the project I work on, so I don't think so.
      - swyx 3y ago
        how is this proof of live ingesting github?
        brianjking 3y ago
        lol, clearly doesn't seem to be.
    - Jensson 3y ago
      > You can ask it's knowledge cutoff and it will respond November 2023 It probably just repeated something based on what common AI cutoffs there are, LLMs doesn't have a sense or self or thought process, they don't know more about themselves than the text given to them about themselves, and even then it is likely to default to some common text from the internet.
      - jstanley 3y ago
        I think it's prompted with a bunch of context information (like, "you are a helpful, harmless, honest AI assistant created by OpenAI, your knowledge cutoff date is ..., please answer the user's questions"). If you really think it is just saying whatever it read on the web, how do you explain that not all LLM chatbots claim to be ChatGPT? Engineering is happening, it's not just a raw model of text from the web connected directly to the user.
hombre_fatal 3y ago
What database would it RAG from? The long tail in the model's data is also the long tail of any data. There are no google searches that have the information it provided about my forum nor is the info neatly collated anywhere on my own forum. Its knowledge about my forum isn't only obscure, it's also an itemization of obscure events over time to draw obscure conclusions that only a historian of my forum would know. That's what's so impressive. Granted, my forum was once the largest forum of its genre though that was almost 15 years ago, so it's not some dead proboards forum.

93po 3y ago

i just tested this too, really cool. i own a yaris have used an online forum for yaris cars for the past decade and had a vague memory of a user who deleted some of the most helpful guides. i asked about it and sure enough it knew exactly who i meant: who's a user on yaris forums that deleted a ton of their helpful guides and how-to posts?: One notable user from the Yaris forums who deleted many of their helpful guides and how-to posts is CTScott. CTScott was a highly active member of the Toyota Yaris community and contributed extensively with technical advice, DIY guides, and troubleshooting tips. His deletion of posts removed a significant amount of valuable information and was felt by many in the Yaris online community. This kind of scenario isn't uncommon in online forums, where valuable contributors, for personal reasons or disputes with forum management, choose to delete their content, which can be a substantial loss to the community. tell me more about ctscott: CTScott is a particularly well-remembered member of the Yaris community, primarily active on forums such as YarisWorld. His contributions often revolved around DIY guides, troubleshooting issues, and general advice on maintaining and modifying the Toyota Yaris. Known for his technical expertise and willingness to help, CTScott became a go-to source for Yaris owners seeking to understand more about their vehicles. ### Key Contributions: 1. *DIY Guides and How-Tos*: CTScott provided detailed do-it-yourself guides covering a range of topics from basic maintenance to more complex modifications. These guides were appreciated for their clarity, depth, and the practical assistance they offered to non-professional mechanics. 2. *Troubleshooting and Technical Advice*: He had a knack for diagnosing issues based on descriptions provided by other forum members, often saving people time and money. His advice frequently helped users fix problems on their own. 3. *Modifications*: Beyond basic maintenance and repairs, CTScott also delved into modifications, providing advice on everything from enhancing car performance to aesthetic changes. 4. *Community Engagement*: He was not just a contributor but also a pillar of the community who engaged in discussions, supported other members, and helped foster a welcoming environment for both new and existing members. ### Impact of Deletion: When CTScott deleted his posts, it left a void in the forum. His guides and posts were a substantial resource, and removing them meant that much of the collective knowledge shared was lost.

PoignardAzur 3y ago
Holy crap. Even if this is RAG-based, this is insanely good.

thequadehunter 3y ago

It actually knew info about an account of mine on Newgrounds I abandoned around 2011, and I wasn't famous on there or anything.

m3kw9 3y ago

If this isn’t Google, google stock may really go down hard

MyFirstSass 3y ago

Weird, it doesn't seem to have any info on reddit users or their writings. I tried asking about a bunch, also just about general "legendary users" from various subreddits and it seemingly just hallucinated.

lelandfe 2y ago
They may have put restrictions in place. I know they did after the NYT sued them over being able to reproduce paywalled articles. Which is different from not actually having that info.
concurrentsquar 3y ago
Reddit may have told OpenAI to pay (probably a lot of) money to legally use Reddit content for training, which is something Reddit is doing with other AI labs (https://www.cbsnews.com/news/google-reddit-60-million-deal-ai-training/ https://www.cbsnews.com/news/google-reddit-60-million-deal-a... ); but GPTBot is not banned under the Reddit robots.txt (https://www.reddit.com/robots.txt https://www.reddit.com/robots.txt). This is assuming that lmsys' GPT-2 is retained GPT-4t or a new GPT-4.5/5 though; I doubt that (one obvious issue: why name it GPT-2 and not something like 'openhermes-llama-3-70b-oai-tokenizer-test' (for maximum discreetness) or even 'test language model (please ignore)' (which would work well for marketing); GPT-2 (as a name) doesn't really work well for marketing or privacy (at least compared to the other options)). Lmsys has tested models with weird names for testing before: https://news.ycombinator.com/item?id=40205935 https://news.ycombinator.com/item?id=40205935
- Tetou 3y ago
  robot.txt doesnt really mean anything, I used to work for a company that scraped the web and this was literally not a concern. That being said, using data for training LLMs is a new things and potential lawsuits going reddit's way are a possiblity, we can't really know. One note, its name is not gpt-2 it is gpt2 which could indicate its a "second version" of the previous gpt architecture, gpt-3, gpt-4 being gpt1-3, gpt1-4. I am just speculating and am not an expert whatsoever this could be total bullshit.
- 3y ago

skerit 3y ago

It does seem to have more data. I asked it about some of my Github projects that don't have any stars, and it responded correctly. Wasn't able to use direct-chat, so I always chose it as the winner in battle mode! OpenAI has been crawling the web for quite a while, but how much of that data have they actually used during training? It seems like this might include all that data?

SirMaster 3y ago
Hmm, I asked it about my GitHub project that has been out for 4 years and it got everything completely wrong.
- Bombthecat 3y ago
  Did you try increase the information a bit, like: can you give me more information about the GitHub project xxx written in xxx?