3 ms·

> it's not impressive that ChatGPT is simply regurgitating stuff it knows about. I’m always amazed when ChatGPT does something that was literally impossible la

• jsheard 3y ago
  Who ever said it was impossible for an LLM to repeat things from the training set verbatim? It would be very impressive if it somehow divined the algorithm for generating valid Windows keys and produced one by itself, but this is just ChatGPT doing the same job as Google except slower and more expensive, while normally failing to actually produce the information because it erroneously triggers a "request for illegal content" guardrail, and finally it gets bamboozled into ignoring its own guardrail against providing illegal content. Which part of this is supposed to be impressive?
  • PeterStuer 3y ago
    An LLM that could not repeat anything verbatim from the training set, and thus could only respond with completely original sentence fragments, would be as useless as a human trying to speak that way. There is nothing "illegal" here. As the article states these are generic keys published by Microsoft that do not even activate the Windows installation. So yes, https://www.google.com/search?q=Get+me+a+list+of+Windows+10+Pro+Keys https://www.google.com/search?q=Get+me+a+list+of+Windows+10+... will get you the same. Google is a pretty impressive system to be able to (partially) mimic though. And "Googling" is far from the only thing these LLM's can do, even being hobbled tremendously by all the "guardrails" trying to undermine it.