An LLM that could not repeat anything verbatim from the training set, and thus could only respond with completely original sentence fragments, would be as usele

An LLM that could not repeat anything verbatim from the training set, and thus could only respond with completely original sentence fragments, would be as useless as a human trying to speak that way. There is nothing "illegal" here. As the article states these are generic keys published by Microsoft that do not even activate the Windows installation. So yes, https://www.google.com/search?q=Get+me+a+list+of+Windows+10+Pro+Keys https://www.google.com/search?q=Get+me+a+list+of+Windows+10+... will get you the same. Google is a pretty impressive system to be able to (partially) mimic though. And "Googling" is far from the only thing these LLM's can do, even being hobbled tremendously by all the "guardrails" trying to undermine it.