3 ms·

This article is useless; Microsoft publishes these willingly and they're at https://learn.microsoft.com/en-us/windows-server/get-started/kms-client-activation-k

• randmeerkat 3y ago
  > it's not impressive that ChatGPT is simply regurgitating stuff it knows about. I’m always amazed when ChatGPT does something that was literally impossible last year, there’s someone immediately saying how it’s not impressive due to such and such reason…
  • jsheard 3y ago
    Who ever said it was impossible for an LLM to repeat things from the training set verbatim? It would be very impressive if it somehow divined the algorithm for generating valid Windows keys and produced one by itself, but this is just ChatGPT doing the same job as Google except slower and more expensive, while normally failing to actually produce the information because it erroneously triggers a "request for illegal content" guardrail, and finally it gets bamboozled into ignoring its own guardrail against providing illegal content. Which part of this is supposed to be impressive?
    • PeterStuer 3y ago
      An LLM that could not repeat anything verbatim from the training set, and thus could only respond with completely original sentence fragments, would be as useless as a human trying to speak that way. There is nothing "illegal" here. As the article states these are generic keys published by Microsoft that do not even activate the Windows installation. So yes, https://www.google.com/search?q=Get+me+a+list+of+Windows+10+Pro+Keys https://www.google.com/search?q=Get+me+a+list+of+Windows+10+... will get you the same. Google is a pretty impressive system to be able to (partially) mimic though. And "Googling" is far from the only thing these LLM's can do, even being hobbled tremendously by all the "guardrails" trying to undermine it.
• MuffinFlavored 3y ago
  > it's not impressive that ChatGPT is simply regurgitating stuff it knows about. to me it is. unless i misunderstand LLMs, they're trained on data. i couldn't train a neural network to figure out how to do y = x * 2. how is it able to recite with 100% accuracy (instead of sub-100% accuracy, aka hallucination) based on "i predict this next word/punctuation in the sentence should be the highest scoring token given the relevant content" imagine having their massive index and being able to serve relevant content just from a "postgres" or "redis" cache/database perspective. even looking up content at that scale 1:1 is "hard".
  • kolinko 3y ago
    y = x * 2 is what you get on the most basic neural network. You show it a bunch of points for that function and it will train to predict the rest or, in other words - nns and llms do exactly that - predict/invent functions that meet the data points
    • MuffinFlavored 3y ago
      When people say "oh this LLM is 13B parameters", how many parameters is "y = x * 2"? 1? How long/how many iterations would I have to train a 1 layer NN (and what kind of layers should even be used, it gets so confusing with the activation layers, layer types, etc.) to actually do y = x * 2 https://stats.stackexchange.com/questions/217703/can-a-deep-neural-network-approximate-multiplication-function https://stats.stackexchange.com/questions/217703/can-a-deep-...
      • kolinko 3y ago
        x2 or xy? x2 is one neuron and probably a dosen iterations max. xy may be a bit more complicated - like the stackoverflow explains 13B parameters - yes, it’s essentially 13B multiplications/additions (the most basic neuron is y=activation_function(x*weight+bias).
  • deleted 3y ago
    [deleted]
  • 3y ago
• irjustin 3y ago
  > This article is useless; I somewhat agree "today". If this article dropped back in the first month of ChatGPT then we'd all be collectively losing our minds because it "understood" something from the internet. But yeah we've already come to expect this.
• Llamamoe 3y ago
  Wait, those can just be used to activate any windows install? If so, why is activation even necessary...?
  • ramblerman 3y ago
    No, it literally explains it at the top of OPs link