4 ms·

One unexpected benefit of LLM (to me) is that it memorized large parts of the internet, so it has some backup like properties. SO is down, but ChatGPT memorized

One unexpected benefit of LLM (to me) is that it memorized large parts of the internet, so it has some backup like properties. SO is down, but ChatGPT memorized it already.

saintradon 3y ago
Yeah definitely. My default thought process was always, ok I'll just get a cached version, but now it's like - lemme see what GPT-4 thinks about this problem first.
tehbeard 3y ago
It may have memorized it, but recollection with accuracy is not it's strong suit.
twelve40 3y ago
> SO is down, but ChatGPT memorized memorized SO, also known as "stole". when i (and everyone else) write for SO, i give them permission to use what i write, but never did I sign up for the GPT theft of that data.
- Wissenschafter 3y ago
  [dead]
- r2_pilot 3y ago
  You gave them permission to use it, and they used it in such a way that GPT benefits from it as training data. I'm sorry you misplaced your trust in Stack Overflow for not protecting your public writings. Knowledge is awesome, though, in that it's like a candle and by lighting a new flame, your initial candle is not diminished in any way. It's not even your sole candle but merely one in a roaring bonfire.
  - twelve40 3y ago
    > misplaced your trust in Stack Overflow that's a great way to put it, I'm very disappointed they aren't the ones to innovate in this new direction, even though people gave them all the power (and data) to do it. Which they chose to give away to "Open" AI aka Microsoft and now spend their time bickering over GPT detectors and writing nonsensical CEO "vision" posts. Basically, they really are now in a position to fizzle away at this rate, which is a shame, because I believe a community of acknowledged authors is a much more appealing way to advance knowledge than Microsoft anonymously milking the world for their sole profit and credit.
- 8note 3y ago
  Your content is licensed with https://creativecommons.org/licenses/by-sa/4.0/ https://creativecommons.org/licenses/by-sa/4.0/ when you submit it to SO to host and share. You agreed that gpt can use it, so long as it includes attribution, and specifies when it makes changes
  - pests 3y ago
    > so long as it includes attribution, and specifies when it makes changes Does it, though?
phatfish 3y ago
Yes that is one of the cool side benefits i see too. It's like lossy compression for knowledge. Although, I mean that more in the sense we can have an entire (text) internet search engine on a phone, rather than it being a full backup.

One unexpected benefit of LLM (to me) is that it memorized large parts of the internet, so it has some backup like properties. SO is down, but ChatGPT memorized it already.

saintradon 3y ago

Yeah definitely. My default thought process was always, ok I'll just get a cached version, but now it's like - lemme see what GPT-4 thinks about this problem first.

tehbeard 3y ago

It may have memorized it, but recollection with accuracy is not it's strong suit.

twelve40 3y ago

> SO is down, but ChatGPT memorized memorized SO, also known as "stole". when i (and everyone else) write for SO, i give them permission to use what i write, but never did I sign up for the GPT theft of that data.

Wissenschafter 3y ago
[dead]
r2_pilot 3y ago
You gave them permission to use it, and they used it in such a way that GPT benefits from it as training data. I'm sorry you misplaced your trust in Stack Overflow for not protecting your public writings. Knowledge is awesome, though, in that it's like a candle and by lighting a new flame, your initial candle is not diminished in any way. It's not even your sole candle but merely one in a roaring bonfire.
- twelve40 3y ago
  > misplaced your trust in Stack Overflow that's a great way to put it, I'm very disappointed they aren't the ones to innovate in this new direction, even though people gave them all the power (and data) to do it. Which they chose to give away to "Open" AI aka Microsoft and now spend their time bickering over GPT detectors and writing nonsensical CEO "vision" posts. Basically, they really are now in a position to fizzle away at this rate, which is a shame, because I believe a community of acknowledged authors is a much more appealing way to advance knowledge than Microsoft anonymously milking the world for their sole profit and credit.
8note 3y ago
Your content is licensed with https://creativecommons.org/licenses/by-sa/4.0/ https://creativecommons.org/licenses/by-sa/4.0/ when you submit it to SO to host and share. You agreed that gpt can use it, so long as it includes attribution, and specifies when it makes changes
- pests 3y ago
  > so long as it includes attribution, and specifies when it makes changes Does it, though?

phatfish 3y ago

Yes that is one of the cool side benefits i see too. It's like lossy compression for knowledge. Although, I mean that more in the sense we can have an entire (text) internet search engine on a phone, rather than it being a full backup.