4 ms·

I don't know about GPT-3 but playing around with GPT-2 I often got the impression that it was regurgitating learned knowledge (reddit comments) rather than actu

I don't know about GPT-3 but playing around with GPT-2 I often got the impression that it was regurgitating learned knowledge (reddit comments) rather than actually coming up with something novel. With so many weights, it practically encodes a massive Internet text database.

Kinrany 6y ago
Having a better alternative to search engines would be great.
StavrosK 6y ago
I had that thought too, and my immediate next thought was that the value isn't in knowing the sentences, but in being able to put them together usefully.