4 ms·
A rather misleading framing by Ars... OA didn't call it "too scary to release", but explicitly framed it as an experiment in responsible disclosure & release pr
by gwern 3y ago
A rather misleading framing by Ars... OA didn't call it "too scary to release", but explicitly framed it as an experiment in responsible disclosure & release practices (one which the fierce, and extremely hypocritical, criticism of this experiment showed that the community was in sore need of); and they in fact released the model being used here (GPT-2-124m) on the very same day, IIRC, as the GPT-2 announcement!
But while it is far from 'GPT-2 in Excel' (call me when it can do the original context window and doesn't need special binary extensions), I'm surprised that a ctx of 10 works at all with any extensions or plugins which aren't morally equivalent to shelling out to a completely different program.