4 ms·
GPT-2, in Excel
- gwern 3y agoA rather misleading framing by Ars... OA didn't call it "too scary to release", but explicitly framed it as an experiment in responsible disclosure & release practices (one which the fierce, and extremely hypocritical, criticism of this experiment showed that the community was in sore need of); and they in fact released the model being used here (GPT-2-124m) on the very same day, IIRC, as the GPT-2 announcement! But while it is far from 'GPT-2 in Excel' (call me when it can do the original context window and doesn't need special binary extensions), I'm surprised that a ctx of 10 works at all with any extensions or plugins which aren't morally equivalent to shelling out to a completely different program.
- ColinWright 3y agoI think this is the same thing as is being discussed here: https://news.ycombinator.com/item?id=39700256 https://news.ycombinator.com/item?id=39700256