4 ms·
the thing could barely make full grammatical sentences, it's funny to see that even then they were overclaiming the fuck out of their myself
by make3 6mo ago
the thing could barely make full grammatical sentences, it's funny to see that even then they were overclaiming the fuck out of their myself
- anuramat 6mo agoimho it was more reasonable back then to claim "agi soon" -- back when nobody really knew how it scales
- phire 6mo agoThey weren't claiming it was dangerous because "AGI soon", that didn't come until later. OpenAI were claiming GPT-2 was too dangerous because it could be used to flood the internet with fake content (mostly SEO spam). And they were somewhat right. GPT-2 was very hard to prompt, but with a bit of effort it could spit out endless pages that were good enough to fool a search engine, and even a human at a first glance (you were often several paragraphs in before you realised it was complete nonsense.
- make3 6mo agowe essentially have AGI right now brother
- bdangubic 6mo agowe got the A and G parts, just missing the I part but it’s coming :)
- selcuka 6mo agoIt was a 1.5B parameter model. It was still impressive for 2019, but yeah, it was nothing to worry about.
- make3 6mo ago1.5B and insanely under-trained. Size didn't mean much before the scaling laws papers came out.