3 ms·
Saw this a few days ago. Really enjoyed it. I thought he made a good point about dictatorships being positioned fundamentally differently than democracies with
by nullsense 3y ago
Saw this a few days ago. Really enjoyed it.
I thought he made a good point about dictatorships being positioned fundamentally differently than democracies with respect to the current technology that's out there now.
I also found his answer to the question someone asked at the end about hackers in their basement pretty interesting. He was like well hackers in their basement can't create these big models yet, so we can still regulate it. That's true in a sense, but I did notice the other day on that mdegans HuggingFace incident that someone offered up their 200x GPU crypto mining cluster to train uncensored models in support of ehartford who was copping a lot of abuse from this mdegans character. So, I wouldn't be so entirely sure that there aren't at least in principle _some_ hackers that can do it.
- just-tom 3y agoComputing power is one thing, I think the real issue for basement hackers is the training data. They can never have the same amount of data as the big players.
- nullsense 3y agoI thought those scrapes of the web like The Pile we're only around like 45TB? It's a good point though. I'm sure logistically it'd also be way harder than the embarrassingly parallel nature of crypto mining.