5 ms·
This new essay by Jack Clark, who was at OpenAI when they made the decision not to release GPT-2 for safety reasons five years ago, feels relevant: https://impo
by simonw 2y ago
This new essay by Jack Clark, who was at OpenAI when they made the decision not to release GPT-2 for safety reasons five years ago, feels relevant: https://importai.substack.com/p/import-ai-375-gpt-2-five-years-later https://importai.substack.com/p/import-ai-375-gpt-2-five-yea...
> [...] history shows that once we assign power to governments, they're loathe to subsequently give that power back to the people. Policy is a ratchet and things tend to accrete over time. That means whatever power we assign governments today represents the floor of their power in the future - so we should be extremely cautious in assigning them power because I guarantee we will not be able to take it back.
- ralegh 2y agoWell said, also applies to many human dynamics - friendships, relationships, work relationships, etc. Ceding power is a ratchet and you either put your foot down to start with or it grinds away.
- redserk 2y agoHard disagree. Healthy relationships include negotiating when potential boundaries are in question, or if things change that require re-aligning boundaries. It's reasonable to give more to the other party from time-to-time, and reasonable to discuss with the other party if it becomes a point where it feels unfair. Instead we (Americans) take an unnecessarily adversarial stance against what our government could do, ensuring it is perpetually unprepared.
- LeafItAlone 2y ago> Healthy relationships In reality, the vast majority of relationships aren’t actually healthy in this way. Most people get that only from their parent and family, if that. So parent’s advice is important.
- JohnFen 2y ago> the vast majority of relationships aren’t actually healthy in this way The vast majority? I'd love to see data backing that claim up.
- ralegh 2y agoI love to give more. That’s what life’s about. But it should be done freely and without expectation. What I’m talking about is taking - do this or I’ll be annoyed. It’s overt vs covert contracts. I ask you to do X because it would be helpful/make me happy. Versus I ask you to do X because it’s helpful and also I want to feel in control of you, and maybe you’ll be more willing to do Y later. I don’t agree with the last comment, maybe I am a cynic.
- no_wizard 2y agoI don’t disagree with this assessment but it’s also a narrow view[0] that allows the problem to persist in the first place. Rather, I’d like to see what positive oversight would look like, but that has not been put forth by any of these organizations thus far. It all comes down to “trust us” which is also hard to stomach [0]: most often but not exclusively held by Americans (of which i am one). We collectively fail to imagine government being a positive force and what that would look like.
- vundercind 2y agoThis is a relatively new and carefully cultivated state of things. I mean, the early phases of this era are a half-century old at this point, but it’s not like it’s a law of nature that at least half the population of the US and about half the politicians must regard government as rarely-useful. It didn’t used to be that way. It’s not an American trait in some holistic historical sense.
- whimsicalism 2y agoperhaps our government has become less competent? Having worked in the federal government briefly (and growing up in a place with lots of feds), it makes perfect sense that our government is generally incompetent/low-capacity. In the wake of the civil rights movement, lots of government civil service exams became presumptively illegal. The pay bands are also pretty trash. If we wanted a competent government, we should have far fewer people paid a lot more and hired in a more aggressively merit-based process. Our current government is from an era without computerization where you needed lots of grunts to process things like SS claims, etc. That is simply not this era.
- ethbr1 2y ago> If we wanted a competent government, we should have far fewer people paid a lot more and hired in a more aggressively merit-based process. Our current government is from an era without computerization where you needed lots of grunts to process things like SS claims, etc. That is simply not this era. This. IMHO, the military's regular reassignment also solves a lot of bureaucracy-at-scale problems (even if it creates different ones around competency and long-duration projects). Preventing people from becoming entrenched in a single role/office is important to ensuring a healthy overall system and providing space for new ideas.
- martin293 2y agoWhy did they decide not to release GPT-2? I haven't heard about it.
- versteegen 2y agoLargely because they feared that large language models would be useful for large scale disinformation, election interference, impersonation, automated phishing, etc. https://openai.com/index/better-language-models/ https://openai.com/index/better-language-models/ See "Policy Implications" and down.
- yqx 2y agoI'm curious what history Jack Clark is referring to here. If I think of the last thirty years of policy in most of Europe and the US I'm thinking of a strong trend of deregulation and giving more powers to markets, removing international trade barriers and so on. That seems to be a dynamic opposite to the one the quoted article is suggesting.
- rurp 2y agoRight, and many of those deregulation moves turned out poorly in hindsight. Governments have ratcheted up control in some cases, but stating that it is a universal law is patently false, although it sounds good as a quip. Regulations are kind of like security practices. When done well they are often taken for granted, but poor ones get a lot of negative attention. I'm glad that I don't have to wonder if the cereal I buy at a store is filled with rat poison. I'm fine if the government never relinquishes the power to oversee that. Unfortunately the current leaders in the latest AI craze have not inspired much confidence that they will act responsibly in the future. Maybe if different people were running these companies it would make sense for the government to keep out of it, but in this world we're going to need some reasonable regulation.
- nurple 2y agoDeregulation is not returning power to the people, it's bestowing carte blanche privatization of profits to corpos, in the wake of near complete regulatory capture, while they dump the negative externalities on the public.
- pdonis 2y ago> If I think of the last thirty years of policy in most of Europe and the US I'm thinking of a strong trend of deregulation and giving more powers to markets That's been the PR spin, but it's not actually true. It's a smoke screen to help governments avoid actual accountability. For example, the crash of 2008 was blamed on too much market and not enough regulation, but in fact it was the opposite: regulatory thumbs on the scale, for example the US government wanting to encourage home ownership and skewing the mortage market and the money supply and requiring lenders to accept more default risk, and governments implicitly giving a "too big to fail" guarantee to large financial institutions and then being extremely arbitrary in when that implicit guarantee was broken. A true free market would never have produced such a thing. > removing international trade barriers and so on. Globalization of trade has been going on for much longer than the last 30 years. If anything, the last 30 years have seen more of things like trade wars (for example between the US and China) and other disruptions to smooth international trade.
- PaulDavisThe1st 2y agoYou know the other thing that is a ratchet? Experience. It is true that sometimes you learn something at time T2 that invalidates something you learned at time T1 (T2 > T1), and thus you do need a de-ratcheting system of some sort. But what actually drives the ratchet is experience with current policy (or lack thereof). "Oh, we had no plans to deal with X, and we got screwed, so lets add policy for X". The ratcheting aspect of policy reflects the ratcheting aspect of societal experience accumulation.
- oglop 2y agoWhat a pretentious way to say something simple.