6 ms·
Developing AI models or giant GPU clusters? Uncle Sam would like a word
- wslh 3y agoIs this some kind of new Clipper chip [1] I understand the differences but I see this as a type of allegory? [1] https://en.wikipedia.org/wiki/Clipper_chip https://en.wikipedia.org/wiki/Clipper_chip
- mpalmer 3y agoI'm not sure what connection you're seeing here. How does a set of reporting requirements resemble the attempt to encourage telecom businesses to add a backdoor in communications infrastructure?
- wslh 3y agoI mentioned explicitly the word allegory. First, the term backdoor applies loosely to the Clipper chip since it would have been public that this chip could be used for accessing private information. I think lock is a better security term. Backdoors generally are secret. My memories from that time are that the term backdoor was also an irony. Second, the link is about informing private information because there is a security concern. It is not because the government want to have stats to inform the public about how to run AI nodes.
- mpalmer 3y agoNo, I think backdoor is the appropriate term, not least of all because the first sentence of the Wikipedia entry you linked identifies the Clipper chip as such. As long as we're nitpicking word choice, the word allegory does not apply here. An allegory is an intentional narrative device employed by an author or artist. Two things you find to be similar does not constitute an allegory. The link you identify is pretty tenuous. With the Clipper chip, the government wanted access to live communications, not information about the infrastructure the communications were passing through. That is not the case with the recent EO.
- wslh 3y agoSorry, if I can say it differently it reminds me of the Clipper chip because of the security concerns for the use of technology in a specific way. AI now, crypto before. Please take it as a personal connection then.
- amzn12333 3y agoJust do it in China or Russia then.
- threeseed 3y agoThere are export controls for the highest end GPUs. And history has shown that companies don't just move to China/Russia because the US market is so lucrative.
- cscurmudgeon 3y agoWhere did Apple manufacture its phones?
- threeseed 3y agoApple never moved to China. And their phones are manufactured in China, India and Vietnam.
- cscurmudgeon 3y ago> Apple never moved to China. Nobody said that. Please don't do straw men arguments. They moved most of their manufacturing to China.
- Dalewyn 3y ago1. Highest-end silicon is not strictly necessary. Most people here can surely appreciate just how fast microprocessors in general are today? 2. The export controls have exceptions, loopholes, and people with strong wills.[1][2] 3. China is slowly but steadily freeing itself from import dependence.[3] [1]: https://tech.slashdot.org/story/23/08/21/203241/china-keeps-buying-hobbled-nvidia-cards-to-train-its-ai-models https://tech.slashdot.org/story/23/08/21/203241/china-keeps-... [2]: https://mobile.slashdot.org/story/23/09/09/1849221/huawei-shocks-with-advanced-new-smartphone-built-with-south-korean-memory-chips https://mobile.slashdot.org/story/23/09/09/1849221/huawei-sh... [3]: https://mobile.slashdot.org/comments.pl?sid=23071327&cid=63874153 https://mobile.slashdot.org/comments.pl?sid=23071327&cid=638...
- akira2501 3y agoThe order itself is ridiculous election year pandering. It imagines we are suddenly in an "age of AI" and that it's clueless meddling is required to establish an industry that already exists and to prevent algorithmic dark patterns that are already entrenched from forming. It then sets every federal agency out on a quest to identify and then create a plan to ameliorate all the "scary AI boogey men" sci-fi fever dreams that have been associated with the deployment of a technology that doesn't even actually exist yet. And, of course, more H1-B visas, because.. you know.. we wouldn't want to be "left behind." [0]: https://www.whitehouse.gov/briefing-room/presidential-actions/2023/10/30/executive-order-on-the-safe-secure-and-trustworthy-development-and-use-of-artificial-intelligence/ https://www.whitehouse.gov/briefing-room/presidential-action...
- ketzo 3y agoEdit: I read H1-B as a generalization for “skilled immigration” - I now see that people have issues with the H1-B program, specifically. The H1-B thing is kind of a non-sequitur. I think anyone involved in tech (software, hardware, anything) should be wildly in favor of massive H1-B increases, AI-related or not. The U.S. has the opportunity to cement itself as the center of the world as far as technological progress from now into eternity. Why wouldn’t we take every brilliant immigrant we can get? If you’re a software developer and you are afraid for your job/wages, I get that intuitively; but how many times do we have to learn the lesson that “more people making software leads to more software jobs”
- jgalt212 3y ago> I think anyone involved in tech (software, hardware, anything) should be wildly in favor of massive H1-B increases, AI-related or not. Not if you like high wages, and you want them to stay that way.
- mschuster91 3y agoThere's way too much work to do in the AI space and - even worldwide - not enough skilled people by far. The danger, IMHO, isn't wage dilution anyway (that one can be counteracted by politics) - it is that sensitive knowledge will make its way back to China and other current or potentially hostile nations, and it would not be the first time either that this happens.
- deleted 3y ago[deleted]
- downvotetruth 3y agoWonder how much of a write off Nvidia will claim for Mellanox due to the 100 GB/s limit.
- latchkey 3y agoProtip: 400GB/s switches are just 4 bonded 100GB/s channels. What limit? =)
- Ukv 3y ago> One requires reporting of any model trained using more than 10^26 integer or floating point operations total On an unrelated note, OpenAI announces GPT5 will be trained with fixed-point arithmetic.
- ryanschneider 3y agoThere’s actually a lower bound for integer ops: https://twitter.com/DavidVorick/status/1719097248699879831 https://twitter.com/DavidVorick/status/1719097248699879831 > (i) any model that was trained using a quantity of computing pow greater than 10^26 integer or floating-point operations, or using primarily biological sequence data and using a quantity of computing power greater than 10^23 integer or floating-point operations;
- Ukv 3y agoFor integer and floating-point operations, but not for fixed-point operations which are neither.
- jakobson14 3y agoHow would you even measure that, with current tooling? There some option for counting float ops in pytorch or something?
- ketzo 3y agoTime to train * flops per chip * number of chips in training fleet You can estimate it quite accurately, actually
- jakobson14 3y agoThen you're including all kinds of time for other delays, like copying data over PCIe into the GPU for the next batch, or waiting for the CPU to orchestrate things. You could probably get a better estimate based on the network structure, the number of training epochs, and the size of each batch.
- zitterbewegung 3y agoWhy are they using parameters or ops using trained when an objective tests that exist or compare to other state of the art systems which makes more sense. This executive order is a joke when you could just almost train a bit less and get the same output…
- WalterBright 3y agoBy hobbling American AI development, it just hands AI leadership to other countries.
- mdale 3y agoThe regulations as presently defined are pretty lax IMHO; it seems people jump to the all regulations are a unbearable constraint perspective without some measured look at what is being proposed? I get the don't give an inch or they will take a mile, but also some regulation structures are probably warranted by such a fundamental shift on par with the advent of the Internet. Back then we both got it right with DMCA in that big Internet companies could thrive in the US; but also problematic concentration of Monopolistic power in big Internet companies. Will have to do some iteration to see what makes sense with the advent with this new computing model / capabilities at this scale.
- WalterBright 3y agoOne reason the software industry thrives incredibly is the pretty much complete absence of licensing and regulatory hurdles to ship software. It's fine to say you can't legally use software to commit crimes.
- willis936 3y agoThe recent extra-national GPU sales bans were put in place with the explicit goal of US AI supremacy.
- thomastjeffery 3y agoDear Uncle Sam, You have been sorely misinformed about AI. Even the name itself has been used to mislead you! Artificial Intelligence does not exist today. While new systems may be "intelligent" in their designs, none of them is "an intelligence". Artificial Intelligence has been the pursuit of Computer Science since the earliest days of software design, back when the AI department at Bell Labs developed Programming Languages. What is called "AI" today is no more than the newest efforts in that pursuit. Despite the excitement at these newer efforts, the goal that is AI is as mysterious as it ever was. So what's new? Inference Models. These allow computers to navigate ambiguous data. This was entirely impossible before, and is only somewhat possible today. While computers do not get completely stuck on ambiguity the way they used to, they are still unable to conclusively resolve that ambiguity. They can only be trained to guess. With careful training on very large datasets, some impressive results have been obtained. Unfortunately, those impressive results are always closely tied to embarrassing mistakes. This is a feature of contemporary inference models. The goal in mind is to perform this process well enough to have a novel and useful system. Many believe that once a model is big enough and trained well enough that it will become reliably more accurate. There is no conclusive evidence that is the case. While they are often introduced as a "limitation", behaviors like "overconfidence" and "hallucinations" are features of these systems. In order to remove a feature from a system, a new system must be invented. In the mean time, let's consider what does exist, rather than get lost in our own dreams. So what should you be worried about? Contemporary inference models are powerful enough to create convincing results. What does that mean for the people of the United States? We need to recognize the reality in front of us: people can tell lies. Data alone is never a reliable source of information. This has always been true, but the inherent difficulty in storytelling has made some lies impractical to tell. As technology improves, so does each person's ability to tell a story. We have all watched the journalistic integrity of our world suffer at the hands of Social Media, and at the failure of large corporations to moderate content. At best, people have grown to distrust scientific discovery and leadership; and at worst, untamed hate speech has lead to genocide. So what can we do about it? Readers need to be able to differentiate content, not by its substance, but by its source. The good news is that this has been a solved problem for 50 years. All that an author needs to attach their identity to their writing, is to provide readers their unique public key and a signature of their work. Unfortunately, the best tools to do this, including GPG, are very technical and difficult for the layman to use. It should be the priority of the United States, for the sake of national security, to improve this landscape by creating (or motivating the creation of) easy-to-use public-key encryption software.
- arthurcolle 3y agoI know that its more the capabilities angle that the US Government is mainly interested in here, rather than copyright infringement... But just curious, could packages like google's fully-homomorphic-encryption or the difficult to build Pyfhel be used to mitigate government intrusion into model training / datasets? I know there is some work being done to 'extract' training data from models (although given the compression, not entirely sure you could really extract everything but curious if anyone is seriously working on training models on purely encrypted data
- PeterisP 3y agoFHE does still add a huge overhead (measured in orders of magnitude, not percentages), so it would not be applicable for large models that are comparable with state of art models. You can apply FHE to neural networks in general (e.g. https://developers.googleblog.com/2023/08/expanding-our-fully-homomorphic-encryption-offering.html https://developers.googleblog.com/2023/08/expanding-our-full... lists it as one of potential use cases), but the unsaid assumption is that they are relatively small NNs, and that's in an era where we know that simply using a larger model brings meaningful improvements to the outcome, and the main limiting factor for people training their own models is the cost of compute.
- Spivak 3y agoY'all just need to read the executive order (or at least the white house fact sheet) itself it's got way more stuff than this article covers and to my eyes is overwhelmingly positive. It's like the white house read all of the complaints people on HN have had about inappropriate uses of LLms and bundled them into one huge omnibill telling every federal agency to stop people from behaving recklessly with AIs that are are mirror of the average Redditor. Outside of reporting that you're working on a new huge model and some maybe down the road future NIST guidelines they don't actually restrict the production of models at all. It's all about telling the humans jumping on the move fast break things train that no you can't use these tools for for <obviously dystopian thing> like renter screening, price fixing, and judicial sentencing. Good on the white house for recognizing that the harm these models produce is almost entirely the humans connecting them to the real world.
- phillipcarter 3y agoYeah, lots of weirdos likely bleeding over from the bitcoin maxi camp here commenting. This exec order is mostly good and directly addresses a bunch of future problems.
- junofan 3y agoYou’re making a huge assumption about NIST’s implementation. Generally people like the goals of regulation. They might not like the implementations. I’d prefer to see strategic action on concrete issues rather than perceived risks. I don’t see how tasking a bunch of government agencies with pontificating on new and unfamiliar technologies can produce a good result.
- tayo42 3y agoIll have to develop more thoughts but there is something amusing about having a whole section about protecting jobs, the having sections about importing more laborers for ai development.
- RecycledEle 3y agoExcuse me, Congress. I need to have a word with you. Your oath of office said “I do solemnly swear (or affirm) that I will support and defend the Constitution of the United States against all enemies, foreign and domestic; that I will bear true faith and allegiance to the same; that I take this obligation freely, without any mental reservation or purpose of evasion; and that I will well and faithfully discharge the duties of the office on which I am about to enter: So help me God.” Source: https://oaths.us/senate-oath-of-office/ https://oaths.us/senate-oath-of-office/ I noticed that you just voted on a bunch of unconstitutional laws, which makes you guilty of perjury. Note: It does not matter which memeber of Congress you address, or when. This applies to all of them, all the time.