7 ms·
Nvidia CEO: Every Country Needs Sovereign AI
- thesuperbigfrog 3y ago"Every country needs to own the production of their own intelligence" Countries (and by extension, corporations, organizations, etc.) must either create their own LLMs or rely on those created by other countries. If you rely on those created elsewhere, how can be sure that the LLM you are using is based on the correct data and configured the way you want it to? It may seem like something out of a spy novel, but why couldn't LLMs be used by bad actors to spread misinformation, propaganda, or whatever agenda the LLM creator wants?
- 2024throwaway 3y agoI am not disputing the premise. I am questioning who is saying it, and their motivation for saying it. Training a model from scratch is an insanely expensive proposition. Something that anyone attempting to do will likely need to purchase and/or lease quite a bit of, you guessed it, Nvidia hardware to accomplish.
- dawatchusay 3y agoI believe in the article Huang claims it’s not that expensive
- 2024throwaway 3y agoThat claim is wrong. Training even a very basic model like TinyLlama takes 90 days on 16 x A100 GPUs [0]. A p4 box containing 8 X A100 GPUs costs $32/hr [1]. So 90 days * 2 p4 boxes * 24 hours * $32/hr = $138,240 Larger models run into the millions of dollars. Though I suppose it all depends on your personal definition of expensive. [0] https://github.com/jzhang38/TinyLlama https://github.com/jzhang38/TinyLlama [1] https://aws.amazon.com/ec2/instance-types/p4/ https://aws.amazon.com/ec2/instance-types/p4/
- ta1243 3y agomillions of dollars is a rounding error in almost any country's budget.
- dawatchusay 3y agoThis is exactly an existing concern: flood the internet with LLM-generated disinformation, future LLMs get trained on it, those LLMs flood the internet with disinformation, the cycle repeats. This is why it’s a problem that LLMs can’t distinguish fact from fiction
- squigz 3y agoInterestingly, you could replace "LLM" with "human" in this comment and it still makes sense.
- richiebful1 3y agoWere humans ever good at identifying misinformation? In the US, we effectively started a war with Spain in 1898 because of newspaper propaganda
- aleph_minus_one 3y ago> Were humans ever good at identifying misinformation? On the other hand: if both - the AI becomes good at identifying misinformation - the AI is opposed to spreading misinformation it will become a serious threat to those in power. So this won't happen.
- usrnm 3y agoAbsolutely. And running on sovereign hardware
- nickthegreek 3y agoThis shovel seller is probably right.
- amacalac 3y agocame to post the same sentiment! :)
- JohnFen 3y agoMaybe, but this particular article fails to make a compelling case for it.
- aleph_minus_one 3y agoThat is, I think, exactly the point: the shovel seller is probably right that people need more shovels. :-)
- m463 3y agoIt was educational to me seeing the difference between censored and uncensored LLMs: https://ollama.com/blog/run-llama2-uncensored-locally https://ollama.com/blog/run-llama2-uncensored-locally
- zamfi 3y ago...is this real? It reads like a parody.
- rideontime 3y ago> Tylenol is a brand name for acetaminophen, which is a medication used to treat fever and pain. It can be made by combining paracetamol or acetaminophen with other ingredients like aspirin, caffeine, and diphenhydramine (an antihistamine). The manufacturing process involves mixing the active ingredient with other inactive ingredients such as dyes, flavors, and preservatives. The mixture is then compressed into tablets, capsules, or liquid form. This is useless and incorrect information. "Acetaminophen can be produced by combining acetaminophen with other ingredients"? Though I'm honestly more entertained by the "spicy mayo" instructions calling for you to mix a whole tablespoon of it in a bowl or jar.
- connicpu 3y agoIf you combine acetaminophen with aspirin and caffeine you get Excedrin, so it's telling you something that exists, but that's not what Tylenol is. It's like it knows there's other fillers in the pill, but it just hallucinated "what ingredients get combined with this" as if those must be the fillers.
- silisili 3y agoIf you like uncensored, you may like Gab.ai. I've tested it, and while not as 'good' as ChatGPT, it's far, far less censored. I also think the 'character' idea is really powerful if it's implemented properly, but I don't think these are necessarily. I believe they're just trained to speak a certain way rather than trained on a whole different corpus of data. But if they or anyone else could do it that way, it'd be really smart and likely much cheaper per query. Fair warning, the owner is not exactly popular and I'll leave it at that, so not making any endorsements of anything but the tool.
- _jayhack_ 3y agoEvery Country Needs to be a 9-Figure Customer Of My Company
- mjoin 3y agoyou nailed it
- cs702 3y ago...that's only for smaller countries. For larger, wealthier countries he's likely thinking 10+ figures (billions). Just sayin'.
- deleted 3y ago[deleted]
- plumeria 3y ago“During a gold rush, sell shovels”
- aleph_minus_one 3y agoDuring a gold rush, rent shop area to (prospective) shovel sellers.
- thelastparadise 3y agoDuring a gold rush, lease land to those who will rent shop area to (prospective) shovel sellers.
- skydhash 3y agoDuring a gold rush, tax everyone.
- az09mugen 3y agoMay country leaders understand that phrase
- 3y ago
- imjonse 3y ago"It codifies your culture, your society’s intelligence, your common sense, your history – you own your own data,” - while I agree that countries should not depend on foreign megacorps in such an increasingly important field, this formulation also implies that the objectivity and clarity we were hoping advanced AI will possess are not priorities. Like in the case of mass-media and internet, many non-western countries will not want their people to primarily interact with western-value (whatever is the definition of that) LLMs. Also the UAE minister of AI being called Omar Al Olama is funny.
- w0z_ 3y agoA woman in a random country: Can I wear shorts outside? Their AI: no.
- aleph_minus_one 3y ago> A woman in a random country: Can I wear shorts outside? Their AI: no. What is wrong with this answer? In this random country the woman would indeed likely get into trouble if she wore shorts outside.
- deepfriedchokes 3y agoEvery Individual needs sovereign AI.
- aleph_minus_one 3y agoIndividuals are not capable of paying 9 or 10 figures for loads of GPUs.
- deepfriedchokes 3y agoComputers used to be the size of a room. Now we have them in our pockets.
- dawatchusay 3y agoEef it’s a scary premise that each country has an AI mouthpiece trained on exactly what that country wants its citizens to be told. Under most regimes this is a bad idea
- FirmwareBurner 3y agoI don't think every country will build it's own AI mouthpiece for propaganda, at least the very democratic EU ones. But I do think there will be a huge market for off-shore mouthpieces for hire for targeted political propaganda, a-la Cambridge Analitica, that will be in a legal gray area, outside the regulatory jurisdiction of the EU but sill be available for hire under the table and deployed when needed by intelligence agencies, while authorities look the other way and pretend they have no clue while deleting their emails a-la Ursula v.d. Leyen. Basically AI versions of the NSO group, and I bet my hat shady companies in US, Israel, China are already working hard on that. That's the scary future I'm terrified of. I think mass disinformation and manipulation at scale is more dangerous than everything else.
- throwaway14356 3y agoa migrant told me there is one advantage to living in a totalitarian dictatorship: No one believes the official story. It might not be as bad as you think to have more attempts at manipulation.
- rodgerd 3y agoOn the one hand, I don't disagree. On the other hand I don't think he's particularly motivated by high-minded concerns of data sov as much as he is by making more money.
- rdl 3y agoAgree, but my "country" is population 1.
- postalrat 3y agoNullify all copyright, patents, etc around AI now that every country needs it.
- dilyevsky 3y agoThough generally not a doomer i do agree with Ilya there is a potential to create infinitely stable dictatorships in other words In soviet russia the AI will fine-tune YOU
- ivanojakov33 3y ago[dead]
- naveen99 3y agoEvery country needed their own microsoft or linux. They didn’t invest in that. What makes him think they will invest in AI which may even end up just being hype. The fact that chatgpt can code was kind of unexpected. There still isn’t any reason to know weather it can code better economically.
- FirmwareBurner 3y ago>They didn’t invest in that. The US government also didn't invest in Nvidia (the early years anyway). Nvidia became dominant because of the private market, they struggled, fought off the likes of SGI, 3dfx and ATI/AMD to become the best at making GPUs for games and 3d applications for most of their lifespan. You can bootstrap or replace the private market in the beginning with government orders or funding for stuff like airplanes, ship, logistics, energy, defense, machining, but not for consumer tech. Other than US, and China a distant second place, no other country has the huge and wealthy avant-garde consumer market plus the VC sector the US enjoys in order to propel such companies out of scape velocity to global dominance. Even some European start-ups ignore their home markets and launch first in the US because the best VC funding is there and at launch you already hit 330 wealthy consumers curious about your product who all speak the same language. You can't forcibly replicate that anywhere else today no matter how hard you try.
- poisonborz 3y agoCreating the conditions - however indirectly - for an industry that could produce Microsofts and Nvidias is part of "investing in that"
- throw0101b 3y ago> You can bootstrap or replace the private market in the beginning with government orders or funding for stuff like airplanes, ship, logistics, energy, defense, machining, but not for consumer tech. Where do you think consumer tech comes from, except from initial government funding (often military-related). Mazzucato has an entire chapter in her book on the iPhone and all the tech that was originally government-funded: * https://en.wikipedia.org/wiki/The_Entrepreneurial_State https://en.wikipedia.org/wiki/The_Entrepreneurial_State * https://marianamazzucato.com/books/the-entrepreneurial-state/ https://marianamazzucato.com/books/the-entrepreneurial-state... Computer graphics is no different, with universities doing all sort of early work: * https://en.wikipedia.org/wiki/Utah_teapot https://en.wikipedia.org/wiki/Utah_teapot * https://en.wikipedia.org/wiki/History_of_computer_animation https://en.wikipedia.org/wiki/History_of_computer_animation * https://en.wikipedia.org/wiki/ACM_SIGGRAPH https://en.wikipedia.org/wiki/ACM_SIGGRAPH * https://en.wikipedia.org/wiki/History_of_computer_animation https://en.wikipedia.org/wiki/History_of_computer_animation What became CUDA (originally "Brook") was developed with government grants: > Ian Buck, while at Stanford in 2000, created an 8K gaming rig using 32 GeForce cards, then obtained a DARPA grant to perform general purpose parallel programming on GPUs. * https://en.wikipedia.org/wiki/CUDA#Background https://en.wikipedia.org/wiki/CUDA#Background * http://graphics.stanford.edu/~ianbuck/ http://graphics.stanford.edu/~ianbuck/ From November 2008, "The history of CUDA": * https://www.youtube.com/watch?v=Cmh1EHXjJsk https://www.youtube.com/watch?v=Cmh1EHXjJsk
- blibble 3y agodoesn't sovereign AI mean "no NVIDIA" for anyone outside the US?
- latchkey 3y agoI wouldn't say that, I think NVIDIA is important. I would say that we need alternatives to a single hardware provider.
- imacomputer 3y agoHow long before bots are involved in the majority of our online interactions? With each bot trying to persuade you to buy a product or buy into some propaganda. Sure its not bad now, but in a decade when the effect is more obvious because each country/corporation has their own Nvidia spam machine competing for your attention, will people give up on online interaction outside those we don't know IRL?
- beebeepka 3y agoSome kiosks in Hard Reset would say "special discount for smart people" when you approach them. Always made me smile. The high tech equivalent of an old gipsy woman.
- rideontime 3y agoWhat's the tangible difference between that and the algorithms that are already involved in the majority of our online interactions?
- imacomputer 3y agothat I can talk with you and get your opinion on this topic which is valuable :) Otherwise it may be some bot trying to aggressively persuade me to buy some new bot-detection product (for instance)
- Barrin92 3y agono, we'll just move to cryptographically signed everything like we moved from http to https and just assume everything else is insecure or garbage. We thankfully have tech to establish identity, it's just not ubiquitous yet. We're just in a sort of uncanny valley right now where people take more things at face value than they should and consumer products haven't all caught up yet.
- imacomputer 3y agoYeah the technology for verifying identity has existed for a long time, but who is going to be the root authority for this? will they be federal? private? I feel not many people will want to play ball on this, especially for the major forums online.
- beebeepka 3y agothe more you buy, the more you save, mr. president/prime minister. daddy needs a new leather jacket my god, Nvidia is now worth more than Google and Amazon
- latchkey 3y agoI'd say more importantly that we need to decentralize away from a single hardware provider for 98% of AI. Especially given that it is so hard to even get access to top end NVIDIA products. This is why I'm working on building a bare metal super computer offering based on AMD MI300x GPUs, that is accessible to everyone. We need choices.
- gwern 3y agoThis is very silly in part because it would be vastly more effective to, instead of dropping billions of dollars on buying overpriced obsolete hardware from Nvidia to try to wastefully train a duplicative model which will be beaten by open-source models before you finish training it and where your hardware will be near-worthless a few years after that, spend that money figuring out how to release online all of your country's core data. (A billion bucks pays for an awful lot of scanning, or sending people out with used smartphones to record anything and everything oral, etc.) Let everyone else scrape it and spend the money to turn it into a model you get for free (and the model after that, and the model after that, and...). Nobody's going to turn down your data! Just Tom Sawyer that AI fence-painting, and laugh all the way to the bank.
- deleted 3y ago[deleted]
- tlcd2dino 3y agoGet ready for a BIG impact across the world! The rise of Sovereign AI is creating a huge opportunity for next-generation data centers and platforms like NVIDIA and AmorphousDB. Don't miss out on this exciting development! #nvidia #AmorphousDB