4 ms·
"Every country needs to own the production of their own intelligence" Countries (and by extension, corporations, organizations, etc.) must either create their
by thesuperbigfrog 3y ago
"Every country needs to own the production of their own intelligence"
Countries (and by extension, corporations, organizations, etc.) must either create their own LLMs or rely on those created by other countries.
If you rely on those created elsewhere, how can be sure that the LLM you are using is based on the correct data and configured the way you want it to?
It may seem like something out of a spy novel, but why couldn't LLMs be used by bad actors to spread misinformation, propaganda, or whatever agenda the LLM creator wants?
- 2024throwaway 3y agoI am not disputing the premise. I am questioning who is saying it, and their motivation for saying it. Training a model from scratch is an insanely expensive proposition. Something that anyone attempting to do will likely need to purchase and/or lease quite a bit of, you guessed it, Nvidia hardware to accomplish.
- dawatchusay 3y agoI believe in the article Huang claims it’s not that expensive
- 2024throwaway 3y agoThat claim is wrong. Training even a very basic model like TinyLlama takes 90 days on 16 x A100 GPUs [0]. A p4 box containing 8 X A100 GPUs costs $32/hr [1]. So 90 days * 2 p4 boxes * 24 hours * $32/hr = $138,240 Larger models run into the millions of dollars. Though I suppose it all depends on your personal definition of expensive. [0] https://github.com/jzhang38/TinyLlama https://github.com/jzhang38/TinyLlama [1] https://aws.amazon.com/ec2/instance-types/p4/ https://aws.amazon.com/ec2/instance-types/p4/
- ta1243 3y agomillions of dollars is a rounding error in almost any country's budget.
- dawatchusay 3y agoThis is exactly an existing concern: flood the internet with LLM-generated disinformation, future LLMs get trained on it, those LLMs flood the internet with disinformation, the cycle repeats. This is why it’s a problem that LLMs can’t distinguish fact from fiction
- squigz 3y agoInterestingly, you could replace "LLM" with "human" in this comment and it still makes sense.
- richiebful1 3y agoWere humans ever good at identifying misinformation? In the US, we effectively started a war with Spain in 1898 because of newspaper propaganda
- aleph_minus_one 3y ago> Were humans ever good at identifying misinformation? On the other hand: if both - the AI becomes good at identifying misinformation - the AI is opposed to spreading misinformation it will become a serious threat to those in power. So this won't happen.