5 ms·
Politely, what the hell are you talking about? Who is telling anyone what they can or cannot compute?
by alchemist1e9 3y ago
Politely, what the hell are you talking about? Who is telling anyone what they can or cannot compute?
- iamjackg 3y agoUS: https://www.whitehouse.gov/briefing-room/presidential-actions/2023/10/30/executive-order-on-the-safe-secure-and-trustworthy-development-and-use-of-artificial-intelligence/ https://www.whitehouse.gov/briefing-room/presidential-action... "Until such technical conditions are defined, the Secretary shall require compliance with these reporting requirements for: (i) any model that was trained using a quantity of computing power greater than 1026 integer or floating-point operations, or using primarily biological sequence data and using a quantity of computing power greater than 1023 integer or floating-point operations[...]" EU: https://thefuturesociety.org/wp-content/uploads/2023/12/EU-AI-Act-Compliance-Analysis.pdf https://thefuturesociety.org/wp-content/uploads/2023/12/EU-A...
- geon 3y ago> 1026 > 1023 Should be 10^26 and 10^23.
- alchemist1e9 3y agoProbably I did this wrong but I’m getting an approximation of 300K H100s completes that in a month. At least they choose something fairly large it seems. Not sure how LoRA or other incremental training is handled.
- sbierwagen 3y agoDepends on which spec you used, since the law doesn't specify the floating point width. If you used FP8 ops on the H100 SXM then a single GPU would hit the limit in 25265285497.72612 seconds. 300,000 GPUs would pass 10^26 FP8 ops in 23 hours.
- two_in_one 3y ago[flagged]
- hayley-patton 3y agoAre they trying to bring back SIMD-within-a-register? Though that only gives you ~one order of magnitude doing packed 4-bit stuff with 64-bit GPRs. And perhaps fixed-point, sign-exponent and posits are unregulated.
- deleted 3y ago[deleted]
- cyanydeez 3y agoanyone with a functional government.
- deleted 3y ago[deleted]