3 ms·
In all seriousness, if AI models can handle quantization, they can handle some flipped bits from time to time! There are probably some fascinating papers to be
by btown 1y ago
In all seriousness, if AI models can handle quantization, they can handle some flipped bits from time to time! There are probably some fascinating papers to be written around how to choose which layers in an LLM architecture could benefit more than others from redundant computation in a high-radiation environment.
- kibwen 1y agoBrilliant, to turn up the model temperature we just hinge open the shielding. I call dibs on the patent!
- lawlessone 1y agoOk, has anyone patented chips with radioactive source glued to them? For "true" randomness. If it not i want dibs on it.
- DontBreakAlex 1y agohttps://en.wikipedia.org/wiki/Hardware_random_number_generator https://en.wikipedia.org/wiki/Hardware_random_number_generat... > and even the nuclear decay (due to practical considerations the latter, as well as the atmospheric noise, is not viable except for fairly restricted applications or online distribution services)
- notahacker 1y agoyeah, I think the space weather experts would have fun statistically analysing the single-event-upset RNG :)