ProlificInquiry

4 ms·

1. 1.▲
   by ProlificInquiry 4y ago

   Can GPUs run reliably in an orbital radiation environment at all? The combination of extreme transistor density and zero error checking seems like the opposite of what you'd want in a space processor.
2. 2.▲
   by ProlificInquiry 4y ago

   It's far worse than that: to attribute a particular output to an input you don't just need the input data, you need the gradient updates that data caused in the training run. A couple hundred gigabytes input tokens times 175 billi
3. 3.▲
   by ProlificInquiry 4y ago

   This quote seems to fundamentally misunderstand what transformers are doing at all. Technically I suppose you could save all gradient updates from every input token, and do some weighted averaging to show what inputs affected the particul
4. 4.▲
   by ProlificInquiry 5y ago

   It was extremely misleading for the author to list questions from exam P as if they were representative of the exams at a large. I'm an actuary, and I passed that exam with a 10 (maximum grade), with a nights review of my probability c