jojo2219

4 ms·

1. 1.▲
   Observing Spooky Action at a Distance?(functional-coat-477.notion.site)

   1 points by jojo2219 2y ago|0 comments
2. 2.▲
   by jojo2219 2y ago

   what's the state of the art in quantization methods these days that one might apply to a model like LLama 3? Any particular literature to read? Of course priorities differ across methods. Rather than saving space or speeding up calcula
3. 3.▲
   by jojo2219 2y ago

   weights and activations all bf16?
4. 4.▲
   by jojo2219 2y ago

   Where are f32 and f16 used? I see a lot of `.float()' and `.type_as()' in the model file, and nothing explicit about f16. Are the weights and all the activations in f32?