3 ms·
Strong disagree. In a completely unrelated field, I'm seeing pretty great results with knowledge distillation to generate AI language models that fit into 20 m
by fxtentacle 4y ago
Strong disagree.
In a completely unrelated field, I'm seeing pretty great results with knowledge distillation to generate AI language models that fit into 20 mio float16 parameters (40MB) and can process 1GB of raw text in roughly 12 hours.
- janekm 4y ago12 hours on a single CPU core, or on a GPU?
- fxtentacle 4y ago12 hours on a Ryzen 5900X with 12 cores. So not quite fast enough yet, but only 3x too slow.