k1832

7 ms·

1. 1.▲
   by k1832 7mo ago

   Oh.. thanks for letting me know
2. 2.▲
   by k1832 7mo ago

   Thanks! Exactly, getting rid of that dynamic scaling hardware tax was the exact goal. Regarding GGUF Q8_0: I haven't benchmarked against it yet. My focus so far was on proving the hardware thesis (RTL synthesis via SkyWater 130nm) and
3. 3.▲
   I designed a bfloat16/FP8 alternative in a week using LLMs(arxiv.org)

   3 points by k1832 7mo ago|4 comments
4. 4.▲
   by k1832 5y ago

   Great