3 ms·
That's closer than I thought, to be honest. Note also that the 4004 lacks a floating-point unit of any kind - not just a vector unit. I think people make 8-bi
by pclmulqdq 2y ago
That's closer than I thought, to be honest.
Note also that the 4004 lacks a floating-point unit of any kind - not just a vector unit. I think people make 8-bit integer quantizations of LLMs, though, which would be the fastest versions to run on a 4004.
- jart 2y agoA lot of quants just upcast to floats. Some of them work on integer multiplication using pmaddubsw. But oof, it looks like the i4004 doesn't even have that.