3 ms·
> In existing LLMs, we can replace all parameter floating-point values representing real numbers with ternary values representing (-1, 0, 1). does that mean we
by fragmede 3y ago
> In existing LLMs, we can replace all parameter floating-point values representing real numbers with ternary values representing (-1, 0, 1).
does that mean we can do integer instead of floating point math for some parts of the training? that seems like a really big win