2 ms·
Because it's not just the use ternary values. It's also that there are no dot-products; there are only additions. And when we apply both changes to existing LLM
by cs702 3y ago
Because it's not just the use ternary values. It's also that there are no dot-products; there are only additions. And when we apply both changes to existing LLMs, there's no performance degradation (as tested by the authors).