4 ms·
Author here, I just noticed this. If you have any questions I can try answering them.
by szcs 2y ago
Author here, I just noticed this. If you have any questions I can try answering them.
- smusamashah 2y agoDo you have plans to apply this on a small open LLM as a POC to show that there is no loss of performance?
- szcs 2y agoYes, LLMs are planned too.
- fooblaster 2y agoI don't think I quite understand how to apply your technique to gpus, which have discrete formats like fp4, fp8, fp16, int8, etc. Can you shed some light on that?