2 ms·
That's it. The community is working on getting it implemented in the popular inference engines. It came out less then 48 hours ago so give it a few days and we
by Art9681 3y ago
That's it. The community is working on getting it implemented in the popular inference engines. It came out less then 48 hours ago so give it a few days and we should be able to run it and test it at various quantizations depending on how much compute power you have.