4 ms·
You can run this today on a consumer GPU at slow speed, using swapping and 4-bit weights (which works surprisingly well and is the new hot topic now)
by l33tman 4y ago
You can run this today on a consumer GPU at slow speed, using swapping and 4-bit weights (which works surprisingly well and is the new hot topic now)