14 ms·
I just run it on my desktop? 64GB of DDR4 is <$150.
by AnthonyMouse 4y ago
I just run it on my desktop? 64GB of DDR4 is <$150.
- syntaxing 4y agoI'm assuming a quantized version?
- AnthonyMouse 4y agoThe 65B quantized model fits in 64GB of RAM, which I already had. Though RDIMMs on eBay are even cheaper than UDIMMs (just over $1/GB) and Broadwell-era Xeon workstations aren't that expensive if you want to run the unquantized version.