3 ms·
I’m curious what you’re using for that (if you’re inclined to share).
by dd8601fn 5mo ago
I’m curious what you’re using for that (if you’re inclined to share).
- hparadiz 5mo agoI saw that blog post about running local models on a Xeon based server so I benchmarked a bunch of local models on it. The server is dual Xeons with 256 GB of DDR4 and I found it capable of running some things locally. It's slow but still faster than coding things manually. Also that was just an example. Even my 6 year old 6900XT is faster.