I wish I could say that it performs reasonably on my hardware. 8x Radeon AI Pro 9700XTs, and I can't get it to hit double-digit tokens per second. Neither vllm

I wish I could say that it performs reasonably on my hardware. 8x Radeon AI Pro 9700XTs, and I can't get it to hit double-digit tokens per second. Neither vllm nor llama.cpp, with various combinations of quants, draft models, and parallelism methods can get it to run at a tolerable speed. I'll be sticking with StepFun 3.7-Flash for the foreseeable future :(