Got this up and running at 250 tok/s about 2500 agg tok/s for 16 users and now this morning got https://huggingface.co/webbrain-one/DeepSeek-V4-Flash-0731-Visio

Got this up and running at 250 tok/s about 2500 agg tok/s for 16 users and now this morning got https://huggingface.co/webbrain-one/DeepSeek-V4-Flash-0731-Vision-BF16 https://huggingface.co/webbrain-one/DeepSeek-V4-Flash-0731-V... working - patched it to support multiple images... should post this soon to huggingface - having about gpt-5.6 terra high locally feels pretty good