so uh, sglang recommends $330,000 worth of GPUs (minimum) per ebay prices. vLLM i'm not sure about, i can't really tell what it does from docs.vllm.ai site. So

so uh, sglang recommends $330,000 worth of GPUs (minimum) per ebay prices. vLLM i'm not sure about, i can't really tell what it does from docs.vllm.ai site. So i'm not sure you conveyed what, at least, i thought you were trying to; which is that llama.cpp isn't good enough for "home" use. Like, with a 3090 or 4000 series consumer GPU. If you want to donate some L40S to the cause, i'll send you my P.O. box info