3 ms·

I just wish they'd support Pascal :( Nvidia might have given up support but it doesn't mean vllm have to (llama.cpp didn't).

• ta93754829 27d ago
  Pascal? The programming language?
  • lightdot 27d ago
    In this case, Pascal as a Nvidia's codename for a GPU microarchitecture. https://en.wikipedia.org/wiki/Pascal_(microarchitecture) https://en.wikipedia.org/wiki/Pascal_(microarchitecture) I guess many would like to use stock vLLM to run inference on affordable P100...
  • SillyUsername 27d ago
    Sorry I should have qualified it as Nvidia Pascal architecture.