4 ms·
I guessed you thought about consumer GPUs. We are about standard datacenter GPUs indeed. Sorry for the confusion
by gaeld 4mo ago
I guessed you thought about consumer GPUs. We are about standard datacenter GPUs indeed.
Sorry for the confusion
- embedding-shape 4mo agoDo you think maybe changing your articles title from "Real-time LLM Inference on Standard GPUs" to "Real-time LLM Inference on Standard Datacenter GPUs" might make sense here? Given more people seem confused by the title than not, and you could clear this up relatively easily, at least on your website although might be late to fix the HN title.
- gaeld 4mo agoYES - I just updated the title of our article according to your suggestion.
- irishcoffee 4mo agoOh, it isn't confusing, it is misleading. A standard GPU lets you connect a monitor. A datacenter GPU lets you do headless math.
- gaeld 4mo agoI updated the article title accordingly
- bcjdjsndon 4mo agoStandard != Datacentre