4 ms·
> If squeezing the best open models onto GPUs and serving them to millions of developers sounds like your kind of problem, come work with us. What is the typic
by joshuamcginnis 2mo ago
> If squeezing the best open models onto GPUs and serving them to millions of developers sounds like your kind of problem, come work with us.
What is the typical job title and/or skillset for this?
- simonw 2mo agoI've seen this called MLOps.
- buildbot 2mo agoMLOps though typically wouldn't been going quantization? It requires some careful testing of accuracy and performance even today. Applied ML Research Engineer or something maybe, not that I have ever seen that title. Maybe just catchall ML Engineer...
- deleted 2mo ago[deleted]
- overfeed 2mo agoWhat is the typical job title and/or skillset for this? It can be any one of many jobs depending on how high close to the metal one's focus is, but the highest headcount role is usually SRE/Infra/Ops with GPU knowledge sprinkled on top. That is to say Linux sysadmin, networking, fleet management, scaling, incident troubleshooting, etc.
- Tepix 2mo agoLatent space is calling the whole subject "inference engineering" in their episode https://www.latent.space/p/inference-eng https://www.latent.space/p/inference-eng