3 ms·
As an "SRE engineer", I don't agree. Certainly in an university/R&D environment, you cannot compete with what 'the cloud' is able to offer within the reach of a
by koffiezet 7y ago
As an "SRE engineer", I don't agree. Certainly in an university/R&D environment, you cannot compete with what 'the cloud' is able to offer within the reach of a few mouse clicks. It would be absolutely moronic to set up an entire infra yourself with GPU's, ... specifically tailored to for 1 research project to then throw it away after a few months, or see the scope change every 2 weeks.
One of the reasons such AI tech is able to move this fast because the cloud has become a commodity. People start to expect this kind of flexibility. It's impossible to self-host every possible thing some guy might want to try out.
Once you have a stable application - sure you might want to invest in own hosting for this, but even then it's an expensive up-front investment for something that might not go anywhere. I know a few places where they have a bunch of maxed-out nVidia DGX systems catching dust for exactly this reason.
- Tepix 7y agoAt 10k per day it is absolutely worth it to hire someone to take care of a bunch of cheap servers.
- lallysingh 7y agoThat's what, $2.5MM/yr?
- deleted 7y ago[deleted]
- koffiezet 7y agoServers with GPU's are not going to be cheap :)
- blaser-waffle 7y agoServers are a CapEx purchase, and can be depreciated or re-purposed. 10k/day makes sense for a short project, but if this is going to be an on-going thing -- like 2-3 years -- then absolutely buy that hardware and have an internal team run it.
- deleted 7y ago[deleted]