4 ms·
In germany it's a pretty common think for universities to have some servers for themself. 1. Their use case is kinda different. The servers mostly run heavy CS
by dathinab 7y ago
In germany it's a pretty common think for universities to have some servers for themself.
1. Their use case is kinda different. The servers mostly run heavy CS research related stuff. E.g. they might have heavy CPU load and heavy traffic between they servers but they have less often heavy traffic to the "normal internet" (if they have heavy traffic to the outside it's normally to other research institutes which not seldom have dedicated wire connections).
2. They might run target specific optimized CPU or GPU heavy compute tasks going on for weeks at a time. This is really expansive in the cloud which is mostly focused in thinks like web services.
3. When they don't run such tasks in the research groups they want to allow their juniors to run their research tasks "for free". Which wouldn't work with a payment model as done in the cloud.
4. They don't want to relay on some external company.
Also I'm not sure are there even (affordable) cloud systems with compatible spec? (like with 4+TB of RAM, I'm not kidding this is a requirement for some kind of tasks or they will take way to long and requires additional complexity by using special data structures which support partial offline data in the right way, which can be very costly in dev time)??
- jmalicki 7y agoAWS has systems with up to 24TiB of RAM (u-24tb1.metal) [0], but the pricing is "call us". For almost 4TiB of RAM (x1e.32xlarge), it's about $28/hr [1] [0] https://aws.amazon.com/about-aws/whats-new/2019/10/now-available-amazon-ec2-high-memory-instances-purpose-built-run-large-in-memory-databases/ https://aws.amazon.com/about-aws/whats-new/2019/10/now-avail... [1] https://aws.amazon.com/ec2/pricing/on-demand/ https://aws.amazon.com/ec2/pricing/on-demand/
- wbillingsley 7y agoFor a researcher, that means running an experiment changes from "running the experiment" to six months of meetings with higher management establishing business cases, budget justifications, getting competitive quotes from different providers, etc. (in other words it just doesn't happen). The choice is not between "on premises" and "cloud", it's between "on premises" and "our glossy faculty brochure says you can do this but really you can't".
- cmckn 7y agoThis struck a nerve with me. I was a SWE at a company that moved to the cloud last year, after having a couple racks at a local colo previously. I was able to experiment and iterate so much faster when we owned hardware, despite all the cloud's elasticity. After we migrated, everything was request, wait, explain, request, wait... I know some organizations handle this really well, but when mine didn't, it sucked to be a developer there.
- RockIslandLine 7y agoIt's not just CS. The computational chemistry and materials science crystallography folks can have jobs that run for days or weeks too.
- veddox 7y agoI'm at a center for computational biology - our genomics guys have been known to use 90% of our university's HPC capacity ;-) My own work (ecological modelling) is not as heavy, but when I run a full experiment, that takes a 32 core machine about two weeks to complete.
- mintplant 7y agoUCSD here. The CS department building has a large room off in the back filled with cages where we rack up our own machines. There's an internal process by which you can request VM allocations, which ultimately also run on top of a set of on-prem servers. So we have both bare metal and a kind of mini managed cloud to work with, without having to go through purchasing approval just to run a fuzzer or do a web crawl.