12 ms·
Hetzner GPU Server
- ecmascript 3y agoNot really related to their GPU offering but Hetzner is such a great company. I have a dedicated server I rented where I host all of my side projects. For the same price as one shitty VPS I get 8 cores, 64GB ram and a disk of 240GB or something like that. Just incredible, response times are incredibly low and there is no cap on data. The few times I have contacted support they've been great. The only times I have experienced downtime is when I have stopped or rebooted the servers. Can't recommend enough, especially if you are inside the EU and care about data privacy. The fact that they're a european company is of great value to me. If you are new on server provisioning and want to learn how to setup a new server, I wrote a small guide for how to do it for node-projects (works for pretty much any web app if you replace the node.js stuff): https://deployjs.com/ https://deployjs.com/ (hosted on that server)
- gokhan 3y agoHad a server with them for more than 10 years. Had they eliminated the setup fee, they would get more of my money for sure for small projects.
- ecmascript 3y agoThe setup fee is a one-time fee though, so if you have a server for many years that won't hurt so much. I pay around €30/month for the server I am renting but I know it will last a long time even if I get spikes on any on my many projects. For a 8 core, 16GB droplet/vps at DigitalOcean it will cost you ~$96/month. The performance is better at Hetzner for about 1/3 the cost.
- gokhan 3y agoYes. I'm talking about occasional needs for a small server for a month or two.
- ecmascript 3y agoThey have VPS cloud offerings similar to DigitalOcean as well, with no setup fees.
- gowthamgts12 3y agoWhy not go with hertzner cloud? No setup fees and you'll be billed by the usage. Still cheaper than other cloud providers.
- throwaway11460 3y agoThe VM performance tax is huge. Also, no GPU and limited/paid traffic (large limit though).
- e12e 3y agoUse the server auction? No setup fee then.
- Citizen_Lame 3y ago[flagged]
- ecmascript 3y agoI don't work at Hetzner, I live in Sweden. I'm just a happy customer giving praise for a company that really doesn't get so much attention. With all big american companies seemingly getting so much attention nowadays, I am glad for the European alternatives that we have where you don't have to ship your customers data to the three letter agencies.
- sshagent 3y agoThey often have a couple of servers with no setup.
- Citizen_Lame 3y agoAh yes, they are great if you messing about. Not so great if you have crucial business server with them.
- ecmascript 3y agowhy not?
- rapsey 3y agoWe've been running stuff on their platform for years with very little problems. Why not?
- withinboredom 3y agoI haven't run into a single issue for years, what do you mean by that?
- elric 3y agoCare to elaborate on that? I've been using their services for some 20 years at various scales, and the only complaints I've had are that their shared mailservers occasionally get blacklisted. That, and the UI of their KonsoleH could do with a bit of a refresh.
- happylion0801 3y agoSigned up from an Asian country and during signup they asked me to upload a passport copy page. I thought that was weird (I mean no other cloud provider asked for it but okay). I uploaded anyway because I thought it’s in EU so they at least have better privacy laws so they may end up deleting it later from their systems but I immediately got rejected. Not sure why no reason specified. So now they have my passport copy page without me having an account. Oh well, seems like either they have an overly aggressive spam filter that gets false positives or they don’t really like accepting signups from Asia
- lakomen 3y agoHetzner is pretty hostile towards foreigners. And don't you dare suggest in their forum that foreign tech is better than German, instaban. Fuck Hetzner
- EVa5I7bHFq9mnYK 3y agoWhat German tech - AMD, Intel or Nvidia?
- callalex 3y agoPlease don’t feed the trolls.
- lukan 3y agoI can see a possible scenario, in where rather your general attitude might have been the problem.
- Shorel 3y agoI'm from South America, got a server with them, no issues so far.
- deltaknight 3y agoI had a similar experience very recently (albeit within Europe). Did you try their manual verification process? It was available to me after two failed automatic attempts, and it basically had me send an email to Hetzner support asking if they needed any more information. I got approved manually the very next morning. Maybe not the most customer-friendly experience, but I figure half an hour of signup weirdness is okay for a solid after-signup service in the long term, especially as that half an hour is likely to deter a decent chunk of fraud.
- pmontra 3y agoWhich server do you have on Hetzner that I missed? Dedicated servers start at 37.30 Euro per month now there, the AX-41 couch is pretty good and has no setup fee. On the other side I'm paying OVH about 12 Euro per month for two small VPSes and they are even too much for me, performance wise.
- e12e 3y agoHave a look at the server auction? Tbh, I would limit my dedicated server rentals to server/ddr ram setups (which is a little more expensive). But if you just need some cpu (to transcode some video, crack some passwords, what-have-you, run a game/videochat server) - consumer cpu models give you unmetered gigabit or 30tb/month 10gbps. So can definitely be worth it vs a VPS.
- ecmascript 3y agoI have a dedicated server that I got on their auction page for 30 euro per month. That gives me 64GB of ram, 8 cores and some disk space. Sure, you can get a cheaper VPS, but given a VPS with the approx same perf it would cost much more.
- thatwasunusual 3y agoDitto. Been using them since 2012 or something, and have never had a problem (that wasn't my own fault).
- V__ 3y agoNote: For now for existing Hetzner customers only.
- greatNespresso 3y agoIs Nvidia RTX 4000 solid for training? Alternatively this card seems listed for around $1800 so at $180/month on Hetzner, it may be even cheaper to buy it, depending on the expected usage.
- Ayesh 3y agoIt's with ample RAM and the latest Intel CPU. Assuming the whole thing draws 100W, that's also including 72kWh of electricity.
- bluedino 3y agoI'm not sure what the exact 'rule' is here, but you wouldn't use a contraction in this sentence. It is, with ample RAM and the latest CPU.
- sjsdaiuasgdia 3y agoFrom https://www.yourdictionary.com/articles/contractions-correctly https://www.yourdictionary.com/articles/contractions-correct... - Contractions can be used in any position in a sentence; however, homophone contractions such as "it's" and "they're" sound better when followed by another word or phrase. The reason is that the sounds of "its" and "it's" and "they're" and "their" are so similar that they can be confusing unless they are used with the context of an additional word.
- zimpenfish 3y agoTo be fair, the contracted version doesn't read nearly as nicely. Q. Is it good for training? A. It's with ample RAM and the latest Intel CPU. vs Q. Is it good for training? A. It is with ample RAM and the latest Intel CPU.
- bluedino 3y agoI think they are agreeing with it not reading as nicely. But you still need the comma. Otherwise it sounds like: "It is with great pleasure..."
- christkv 3y agoHow is the gpu for inference or tuning ?
- SushiHippie 3y agoFWIW, on the server auction, you could get GPU servers since a while: https://www.hetzner.com/sb/#additional=GPU https://www.hetzner.com/sb/#additional=GPU Looks like currently there are only GTX 1080s on the server auction, I don't know if they normally have other GPUs available as well.
- alberth 3y agoNvidia RTX 4000 SFF Ada From the OP link, the GPU-Server GEX44 server line includes RTX 4000. And the server only cost €184/month.
- SushiHippie 3y agoI meant if they have other GPUs normally available in the server auction. As far as I understand the servers in the server auction are mostly custom built ones for customers and once they stop renting them they land on the server auction for others to rent. The one with the RTX 4000 seems to be a standardized line of products.
- dizhn 3y agoThey briefly had GPU servers before. I believe they stopped when crypto messed up the gpu prices and supply. That's why you're seeing them in the auction now. But they usually go quick. This might change now since they have a brand new offering. The old GPUs would have very litle memory by the way. Not ideal for AI.
- albert180 3y agoThey stopped because they had a high percentage of abuse with Morons mining crypto
- aborsy 3y agoThe price of a brand new Dell precision PC with a core i9 13900 CPU (24 cores), 64 GB RAM and 2X2TB NVMe is probably around 2.5k$. It costs tens of Euros per month in electricity to run this PC. The hardware is good to go for some 3 years, before running into various issues (newer CPUs becoming much more power efficient, firmware updates getting less and less frequent etc). Consider also the cost of components failure, time wasted in dealing with hardware, etc. On hetzner it all costs less than 100$ per month. Doesn’t this imply that it’s better to rent than to buy?
- throwaway11460 3y agoYes, the volume discounts and economies of scale they can get (while you can't) are insane.
- singhrac 3y agoOne of the simplest is that data center energy pricing is just simply different from residential energy, because they often get wholesale (plus small markup) rather than residential rates.
- formerly_proven 3y agoThe majority of residential rates (about 40 ct/kWh) are taxes and levies, not the actual price of the electricity. That's why industrial rates can be less than half of residential rates.
- throwaway11460 3y agoCan you be more specific? What kind of taxes? VAT is paid by the end consumer so you're not getting out of that one. Are there special consumption taxes on electricity in Germany? In my experience the largest difference is distribution cost. The mandated distribution monopoly charges a lot (regulated price) to small customers.
- 3y ago
- petercooper 3y agoI've just ordered one to ditz around with. We're early in the process of deploying our own internal server for Mixtral work, but it'll be interesting to see how this performs (in raw terms, almost certainly worse, since we can roll out a 4090 without getting into trouble – but Hetzner has a better connection and handles the maintenance, so..) Order has been accepted but not deployed yet. I'll update when I have some initial inference numbers.
- syntaxing 3y agoI never deployed it professionally but wouldn’t getting a Mac Studio be a better run for your money if you’re only inferencing?
- petercooper 3y agoPossibly. It's not a bad idea! The performance is pretty good in our initial tests, though cloud platforms do scale further in terms of concurrency. Given how quickly things are changing, using more generic hardware (i.e. PCs and Nvidia cards) or leasing cloud based services might make more business sense in the long term, so investigating fallbacks with more control, like this server, are worthwhile experiments anyway. Further, while I've been an Apple superfan for a couple of decades now, their recent attitude towards developers stinks, and I'm loathe to give them any more money than I need to right now, so I might be migrating away from the platform in any case.
- deleted 3y ago[deleted]
- petercooper 3y agoI got it after a few hours. You need to install drivers/CUDA yourself, but all very straightforward. Unfortunately due to having 20GB of VRAM, I'm limited to mixtral:8x7b-instruct-v0.1-q2_K but it runs fine, generating at about 40 tokens/s (65 tok/s for eval). As per official specs, it's running maxed out at 70W (being an SFF card). (I've now tried running the Q4 mixtral which is 26GB. 18GB is on GPU, 8GB through CPU. Gets about 11 tok/s.)
- gregoriol 3y agoIt's a good price at ~0.30$/hour comparing to Paperspace's RTX 4000 with 30GB RAM at ~0.56$/hour. Are there many other providers for such environments?
- pacohernandezg 3y agovast.ai, runpod.io, tensordock.com, ... I have just ordered a GEX44 from Hetzner. :-)
- edgoode 3y agoIf you want to check them all out in one place, we built a platform for that at https://shadeform.ai https://shadeform.ai
- binarymax 3y agoThe GPU product page: https://www.nvidia.com/en-us/design-visualization/rtx-4000-sff/ https://www.nvidia.com/en-us/design-visualization/rtx-4000-s... 20GB RAM, can fit 13B param models, and maybe some quantized larger models.
- ramesh31 3y agoDoes every European tech company have some kind of committe that ensures their customer facing website looks like a decrepit ASP page from 2004? I mean what explains this? It's a billion dollar corporation and I am having serious reservations about whether I would even enter my credit card info on this site.
- lakomen 3y agoIt's true. And it breaks on mobile when you use the menu.
- delfinom 3y agoHetzner's site looks fine to me. Highly readable and to the point unlike modern web shit where you have to scroll through 5 miles of marketing animatinos.
- rsynnott 3y agoI mean, see also AWS; for a very long time their console looked like something from the dark ages. I think they have largely spruced it up now, though I'm not sure it helped _usability_ too much, and may have actually made it worse.
- system2 3y agoI see the same thing on HN posts. 1999 vibes everywhere.
- Shorel 3y agoI was going to seriously disagree with you, and then I looked at their source code. It's awful. I would still buy from them because their reputation trumps any concerns.
- hipadev23 3y agoJust make sure any workloads you place on Hetzner are treated as spot instances and outputs are immediately sent off network. The reliability of their systems and customer support is very low. Hetzner is a 5-star or 1-star company. Are you willing to risk your business on the flip of a coin? My own experience [2] was definitely a 1-star. [1] https://www.trustpilot.com/review/hetzner.com https://www.trustpilot.com/review/hetzner.com [2] https://news.ycombinator.com/item?id=39075608 https://news.ycombinator.com/item?id=39075608
- tomschwiha 3y agoI've been with Hetzner for around 10 years and didn't had a single larger incident so far. Support also answered promptly - didn't had the need to request a lot support so far. Running 2-3 servers and a few cloud instances.
- gizmo 3y agoReliability and customer support are unbelievably good. 99.995% uptime for the past 10 years. Hetzner will happily customize your servers however you like, and at their low prices you can have hot standbys for everything and still save money.
- whizzter 3y agoMy friend went onto Hetzner for the performance/price, unfortunately the machines drive died within 2 months iirc. Seems like if you're buying on auction you'll get a wiped drive and if you're unlucky it's been written to a lot already, don't remember the specifics but he really wasn't a happy customer afterwards. I think the last sentence you have there is pertient though, maybe don't go for Hetzner unless you can also afford to have a hot-spare (but for the performance/price you probably can compared to any public cloud). In my friends case he was boot-strapping but needed the CPU so he was really penny pinching.
- dr_faustus 3y agoTrustpilot is a scam which encourages bad reviews to force companies to buy their paid plan to “manage” those bad reviews and to feed it good reviews.
- dmaa 3y agoIt looks like a good value for money, but immediately after registering, I get this reply "After reviewing your updated customer information, we have decided to deactivate your account because of some concerns we have regarding this information. Therefore, we have cancelled all your existing products and orders with us." Someone has a similar experience? I've tried it twice, filled everything truthfuly, valid credit cards etc. and no still the same.
- stanislavb 3y agoI haven’t faced this issue myself, however, lots of people from India and some other countries have this experience. I’d assume it’s something to do with collecting recurring CC payments from Indian cards. That’s inherently difficult.
- dmaa 3y agoThat would also be my guess, but I live in western Europe.
- breakingcups 3y agoThere's a manual verification process if you contact support. Obnoxious that it's needed, but works for many people.
- belk 3y agoI got this when I first registered, contacted support and it was lifted in a day or two.
- lobito14 3y agoHetzner has one of the worst customer support I've ever seen. Get really, really, faraway from this company.
- nubinetwork 3y agoAfter the exchange rate, that's $270 CAD a month... after a few months, you might as well just buy a raptorlake and run it locally.
- zymhan 3y agoWelcome to Cloud Computing.
- throwaway81523 3y agoIt's a GPU system, not just raptor lake.
- pinetroey 3y agoA few months ago I tried to register an account, but I was denied. I don't know why, never got a response... I went with ovh.
- ThinkBeat 3y agoI need some help: I have no idea where the NVIDIA RTX 4000 SFF belongs in the hierarchy of speed and suitability for "AI" computing. How does this compare to a NVIDIA A800 40G? (if that is still considered good, I can't keep up) To me the RTX part of the name sounds more on the consumer side but I am probably wrong about that as well.
- renewiltord 3y agoThey had a strange setup process. I had to scan my passport and stuff. However, I did have a VPS with them that had uptime greater than a decade and that I killed only because the underlying hardware was going away. That was some 7 years ago or so.
- kristianp 3y agoIt's running an RTX 4000 SFF Ada, 20GB GDDR6. Interesting that they've gone with a single-slot, low power card. Doesn't pull enough power to mess with their cooling/power design, I guess. Not a lot of graphics RAM to do much with LLMs. That card is about $1500: https://www.amazon.com/dp/B0C2KMXQYG https://www.amazon.com/dp/B0C2KMXQYG
- yread 3y agoIt's a pity you can't commit to 3 year rental for a discount
- Hetzner_OL 3y agoHi there, Thanks for helping to spread the news about our new GPU server, the GEX44. Please keep in mind that it’s not like we don’t want you to open an account – it’s more about safety & security. In general, we take extra precautions when it comes to verifying accounts and accepting new customers, as in these cases the potential of abuse of our ToC are higher. As a reliable hosting partner, we always take the time to listen to our customers and will do our best to find a solution for each case. So feel free to reach out to us if you need further assistance. --Katie
- thijsvandien 3y agoA reliable partner does not close accounts without any kind of recourse. Denying that under the guise of fraud prevention is just security through obscurity. I hope these practices become illegal sooner rather than later. Never before have I been treated as a criminal as much for trying to do legitimate business, and it’s quite the experience.
- gn4d 3y agoDo we get a discount for your MITM? Marketing still doing damage control, I see.