4 ms·
Carolina Cloud – One third the cost of AWS for data science workloads
We're Carolina Cloud - managed data science infrastructure at ~1/3 the cost of AWS.
I left my job earlier this year after watching companies get crushed by cloud bills for workloads that didn't need hyperscaler complexity. Some examples from my previous life:
- $1k/month for a basic 16 vCPU VM
- $50k/month for a high-RAM instance
- Over $1k/month for notebook platform start-stop execution
We built Carolina Cloud for data scientists and small teams who need serious compute without the sticker shock. Our sweet spot: if you're running VMs, notebooks, or RStudio and not deeply tied to AWS/Azure/GCP service ecosystems, we can save you a lot of money.
What we offer:
- Standard Ubuntu VMs
- One-click Marimo notebooks
- One-click RStudio Server and Shiny hosting
- S3-compatible object storage (launching soon)
- Prepay discounts for commitments as short as 2 weeks
- SOC2-certified, HIPAA-compliant datacenter in Charlotte, NC
Simple pricing: $0.005/vCPU/hr, $0.005/GiB RAM/hr, and $0.0001/GiB of hot storage/hr on AMD EPYC Turin processors. A 32 vCPU, 128GB RAM instance runs ~$240/month vs $800+ on AWS.
We're not trying to replicate every AWS service - if you need Lambda + Secrets Manager + S3 with pre-signed URLs, stick with AWS. But if you're a hedge fund running backtests, a biotech team analyzing genomics data, or a researcher who just needs a beefy VM without surprise egress fees, we're 1/3 the price.
Check us out at console.carolinacloud.io - happy to answer questions about our infrastructure, pricing, or why we think there's room for regional clouds built on owned hardware.
- brudgers 10mo agowe're 1/3 the price How will you provide high quality service and reliability while competing on price with the scale and financial might of AWS? Because in B2B, those things tend to have a higher value than initial cost. Or to put it another way, your customers will be making long term investments by choosing you. Successfully competing on price in a commodity market requires cheaper access to resources and because price is the easiest way to segment a market, low prices attract price sensitive customers...they are the least desirable customers. Good luck.
- bojangleslover 10mo agoYou are right for probably 60% of customers. For someone spending $3k/mo on cloud on a company doing $500k/yr of revenue then going down to $1k/mo on cloud for a less tried and true product (us) is likely a bad idea. Similarly for a mom-and-pop bakery (contrived example) hosting a website for $60/mo, going down to $20/mo (just to keep the 1/3 ratio) also is probably not worth it. But some of our customers are not like that. For example a hedge fund we have been working with needs 512G RAM and 256 vCPUs for a mortgage model. The data size is not too big and once they get their results they rip it back to on-prem. The complexity is low, ie they just ssh in and do their models. Often they let them run over the weekend. And these guys are very price-sensitive. In their industry, saving money means more carry for partners and bigger bonuses for quants. These guys are counting nickels. So I think you're totally right for the large part of the market that we're not really for, and we're not really competing for those types of customers. But we're not really providing much managed service, we're providing a commodity that, assuming you don't need the high-complexity ecosystem surrounding it, can be very nice for customers who are price-sensitive.
- jammo 10mo agoHave you found any customers who are too price sensitive for you? Presumably at some point it is cheaper to go and rent bare metal.
- handfuloflight 10mo agoI'll bite. How much capacity do you have or some examples of the capacity you're managing?
- bojangleslover 10mo agoWe have about 1000 cores right now. We're really excited for the AMD EPYC Venice — 256 physical cores each -> 512 vCPUs -> 1024 vCPUS on a single board with dual-socket. It will probably be about $40k per machine with these RAM prices but we're definitely going to buy a few. A full data center on a single motherboard! So we're limited on capacity since we own all our own hardware. Please do not use us for auto-scaling just yet. Our software would have no issue with us linking up other cloud machines such as AWS EC2 to our fleet and offering it there, which could help with auto-scaling, but we would not make any money on that and it would be a lot of engineering effort for us right now.
- cyberax 10mo agoNice! I'm definitely going to try you for our testing infrastructure.
- Lucasoato 10mo agoIf you’re looking for a cheap but reliable alternative, Hetzner offers i7 64GB Ram servers for as low as 37.45€/month. Of course you’re not in AWS, forget about all the managed services, but we’re talking about 95%~98% cheaper egress costs, with 20TB included in most machines.
- h33t-l4x0r 10mo agoWhat about ingress costs?
- re-thc 10mo agofree
- jorams 10mo agoApproximately nobody charges for basic incoming traffic to a server. If it's not mentioned it's free.
- h33t-l4x0r 10mo agoAWS will charge you if you cross zones.
- bojangleslover 10mo agoWe have no egress fees but you're right about Hetzner. They're cheap. We aim to offer more value-added software to make up for it. Also that machine is in Europe, Americans don't like the latency (at least I don't), they have been known to shut people down (within reason). Also I'm seeing that the most they can go RAM-wise for a dedicated US location is 192G. We go to 512 and will soon go beyond. I'm sure they'll get there soon but that's a consideration as well.
- _nhh 10mo agoPlease go an checkout the whole offer of hetzner is already everything you need.
- leetrout 10mo agoI looked around for reasonable datacenter colo in the triad and triangle and didn't get anything promising. Where are you physically hosting your infra? Curious if you are having to buy bandwidth as well. Some of the Midwest data centers include over 30TB of bandwidth in the rack rentals. And if you are willing to go into the details curious how you are handling bare metal provisioning. MaaS or home grown tooling? Or are you just installing proxmox by hand?
- Onavo 10mo agoWhy would they need to buy bandwidth? Many places would offer you a gigabit pipe directly.
- deleted 10mo ago[deleted]
- leetrout 10mo agoSure, some places charge to upgrade. Some places are metered. 100Mbps is 33TB / mo. 1Gbps is 330 TB / mo. I'm curious what they have and how they prevent saturation from a client or they just pass on networks managed by the DC.
- leetrout 10mo agoReplying to myself since OP shared elsewhere they are using Tier. $950.00/month for 100TB @ 1Gbps 20A @ 208V 61 Usable IPv4 or free BGP And half rack is $650 / mo for 30TB @ 1Gbps (so basically the full month at 1/10th full pipe). https://www.tier.net/colocation https://www.tier.net/colocation
- re-thc 10mo ago> Many places would offer you a gigabit pipe directly. i.e. you don't have redundancy? A gigabit is nothing these days sadly. You can get a surge in traffic (DDoS or not) and be stuck quite quickly. You always need extra capacity to deal with issues unforeseen and that adds to the cost.
- 10mo ago
- tcdent 10mo agoCan I attach multiple GPUs to a container?
- johnhamlin 10mo agoLove seeing NC on HN. Go Heels!
- tianqi 10mo agoI'm very interested in your product. However, I'd like to report a strange phenomenon: whenever I open your website's homepage, although it doesn't seem to use a lot of memory, my Chrome becomes extremely laggy, and afterwards my entire Mac OS becomes very slow. The first time I encountered this, I couldn't determine the cause. I closed all applications and rebooted my computer. After working perfectly for a while, I reopened your website, and my Chrome and OS became almost unresponsive. After rebooting my computer again, without opening any other applications, just Chrome and your website, and it immediately became nearly unresponsive again. Therefore, while I'm not entirely sure, it seems highly related to your website.
- jjm 10mo agoIt could be the three.js shader on the page that they use which renders in the background. I think you may be able to disable shaders to test but not sure. Been awhile.
- jjm 10mo agoWant to point out, it does run pretty quick on my iPhone surprisingly (and faster than my other dev laptop :-P). Almost forget how much power phones have...
- _ea1k 10mo agoYeah, I had the same experience. It made the page basically unusable for me.
- leetrout 10mo agoIt is also terrible to scroll on iOS with power saver turned on.
- mystifyingpoi 10mo agoSame here.
- nilslice 10mo agoIt's good of you not to jump to any conclusions!
- tomhow 10mo agoWe’ve removed the Show HN designation for now because it’s not clear that this is something people can play with without paying anything. If it is possible/easy, please indicate in a reply to me, and we can update the title and post. Of course it’s still fine to be on the front page of HN if the community finds it interesting. But Show HN is meant to be about showcasing an interesting project you’ve built (with a focus on technology discovery) rather than announcing a product people can buy.
- bojangleslover 10mo agoThanks for the explanation. As a long time user I feel embarrassed to have not known this but I will definitely keep this in mind going forward.
- 6r17 10mo agoSomething is really really off with the website I would suggest a remake of the front-end as unfortunately it seems to miss the mark. The product seems genuinely valuable so don't get lost in that crazy background thing - focus on what information should be delivered - outline the important stuff - rn it broke my browser and it feels like you don't have the right focus. I closed it and just don't want to be bothered engaging more with it otherwise than writing this stinky commentary unrelated to what you actually deliver. Keep up the great work it seems you have done the most !
- bojangleslover 10mo agoThanks for the honest feedback. We just fixed this, I was hoping people wouldn't stick around on the landing page for too long since our console lets you do almost everything without needing an account. That assumption was obviously misguided!
- mindcrime 10mo ago> Carolina Cloud > Charlotte, NC > bojangleslover Username checks out! Seriously though, this looks really cool. And I'm always happy to see other NC folks representing on HN. I could see using your service for some stuff, so who knows, we may be sending some business your way. It wouldn't be much (for now), but hey...
- bojangleslover 10mo agoIf you need more trial credits than our pitiful $1 email me at derek@carolinacloud.io. We were inundated with crypto miners from Russia so we had to ban all .ru domains from signing up + shrink the free trial. People on HN are obviously legit users so anyone reading this please email me at derek at carolinacloud.io and we will give you $250 free credits at least or maybe more if your workload requires it!
- dotancohen 10mo agoWhat type of workflows do you support? My startup is running a lot of Whisper on user-provided audio clips. Is that something we could run on your servers? If so, I'll email you for trial credits.
- Thaxll 10mo agoNot sure what's going on with the landing page but it's CPU / GPU heavy.
- brcmthrowaway 10mo agoDon't put a particle sim on your landing page
- amhoab 10mo agoThis is a huge market and there are lots of competitors out there. Just FYI that 1/3 of the AWS price isn't really considered cheap when you look at the budget market. Some of the cheap European providers have US presence now as well. That said, the pricing isn't too bad and the lineup looks good. Also, the website also gives me issues on my Android phone.
- h33t-l4x0r 10mo ago> Some of the cheap European providers have US presence now as well Not that offer s3-compatible object storage (which I guess is on the roadmap) and Turin VPS. These prices are legit and I'm not pulling the trigger yet but I'm definitely interested.
- bojangleslover 10mo agoYes we're going to offer this very soon, we have a bunch of SSDs but we're still deliberating on what to use now that MinIO is moving toward closed source.
- Imustaskforhelp 10mo agogarage (written in rust) / seaweedfs (written in golang) are something which I have heard is mostly recommended by the community. Someone on lowendtalk recently created a very minimalist php s3 thing too if you only need the basic crud app but I would recommend you to select garage from what I've heard I have also heard someone creating a new rust s3 application but I forgot its name but maybe you can look out for it too and see what fits the best for your goal. Also coolify team is maintaining a docker image of MinIO but that was before they said that minio is going closed source and that they had just stopped providing docker images so I am not sure how valid it is right now. There must be forks who are maintaining Minio too so you can look at it too.
- deleted 10mo ago[deleted]
- bojangleslover 10mo ago
- 0xbadcafebee 10mo ago"one third the cost of AWS" is just AWS with savings plans enabled > if you're [...] a researcher who just needs a beefy VM without surprise egress fees, we're 1/3 the price The AWS egress fee is $0.08/GB, whereas Hetzner has $0.00/GB. So, why pay $0.0225/GB? These companies are the worst kind of scam. If you could really provide a product on par with the big boys but somehow lower than commodity prices, you'd corner the entire hosting/cloud market. But you can't, because they already made things hyper-efficient. It's like trying to sell someone a $5 hamburger by advertising that some other restaurant sells a $15 hamburger. It turns out that other restaurant also sells a $5 hamburger, it's just not at the top of the menu, because cheap isn't always a sales leader.
- solatic 10mo agoThe argument I'm hearing you make is that Hetzner needs to license a white-labelled version to distributors. If the servers are really commoditized then why aren't the data scientists in this "AWS is too expensive for data science" market going to Hetzner?
- ilaksh 10mo agoThe console page is showing third party login failure on my phone after I tried to switch to desktop mode because I couldn't see the create instance form. Also the wrbgl stuff on the home page crashes my Android browser after a few minutes.
- bojangleslover 10mo agoDid you try to log in with Github or gmail?
- Imustaskforhelp 10mo agoWhat service are you using to run your cloud on top of? Do you have your own hardware (which I feel is unlikely) or are you using any other cloud provider to build on top of I was interested in building my own cloud (which had a specific niche) and the biggest issues which happened for me personally were that most companies had the issues that if you wanted to create your own cloud on top of, you were responsible for the abuse from your clients and they can shutdown your account if threats persisted/It wasn't really clear for many companies so I was always somewhat worried about it, so I am curious as to how you are dealing with it or what your thoughts are on this matter.
- re-thc 10mo ago> they can shutdown your account if threats persisted That problem can NEVER be avoided at any level unless you run absolutely everything (which is almost impossible). What everyone does is have a system to quickly pass on and also shutdown who's 1 layer down. You receive a report and deal with the client. > I was interested in building my own cloud At the end of the day the problem has nothing to do with clouds. It happens everywhere e.g. if you rented out a house and someone did something illegal with it... how do you avoid it? All the same.
- bojangleslover 10mo agoWe actually ran out of my house in our very early stages at which case we owned everything. We had Google Fiber 8gbps for $150/mo. The only issue was the Google Fiber terms of service — ie they could shut us down at any time. This was one reason we went to colocation.
- re-thc 10mo ago> at which case we owned everything. We had Google Fiber So you didn’t own everything. Google owned the IPs and network. It’s the same colocating in that your network providers can be shut down.
- 10mo ago
- alicepfulton 10mo agoCo-Founder here! Happy to see this has blown up. If anyone wants free trial creits beyond our crypto miner-defense $1 credit please email me at alice@carolinacloud.io or message me on Linkedin at https://www.linkedin.com/in/alice-pearson-1a0339183/ https://www.linkedin.com/in/alice-pearson-1a0339183/
- kjfarm 10mo agoLove that it is in NC! Though, I'm confused who this is for. Is it for genomics data scientists mainly or is it general compute (I would also compare with hetzner and the other clouds if you are going the general compute method). If genomics or data scientists is the main audience, is this going to grow to be more collab notebook plug and play? Very cool and wish you the best!
- bojangleslover 10mo agoReally it's for both. One of our cofounders came from a genomics background and so that's why we have the Marimo notebooks + R Studio Server + genomics container. But we've also had a lot of requests for general VMs so we made some of those as well.
- statskier 10mo agoI’m confused about what the licensing situation is that allows you to provide RStudio Server instances. Does Posit allow third parties to do that?
- gapeleon 10mo agoBad timing. I just tried it, and the entire platform went offline within 20 minutes. https://console.carolinacloud.io/ https://console.carolinacloud.io/ is unreachable, my container is also unreachable. https://downforeveryoneorjustme.com/console.carolinacloud.io?proto=https https://downforeveryoneorjustme.com/console.carolinacloud.io...