lebovic

10 ms·

91.
AWS has a low elasticity ceiling for big servers(noahlebovic.com)
15 points by lebovic 4y ago|7 comments
92.
by lebovic 4y ago
I'm a software engineer who works on genomics. I see a lot of negativity in this thread, which mirrors my experience: in most places, you'll be paid like a researcher with the respect of a lab assistant – unless you have a PhD and
93.
by lebovic 4y ago
Author here. It's clear that you genuinely believe my intent here is to be deceptive, so I think your comment deserves a thoughtful response. For context, I work on a computational biology infrastructure company that only uses cloud co
94.
by lebovic 4y ago
True! It sometimes drops even more, which definitely makes spot instances attractive. The r5.16xlarges had a ~80% discount and a <5% termination rate for while. Also, if all of scientific computing switched to AWS in order to exploit spo
95.
by lebovic 4y ago
Author here. I agree that pricing is highly negotiable for any large cloud provider, and there are even (capped) egress fee waivers that you can negotiate as a part of your contract. There's also a place for using AWS; I used it for a
96.
by lebovic 4y ago
Author here! Spot instance pricing is better than on-demand, but it doesn't include data transfer, and it's still more expensive than on-prem/Hetzner/etc. Data transfer costs exceed the cost of the instance itself if you
97.
by lebovic 4y ago
Yep, that's right! Toolchest focuses on compute, deploying and optimizing popular scientific computing packages.
98.
by lebovic 4y ago
In HPC land, most hardware is amortized over five years and then replaced! If you keep your service in life for five years at high utilization, you're doing great. For example, the Blue Waters supercomputer at UIUC was originally expec
99.
by lebovic 4y ago
Toolchest actually runs scientific computing on AWS! I'm just frustrated by what we can build, because most scientific compute can't effectively shift to AWS
100.
by lebovic 4y ago
Author here! I think running an HPC service that has a steady queue in AWS can be more than 3x as expensive. What type of HPC do you work in? Maybe I'm over-indexing on computational biology.
101.
by lebovic 4y ago
Author here! I worked for the computing infrastructure for a DNA sequencing facility, and I run a computational biology infrastructure company (trytoolchest.com, YC W22). Both are built on AWS, so I do think AWS in scientific computing has
102.
by lebovic 4y ago
Author here. I agree with your points! I use AWS for a computational biology company I'm working on. A lot of scientific computing can spin up and down within a couple hours on AWS and benefits from fast turnaround. Most academic HPCs
103.
by lebovic 4y ago
For fast-moving researchers who are blocked by a queue, cloud computing still makes sense. I guess I wasn't clear enough in the last section about how I still use AWS for startup-scale computational biology. My scientific computing sta
104.
by lebovic 4y ago
Even spot instances on AWS are still over 2x more expensive per month than Hetzner. The cheapest c5a.24xlarge spot instance right now is $1.5546/hr in us-east-1c. That's $1134.86/mo, excluding data transfer costs. If you tran
105.
AWS doesn't make sense for scientific computing(noahlebovic.com)
295 points by lebovic 4y ago|270 comments
106.
by lebovic 4y ago
I worked as a software engineer in bio and am building a company adjacent to this. There's a subset of popular software – especially in computational science and machine learning – that doesn't package well with pip or conda. For
107.
Show HN: Lug – run Python locally or in the cloud, paired with a container(lug.dev)
5 points by lebovic 4y ago|1 comments
108.
by lebovic 5y ago
Thanks! Right now we only have a couple tools live, but you can run kraken2 by following the quick start and signing up for an API key. The API key comes with 10GB of free data analysis. Cost is not yet finalized, but will be on the order o
109.
by lebovic 5y ago
While implementing and scaling data analysis pipelines at a biotech startup, I spent most of my time getting new tools running efficiently and scaling them. Implementing something like Kraken2 for genomic analysis ( https://github
110.
Show HN: An API for running computationally intensive tools(trytoolchest.com)
6 points by lebovic 5y ago|3 comments
111.
by lebovic 7y ago
CoreBiome | Full-stack Software Engineers | Minneapolis/St. Paul, MN | Full-Time | ONSITE or REMOTE | https://corebiome.com Our company specializes in fast, reliable microbiome analysis using cutting-edge genomics and infor
112.
by lebovic 8y ago
CoreBiome | Software Engineers | Minneapolis/St. Paul, MN | Full-Time | ONSITE | https://corebiome.com Our company specializes in fast, reliable microbiome analysis using cutting-edge genomics and informatics. Our unit ensu