4 ms·
> first scale vertically (buy better machine) With tools like message queues and Docker making it so easy to scale horizontally you don't even have to go vert
by knz 9y ago
> first scale vertically (buy better machine)
With tools like message queues and Docker making it so easy to scale horizontally you don't even have to go vertically.
We just won an industry award at work for a multi billion data point spatial analysis project that was all done with Python scripts + Docker on EC2 and PostgreSQL/PostGIS on RDS. A consultant was working in parallel with Hadoop etc and we kept up just fine. Use what works not what is "best".
Edit: A dumbed down version of the Python/Docker piece for anyone interested (https://medium.com/@mbaker/horizontally-scaling-gis-python-analysis-with-docker-65eedf3d75ef https://medium.com/@mbaker/horizontally-scaling-gis-python-a...). It's really easy to scale horizontally with Docker...
- sah2ed 9y agoWhat's your firm's name?
- knz 9y agoIt was for my day job and I'd prefer not to have that publicly linked in a searchable format to my HN profile. My profile has a link to my personal website though and it's the current employer listed on the associated LinkedIn profile.
- nimchimpsky 9y agoWhy is it searchable if you name them here, but not via linkedin ? When your hn profile explicity links to yr website.
- knz 9y agoI assume searching for [employer] could direct someone here vs searching for knz/me specifically would take you to my HN profile page. I'm not ashamed of anything I've said on HN but would rather not have people just searching for my employer ending up here (especially since I work in an office that routinely deals with sensitive political and community issues). It's a minor amount of (perceived) anonymity vs stating my name/job title/employer here!
- VintageCool 9y agoI love your website.
- knz 9y agoHa. Thanks! It's a bit basic but has proven sufficient.
- hvidgaard 9y ago> With tools like message queues and Docker making it so easy to scale horizontally you don't even have to go vertically. That depends entirely on the workload. It's not always a good idea to move from one sql instance, to a cluster of them. Just buy the better machine that gives you time to make a real scalable solution.