3 ms·
> it works reasonably well on the scale of thousands of hosts I could see this if you're working from one really powerful machine... no, that won't work, it's
by falcolas 11y ago
> it works reasonably well on the scale of thousands of hosts
I could see this if you're working from one really powerful machine... no, that won't work, it's constrained by SSH, not hardware specs.
I could see this if you're calling Ansible on another host... no, then you have to copy everything out to the sub hosts, who have to copy everything out to their sub hosts... A scalability nightmare.
You can use redis as a distributed store of truth and... wait, what? Now there's a blog post worth reading. Show us how to scale Ansible with real-world examples using redis and autoscaling groups. Please.
Got it. I can see this work reasonably well if you're willing to wait 10 hours for a deploy to complete. Personally, I'm not.
> If you want to have 1000 forks, that will cost about 30 GB of memory
Ansible is not, nor has it ever been, limited by available memory. It's limited by the number of concurrent SSH sessions it can handle while copying every single module to be executed to that host.
There's plenty of reasons and ways to use Ansible for deploying code. Some of the post has accurate and reasonable information, but the scaling portion is pure fantasy right now.
- dozzie 11y agoI had around a thousand of hosts and one small virtual machine, and my SSH call to each and every one (and running something trivial, like `uptime') took less than a minute in total. Though this was a custom script that used Erlang's built-in SSH client, and had some unpleasant trouble when hitting the limit on file descriptors (1024, bumped later to 4096 just because of that).
- falcolas 11y agoIt's much less about just the ssh overhead, as it is about copying Python scripts to the target hosts, then executing them, one at a time.
- drakenot 11y agoI thought Ansible had different execution strategies and you could make the hosts not wait for each other if you wanted. Wouldn't that speed things up a good deal?