5 ms·
Which automation tools/scripts do you use to save time and feel like a boss?
- cristobal23 10y agoAnsible is specifically geared for that boss like feel.
- oneplane 10y agoSaltStack, Preseed and Kickstart, Jenkins and GitLab CI, FreeIPA for proper LDAP/Kerberos/Pubkeyauth.
- vgy7ujm 10y agoPerl
- outworlder 10y agoTerraform! Watching infrastructure being created and configured in seconds on AWS (or even openstack) is amazing. Preferably paired with something like chef or ansible.
- pragnesh 10y agopacker, fabric
- kodfodrasz 10y agoWhichever I have tried I always felt like a slave. The ones with enough experience to hate thoroughly so far are: - bash - powershell - windows cmd/batch - ansible - terraform - azure clis, azure powershell api - aws python api, cli - Jenkins - MS Team Foundation Services - Docker (one of the nastiest ones) - Rancher I always managed to solve the tasks with the tools at hand (one of these), but all have so many weak points one must always work around, that I cannot say any single one made me feel like a boss when I had to use them for any non-trivial task. If you want to feel like a boss, be a boss!
- oneplane 10y agoMany tools are indeed not the 'feel like a boss' type, but the 'thoroughly hate it' kind. Having tried plenty of tools for cfg mgmt for example, GPO, Ansible and CFengine basically make you want to jump out of a window, as well as diverse puppet versions. Same goes for SCM/VCS systems that can't even get on Subversion-level, which by itself nowadays is a reason to not take a job.
- weitzj 10y agoJenkins, Hammerspoon, Terraform,vim macros, FZF,bash-scripts (e.g. push this branch to origin and open PR from this repo), fish-shell completions
- kemiller2002 10y agoI use a combination of F# scripts and PowerShell. Anytime I need to do data manipulation, code generation, or anything hard core development related I use F#. I could use PowerShell for this, but I'm more comfortable and feel I have more control with fsx scripts. For all the server related tasks or automated build tasks I use PowerShell. We're a heavy MS shop, and I get that it may not work for everyone, but we leverage so many MS technologies that it just makes sense to go with the flow.
- sirolf 10y agobash, tar, gzip, rsync, ssh, and perl.
- 0xdeadbeefbabe 10y agoInternet Explorer
- falsedan 10y agoThe tab key.
- thorat 10y agoVim macros.
- tapoxi 10y agoMy favorite tool this year has been SaltStack. It manages the entire lifecycle of our VMs now (provisioning and state management) and it was very easy to create a Slack bot with it that can update our production/dev environments. Salt is a little confusing at first, since it's essentially just a framework for systems management with Python + ZeroMQ, but you can do a lot with it.
- gouggoug 10y agoI've tried reading the saltstack doc many times, I still am very confused. To the point that I've stuck to ansible, despite truly thinking saltstacks might be better. Is there any not confusing doc about saltstack available?
- tapoxi 10y agoThey recently rewrote the tutorial, which is available here: https://docs.saltstack.com/en/getstarted/ https://docs.saltstack.com/en/getstarted/ The easiest way to learn Salt is by starting with execution modules (https://docs.saltstack.com/en/latest/ref/modules/all/index.html https://docs.saltstack.com/en/latest/ref/modules/all/index.h...), which are just Python modules that abstract the commands underneath and you can blast to machines, such as salt 'web~' pkg.install httpd to install Apache on all servers named web. You can send shell commands directly using cmd.run - salt 'web~' cmd.run 'yum -y install httpd' (Note: I replaced asterisks with tildes in the above example due to HN formatting.) On top of execution modules are state modules (https://docs.saltstack.com/en/latest/ref/states/all/ https://docs.saltstack.com/en/latest/ref/states/all/). You define a state in YAML and tell a host to execute the state with the state.apply execution module. States consist of an id (a unique string identifier), the state module to use, and arguments, like so: base.packages.stable.install: pkg.installed: - pkgs: - git - zsh - mosh The other major components are runners (https://docs.saltstack.com/en/latest/ref/runners/ https://docs.saltstack.com/en/latest/ref/runners/), which are scripts written against the salt API that perform actions on the salt bus, and engines (https://docs.saltstack.com/en/latest/topics/engines/index.html https://docs.saltstack.com/en/latest/topics/engines/index.ht...), which are child processes spawned by the master that listen for and react to events - like the Slack bot I use. One of the included engines is called reactor, which makes it easy to script events in YAML. There are more moving parts I'm not covering here, but I hope this helps you get started.
- DanHulton 10y agoAnsible is basically my favourite automation tool, though I use it less to "save time" and more for peace of mind. I can define how I want my servers set up and ensure that every time I spin up a new one or make a deploy, all the proper steps are followed automatically. Though technically, this can save time in tracking down errors or weird state-based bugs, I guess? So it even still qualifies under that.
- clarkenheim 10y agoA clipboard manager is an absolute have to have. Having the last 40 or so clibboard items available to me instinctively has increased my productivity and the speed at which i can do anything on a computer. I use the one that is part of the Alfred power pack, but there are plenty of others out there. https://www.alfredapp.com/help/features/clipboard/ https://www.alfredapp.com/help/features/clipboard/
- sillysaurus3 10y agoThis seems at odds with a password manager, though.
- gargravarr 10y agoIt's not about remembering passwords, it's for code snippets or URLs. I also find these invaluable.
- sillysaurus3 10y agoWhat I mean is, I'm constantly copying passwords to my clipboard, both to generate them and to input them. This is an app which remembers clipboard history. That means all my passwords will be stored in this history, which makes it incompatible for my use case. The documentation is less than clear about whether it can ignore apps: By default, Alfred ignores popular password applications like the macOS Keychain Access and 1Password, so that you don't inadvertently copy a password to your clipboard. I don't want to prevent apps from copying to my clipboard. I want to prevent Alfred from storing the history when I copy from a specific app (my password manager). I may as well just try it and find out, though.
- gargravarr 10y agoMy bad, sorry.
- sillysaurus3 10y ago
- dangirsh 10y agoEmacs - even a novice elisp programmer has more power to automate their Emacs environment than I've seen in any other tool. If you've ever wondered how a small community managed to maintain near feature-parity with popular IDEs for 3 decades, this is it.
- girzel 10y agoMe too. I'm now much more proficient in emacs-lisp than in Python, my second-best language. I don't write bash scripts often enough to remember all the gotchas. It's a little embarrassing how much I do through emacs: manipulating the file system, url fetching, RPC... stuff you really shouldn't be doing with your text editor. But hey, the tool you know...
- davelnewton 10y agoI'd disagree on "feature parity" for some usecases. For example, I used Emacs as my Java IDE for some time, but it lost that race in a hurry as IDEs caught up to JDEE. And it wasn't even close within a year or two after that. I'm not even sure if Emacs will hold up to tools like IntelliJ for Ruby/Rails/JavaScript development at this point, although in that space it's a lot closer. Overall, however, I agree: Emacs is freakin' awesome. Heck, I booted into it as my shell for a few years. I keep meaning to get back into it but I rarely have the time, and I need to learn more Vim as well. Time is the enemy.
- mercwear 10y agoAn answer for the less technical crowd: Zapier. It allows me to tie all of my favorite tools together. Those that do not integrate natively can be accessed via API if you want to put the time into it.
- Xavdidtheshadow 10y agoHeck, this is great for technical people too. There's the public integrations, but I use the dev platform for private things all the time. Takes some extra coding, but once the interface is built everything else comes free. That plus code steps and I'm set.
- gargravarr 10y agoJenkins is fantastic because you can plug it into just about everything, and trigger your job that does $whatever either on a timer, manually or with an HTTP GET request. When I started at this company, Jenkins was nothing more than a web server used to launch an all-encompassing build script on SVN commit. Since then, I've redesigned all builds using plugins such that Jenkins now manages the whole process (previous admins had reinvented so. f*cking. much. stuff Jenkins does natively) and we're using Jenkins to automate just about everything we can plug it into. This and Powershell, which although its syntax is mind-bending and in some cases just outright appalling, is a decent attempt at a scripting language with exceptional power over Windows.
- autotune 10y agoYou also get the benefit of it the jobs being built on a shared environment. If developer A wants to build a job, $THING-A and developer B wants to build a their job, $THING-B, there's no having to look through code for environment variables or other differing, machine-specific issues, that might pop up when building with something like, for example, Terraform.
- gargravarr 10y agoThe build server was still the shared environment, but all it did was call a batch script that did everything else, up to and including emailing the build breaker (see above comment). There was also copy-pasted jobs for each branch, rather than a single master build-branch job that took parameters.
- strictfp 10y agoNoo, builds shouldn't rely on Jenkins. I root for the previous admins.
- kirubakaran 10y agoCan you please go into more detail?
- natecavanaugh 10y agoFor me, Keyboard Maestro[1], which is probably the one app I couldn't live without. With it, I can do things like highlight any git sha (or any sha range) in the terminal, press a keyboard command and it will launch my diff tool with the diffs for just that commit. I also use it to do inline transpiling of different code. I have keyboard commands for transpiling my highlighted Sass or ES6 code and replacing it with the result. It's so powerful, there's very little it can't do. [1]: https://www.keyboardmaestro.com https://www.keyboardmaestro.com
- neurocroc 10y agoI too agree on usefulness of KM. Can you share that KM macro please?
- natecavanaugh 10y agoSure thing (I'm assuming you mean the git diff one): https://www.dropbox.com/s/3vrp9yk6d7d5f3j/Open%20Diff%20in%20Kaleidoscope.kmmacros?dl=0 https://www.dropbox.com/s/3vrp9yk6d7d5f3j/Open%20Diff%20in%2... I haven't gotten around to making it more generic (right now, it's really only supporting iTerm, but it shouldn't be too hard to do the equivalent for Terminal as well). I'm using Kaleidoscope for my git diffs, but you can edit the first action to being whatever command you want. Hopefully that works for you, but let me know if you have any questions :)
- gouggoug 10y agoAll of the automation tools out there always felt clunky to me. Ansible has been working fairly OK so far for my usage, but I can't imagine using it if I was managing hundreds of machines. I considered using saltstack, but despite spending a few hours reading their doc, I'm still very confused by all the lingo. I recently started reading and considered using NixOS, but the still relative newness (it's 14 years old!) makes me worry about missing packages and updates.
- djsumdog 10y agoI felt the same way about Saltstack. I've worked at shops that use Puppet (with and without Hiera) and CFEngine. In my person projects I've used a lot of Ansible. Out of all the CM systems I've tried Ansible feels the most sane. It still has a some things that annoy me, but overall I've found it the easiest to deal with. My current shop puts everything in Docker containers and runs them on DC/OS scheduled via Marathon. I don't touch the CM parts anymore, but I think our DC/OS team provisions the actual nodes via Puppet.
- hamilyon2 10y agoVim, bash, sometimes python scripts
- neduma 10y agoVim/Git/ITerm/Fish
- purple-dragon 10y agoI get a lot of lift out of ndjson-cli (though jq is a lot more popular) for command-line JSON manipulation. I've found it incredibly powerful for scripting and piping with web/RESTful services.
- mod 10y agoA mortising machine. Craigslist searches.
- valbaca 10y agoOn a mac, so these are a must: - Workspaces! These help with focus and isolate the "blast radius" of getting randomized - Spectacles: windows manager to assign windows to left/right side of screeen, across monitors, or left, middle or right 1/3 - CopyClip: I don't use this clipboard manager all the time, but when I do, it SAVES MY BUTT - Sublime: speaking of saving my butt...Sublime has never once lost a single file. I love Vim but Sublime has flawless reliability - Cmd+0: Global hotkey to "new browser window" If you do something 20+ times a day, make it super stupid fast (I know it conflicts with "reset zoom" but I can just manually adjust zoom back to 100%) - Shell scripts: If I'm typing more than 3+ commands over and over again, just script it. Scripting isn't scary and more developers need to be doing it. (I seem to be the only one on my team, which is why I say that)
- falcolas 10y agoAn automator script to gather AWS session credentials from a web-based provider and paste them in '~/.aws/credentials' for local testing and administration. It's saved me an insane amount of time lately. That said, my second biggest time saver has been saving language reference and library docs to my local drive: #! /bin/bash wget --recursive --level=5 --convert-links --page-requisites --wait=1 --random-wait --timestamping --no-parent $@ local_docs.sh http://docs.python.org/2.7/library/ Near-instant rendering, available anytime my computer is powered on, and they still link to the external docs when I have to follow some esoteric link.
- rdiddly 10y agoThis might be a bit on the noob side but I always feel like a boss when I get a complicated project set up to be built and deployed with one double-click or keystroke. Even though it's just knowing how to use MSBUILD/NAnt/Ant/make and robocopy/cp, it's still satisfying.
- ivan_ah 10y agoFor anyone using Mac OS X, I highly recommend setting up a keyboard shortcut for the text-to-speech tool. See [1] for instructions and screenshots. The computer voice is not too annoying, and it can read news articles and blog posts to you, rather than wasting your eyes. I often do the dishes or exercise while the computer reads hacker news to me. The text-to-speech tool is also very useful to proofread any text you might be writing—I catch a lot of typos this way. [1] https://docs.google.com/document/d/1mApa60zJA8rgEm6T6GF0yIem8qpMmnaBFYOgV32gdMc/edit https://docs.google.com/document/d/1mApa60zJA8rgEm6T6GF0yIem...
- rodjomatic 10y ago(Windows only) AutoHotkey!
- deleted 10y ago[deleted]
- viktorbenei 10y agoBitrise! Both the open source CLI (https://www.bitrise.io/cli https://www.bitrise.io/cli) and bitrise.io (hosted service). I'm obviously biased (CTO and Co-founder), but I love automation, that's why I'm part of the bitrise team in the first place ;) The CLI is similar to something like rake, but the config lives in a single file which can be moved anywhere, and you can get a list of available "tasks" (workflows in the bitrise terminology) by running `bitrise workflows` or `bitrise run` without any parameter. There's also an open source editor (UI) available for it (https://discuss.bitrise.io/t/offline-workflow-editor-workflow-editor-v2/39 https://discuss.bitrise.io/t/offline-workflow-editor-workflo...), which is now part of the "base plugins" which gets installed by the Bitrise CLI. It's also really light weight, as the CLI is a single binary distribution (written in Go).