4 ms·

My Lights Run on Bash

67 points by todsacerdoti 1y ago

Rediscover 1y ago
It's time for me to re-read the man page for bash. I was not aware of BASH_REMATCH, wow. It's in the first snippet on the linked page, and would save the hassle of using multiple var expansions of the %% and ## et al sort.
- tecleandor 1y ago
  Oh yeah! I was unaware too! Nowadays I quickly jump to python instead of using Bash even for the simplest of scripts , but this could help creating tiny and easy to understand scripts for some integrations...
  - enriquto 1y ago
    > I quickly jump to python instead of using Bash even for the simplest of scripts You don't seem to respect the old, venerable, well-tested adage: "once your shell script becomes too complex, switch to a real programming language like python". Or, the zen version (formally equivalent, but with quite a different tone): "once your program becomes sufficiently simple, turn it into a beautiful shell script".
    - skydhash 1y ago
      The true power of shell script is to coordinate programs. Once you find yourself altering data with the shell constructs, that's the sign to use $LISP instead.
      - unit149 1y ago
        [dead]
      - endofreach 1y ago
        > The true power of shell script is to coordinate programs. Once you find yourself altering data with the shell constructs, that's the sign to use $LISP instead. one might awk how much logic one can bash into a script before leaving the beloved shell
        skydhash 1y ago
        if it’s structured text, especially line based format. You can get in trouble when you want maps,2+D arrays, and variable length lists
- alganet 1y ago
  Yes, but also: https://wiki.ubuntu.com/DashAsBinSh#Why_was_this_change_made.3F https://wiki.ubuntu.com/DashAsBinSh#Why_was_this_change_made... > [bash] is rather large and slow to start up and operate by comparison with dash For more complex regular expressions, you can use `sed`. -- It's all a matter of context. Sometimes simple ## and %% param substitutions are the best tool for the job. I think bash is a fantastic interactive shell and a lousy script runner.
  - Calzifer 1y ago
    Bash is slower than other POSIX compatible shells but once you start running external commands for any substring or replace operation you loose much of this performance edge since forking is comparable slow. One reason why I personally prefer to use Bashisms like ${x//str/replace} or [[ $value =~ $pattern ]] instead of doing the common x=$(echo $x | sed s/str/replace/) which has to launch two processes just for the sake of avoiding Bashism. (or grep -oP ... which is nice but a BASH_REMATCH is often simpler)
    - Ferret7446 1y ago
      The reason Bash has so many features is that doing these things natively in the shell is faster and more convenient. After all, these features weren't just added randomly.
      - alganet 1y ago
        These features were added slowly, randomly, as time passed. The weird syntaxes for all of these are a clear sign of this. Practically all shell interpreters suffer from decades of feature creep since the original bourne shell. They're full of weird arcana, hard to maintain and debug. Many people tried to replace bash and died on the hill because of these weird features, or ended up creating a replacement that is even slower, or ended up rediscovering what perl is.
    - alganet 1y ago
      If the script does a lot of unstreamable replacements, you're right. But there are still ways out of bash. I prefer no fork, no bashism, reusable functions: set -euf replace () { local t= REPLY=$1 t="${REPLY#*"$2"}" test "$t" != "$REPLY" || return REPLY="${REPLY%"$2$t"}$3$t" } replace_all () { REPLY=$1 shift while replace "$REPLY" "$@"; do :; done } input="foo bar foo baz" replace_all "$input" "foo" "HELLO" echo $REPLY Not exactly easy to write, but now that they're functions, it doesn't matter since I can reuse them. Regarding performance, it is slower than bash, but not significantly. Times for 1000 calls: 9.908s -- sed (one fork per replacement) 0.015s -- bash x//str/replace 0.088s -- sh replace_all Times for 50.000 calls: 0.351s -- bash x//str/replace 0.631s -- sh replace_all Also, you can get further performance by inlining replace inside replace_all instead of making one call another. Note that I could have done several replacements inside a single sed pipe, but I decided to count the performance for doing it like you suggested x=$(echo $x | sed s/str/replace/). The same goes for my functions, one invokation per replacement (in fact, they are tuned for that scenario). sed can absoltely beat the shell in scenarios where you can make one fork do lots and lots of replacements. It depends on the scenario, and how proficient you are in writing sed (which can do branching, keep state, all sorts of things portably). -- From an architectural point of view, it makes sense to have a simpler `sh` and keep a sort of standard library of functions, instead of feature creeping the interpreter with weird arcana. It makes shells like dash easier to maintain, easier to debug, easier to port and safer.
- couscouspie 1y ago
  How do you actually read man pages? Do you skim them, to actually read and focus on interesting parts? Do you try to memorize features?
sunshine-o 1y ago
MQTT is a fantastic protocol. I basically do the same as the author but use nutshell and its powerful pattern matching [0] as the router -[0] https://www.nushell.sh/cookbook/pattern_matching.html#pattern-matching-on-types https://www.nushell.sh/cookbook/pattern_matching.html#patter...
sunshine-o 1y ago
For those using termux, termux widgets are exposed to Android device control so you don't need the MqttDroid app
- Arch-TK 1y ago
  Interesting... I didn't know about this, although I was pretty satisfied with the simplicity of MqttDroid (after I fixed a bug: https://github.com/LightJockey/MqttDroid/pull/3 https://github.com/LightJockey/MqttDroid/pull/3). Will investigate to compare.
Spivak 1y ago
The hate for the HomeAssistant OS is misplaced. It's just an appliance that manages its own software packages. Like for example the author could have set up Zigbee2MQTT entirely through the web GUI.
- jrm4 1y ago
  It's really not though; I went with it for a while then it did this weird diverging thing with updates and full versions that I still don't fully understand because I just got fed up with it.
  - nomel 1y ago
    It really is the design and intent, though. What year was this? Things are much more stable than in the early days.
- skgough 1y ago
  HomeAssistant's dependency requirements are so complex as to make a deployment of it essentially read-only. Trying to mod it with HACS is so hard that I gave up even though I write python for a living. I can't recommend it to anyone that doesn't know how to use linux at an expert level. This detracts from it's mission IMO; I would like to tell my family to use it instead of Google Home or Amazon whatever but it is so fragile that I can't do that in good conscience.
  - Spivak 1y ago
    My install has been essentially maintenance free for years. I don't imagine many casual users that just want an app/gui for their smart outlets will be reaching for HACS. HA even warns you when you install HACS that you're voiding all the warranties.
  - justusthane 1y ago
    HACS is very easy _if_ you’re using the HA OS installation method, in which Home Assistant manages its own containers (requires bare metal or a dedicated VM). I’d have no hesitation recommending it to someone who is just tech savvy enough to operate Home Assistant itself (e.g. setting up automations). I’ll also echo the sibling commenter re: running it for years with no maintenance besides occasionally installing the updates.
ramon156 1y ago
I respect both the DIY's and the HA fans. That aside, I'm currently contemplating whether running TrueNAS Scale for web apps is really necessary. I like the fact that I only need to click a few buttons or fill in a few fields, but on the otherhand my setup can be kept inside a docker-compose.yml We'll never know, since I like the safety of running my apps through something like TrueNAS Scale. It feels professional
lofaszvanitt 1y ago
people and their mazochistic ways
subjectsigma 1y ago
> Bash as critical infrastructure? Am I alright? Do I need to see a psychiatrist? Who’s gonna tell him
- Arch-TK 1y ago
  You don't need to tell me, I've read enough "bash" written by people who "know bash" in the wild to know that my house lights running on bash is (worryingly) probably some of the most sensible and least fragile use of bash on the planet.

67 points by todsacerdoti 1y ago

It's time for me to re-read the man page for bash. I was not aware of BASH_REMATCH, wow. It's in the first snippet on the linked page, and would save the hassle of using multiple var expansions of the %% and ## et al sort.

tecleandor 1y ago
Oh yeah! I was unaware too! Nowadays I quickly jump to python instead of using Bash even for the simplest of scripts , but this could help creating tiny and easy to understand scripts for some integrations...
- enriquto 1y ago
  > I quickly jump to python instead of using Bash even for the simplest of scripts You don't seem to respect the old, venerable, well-tested adage: "once your shell script becomes too complex, switch to a real programming language like python". Or, the zen version (formally equivalent, but with quite a different tone): "once your program becomes sufficiently simple, turn it into a beautiful shell script".
  - skydhash 1y ago
    The true power of shell script is to coordinate programs. Once you find yourself altering data with the shell constructs, that's the sign to use $LISP instead.
    - unit149 1y ago
      [dead]
    - endofreach 1y ago
      > The true power of shell script is to coordinate programs. Once you find yourself altering data with the shell constructs, that's the sign to use $LISP instead. one might awk how much logic one can bash into a script before leaving the beloved shell
      - skydhash 1y ago
        if it’s structured text, especially line based format. You can get in trouble when you want maps,2+D arrays, and variable length lists
alganet 1y ago
Yes, but also: https://wiki.ubuntu.com/DashAsBinSh#Why_was_this_change_made.3F https://wiki.ubuntu.com/DashAsBinSh#Why_was_this_change_made... > [bash] is rather large and slow to start up and operate by comparison with dash For more complex regular expressions, you can use `sed`. -- It's all a matter of context. Sometimes simple ## and %% param substitutions are the best tool for the job. I think bash is a fantastic interactive shell and a lousy script runner.
- Calzifer 1y ago
  Bash is slower than other POSIX compatible shells but once you start running external commands for any substring or replace operation you loose much of this performance edge since forking is comparable slow. One reason why I personally prefer to use Bashisms like ${x//str/replace} or [[ $value =~ $pattern ]] instead of doing the common x=$(echo $x | sed s/str/replace/) which has to launch two processes just for the sake of avoiding Bashism. (or grep -oP ... which is nice but a BASH_REMATCH is often simpler)
  - Ferret7446 1y ago
    The reason Bash has so many features is that doing these things natively in the shell is faster and more convenient. After all, these features weren't just added randomly.
    - alganet 1y ago
      These features were added slowly, randomly, as time passed. The weird syntaxes for all of these are a clear sign of this. Practically all shell interpreters suffer from decades of feature creep since the original bourne shell. They're full of weird arcana, hard to maintain and debug. Many people tried to replace bash and died on the hill because of these weird features, or ended up creating a replacement that is even slower, or ended up rediscovering what perl is.
  - alganet 1y ago
    If the script does a lot of unstreamable replacements, you're right. But there are still ways out of bash. I prefer no fork, no bashism, reusable functions: set -euf replace () { local t= REPLY=$1 t="${REPLY#*"$2"}" test "$t" != "$REPLY" || return REPLY="${REPLY%"$2$t"}$3$t" } replace_all () { REPLY=$1 shift while replace "$REPLY" "$@"; do :; done } input="foo bar foo baz" replace_all "$input" "foo" "HELLO" echo $REPLY Not exactly easy to write, but now that they're functions, it doesn't matter since I can reuse them. Regarding performance, it is slower than bash, but not significantly. Times for 1000 calls: 9.908s -- sed (one fork per replacement) 0.015s -- bash x//str/replace 0.088s -- sh replace_all Times for 50.000 calls: 0.351s -- bash x//str/replace 0.631s -- sh replace_all Also, you can get further performance by inlining replace inside replace_all instead of making one call another. Note that I could have done several replacements inside a single sed pipe, but I decided to count the performance for doing it like you suggested x=$(echo $x | sed s/str/replace/). The same goes for my functions, one invokation per replacement (in fact, they are tuned for that scenario). sed can absoltely beat the shell in scenarios where you can make one fork do lots and lots of replacements. It depends on the scenario, and how proficient you are in writing sed (which can do branching, keep state, all sorts of things portably). -- From an architectural point of view, it makes sense to have a simpler `sh` and keep a sort of standard library of functions, instead of feature creeping the interpreter with weird arcana. It makes shells like dash easier to maintain, easier to debug, easier to port and safer.
couscouspie 1y ago
How do you actually read man pages? Do you skim them, to actually read and focus on interesting parts? Do you try to memorize features?

sunshine-o 1y ago

MQTT is a fantastic protocol. I basically do the same as the author but use nutshell and its powerful pattern matching [0] as the router -[0] https://www.nushell.sh/cookbook/pattern_matching.html#pattern-matching-on-types https://www.nushell.sh/cookbook/pattern_matching.html#patter...

sunshine-o 1y ago

For those using termux, termux widgets are exposed to Android device control so you don't need the MqttDroid app

Arch-TK 1y ago
Interesting... I didn't know about this, although I was pretty satisfied with the simplicity of MqttDroid (after I fixed a bug: https://github.com/LightJockey/MqttDroid/pull/3 https://github.com/LightJockey/MqttDroid/pull/3). Will investigate to compare.

Spivak 1y ago

The hate for the HomeAssistant OS is misplaced. It's just an appliance that manages its own software packages. Like for example the author could have set up Zigbee2MQTT entirely through the web GUI.

jrm4 1y ago
It's really not though; I went with it for a while then it did this weird diverging thing with updates and full versions that I still don't fully understand because I just got fed up with it.
- nomel 1y ago
  It really is the design and intent, though. What year was this? Things are much more stable than in the early days.
skgough 1y ago
HomeAssistant's dependency requirements are so complex as to make a deployment of it essentially read-only. Trying to mod it with HACS is so hard that I gave up even though I write python for a living. I can't recommend it to anyone that doesn't know how to use linux at an expert level. This detracts from it's mission IMO; I would like to tell my family to use it instead of Google Home or Amazon whatever but it is so fragile that I can't do that in good conscience.
- Spivak 1y ago
  My install has been essentially maintenance free for years. I don't imagine many casual users that just want an app/gui for their smart outlets will be reaching for HACS. HA even warns you when you install HACS that you're voiding all the warranties.
- justusthane 1y ago
  HACS is very easy _if_ you’re using the HA OS installation method, in which Home Assistant manages its own containers (requires bare metal or a dedicated VM). I’d have no hesitation recommending it to someone who is just tech savvy enough to operate Home Assistant itself (e.g. setting up automations). I’ll also echo the sibling commenter re: running it for years with no maintenance besides occasionally installing the updates.

ramon156 1y ago

I respect both the DIY's and the HA fans. That aside, I'm currently contemplating whether running TrueNAS Scale for web apps is really necessary. I like the fact that I only need to click a few buttons or fill in a few fields, but on the otherhand my setup can be kept inside a docker-compose.yml We'll never know, since I like the safety of running my apps through something like TrueNAS Scale. It feels professional

lofaszvanitt 1y ago

people and their mazochistic ways

subjectsigma 1y ago

> Bash as critical infrastructure? Am I alright? Do I need to see a psychiatrist? Who’s gonna tell him

Arch-TK 1y ago
You don't need to tell me, I've read enough "bash" written by people who "know bash" in the wild to know that my house lights running on bash is (worryingly) probably some of the most sensible and least fragile use of bash on the planet.