9 ms·

OpenEnergyMonitor – open-source monitoring for energy

133 points by pabs3 4y ago

c_o_n_v_e_x 4y ago
Is it me or do the costs seem a little punchy? The heat pump monitoring system is 646 GBP. At local electrical prices, I'd have to save nearly 6 megawatts to see any kind of return.. and that's just on hardware cost, not including install.
- ilyt 4y ago
  Low volume means your NRE costs are good part of the price Also heat meter they use is almost 300 on its own so that's already near half the price
- ezconnect 4y ago
  My heat pump comes with an app for energy monitoring and remote control and stores 2 years of energy usage. Too bad it doesn't have an API to integrate with other stuff.
  - c_o_n_v_e_x 4y ago
    This is the way forward. I see so many IoT start-ups coming up with sensor packages to retrofit onto existing equipment, however it almost always never makes economic sense due to the installation cost. The sensors and monitoring hardware ideally should be included in the machine/appliance at the factory.
function_seven 4y ago
Funny seeing this link just after watching Matthias’ video on his Emporia install[0] Several comments on that video say it can be Tasmotized. It runs on an ESP32. Amazon’s got them for $165, and that’s with 16 circuits plus the main. [0] https://youtu.be/siJZYFCmU68 https://youtu.be/siJZYFCmU68
- ilyt 4y ago
  Yeah it's a steal for that price
- tda 4y ago
  I saw the same video, and had the same thoughts. I saw a comment mentioning flashing the Emporia with ESPHOME, of which I am a great fan. What I really like about that option is you can push all the logic to the "edge" device with ease (including hosting a webserver), or just merely expose the data and use e.g homeassistant to manage it. I'm sure you could probably also have it post the data directly to clickhouse if you want. All this to say esphome is really great and I love its flexibility.
- 0xQSL 4y ago
  I was planning to build something similar with esp32 until i found the emporia. It's a bit of a hassle to install (don't think anything can be done about that) and I didn't really like the official ui, but it works great with home assistant / esphome. [0] [0] https://gist.github.com/flaviut/93a1212c7b165c7674693a45ad52c512 https://gist.github.com/flaviut/93a1212c7b165c7674693a45ad52...
- flaviut 4y ago
  Not Tasmotized--ESPHome! Instructions are at https://gist.github.com/flaviut/93a1212c7b165c7674693a45ad52c512 https://gist.github.com/flaviut/93a1212c7b165c7674693a45ad52..., and I'm around in the discussion forums at https://github.com/emporia-vue-local/esphome/discussions https://github.com/emporia-vue-local/esphome/discussions to help out with getting this set up. And I agree--it's really a great deal, and it's the only one of these products that comes with UL listing and can run open-source firmware.
  - function_seven 4y ago
    I don’t know why but I was using “tasmotized” to mean ESPHome. I run both of them on various devices. Weird mix-up to make on my part :) Thanks for the links! I think I might pull the trigger on one of these
evolve2k 4y ago
GitHub repo: https://github.com/emoncms/emoncms https://github.com/emoncms/emoncms
- cricalix 4y ago
  That's only the web UI. The code and so on for the hardware is at https://github.com/openenergymonitor https://github.com/openenergymonitor
cricalix 4y ago
It's a nice project - I use it at home for a very simple setup to see what my house power consumption is; shows how I can go from 5-6 kWh per day to > 9 kWh just by using the oven. Worked out how to run the emoncms aspect in a LXC container, instead of in Docker, so it'd fit into my preferred way of doing things [0]. The forums can be a bit like posting into the void - a few views, no comments. I've got a bug issue and bug fix PR up, and it's been there for a few months with no traction. It's the web UI rather than core code, but it's not even had a response from the core committers/project owners. [0]: https://www.cricalix.net/2022/10/19/running-emoncms-in-a-linux-container/ https://www.cricalix.net/2022/10/19/running-emoncms-in-a-lin...
snickmy 4y ago
Just leaving a comment here, if you are an electrical engineer and you are interested in working on thing like this, I'd love to talk to you.
- IndrekR 4y ago
  Contact me. Have worked with designing/engineering/manufacturing similar measurement systems before and am quite interested in getting more done in the field. The e-mail address is in the profile.
- morphle 4y ago
  morphle { at } ziggo { dot com}. I'm making a very reliable and professional $2 power meter. We make our own microcontroller to replace the $0,03 Padauk. To prove our microcontroller we build better 18650 battery chargers dischargers and power meters. Also a remote monitoring system for the even more reliable analog power meters. https://www.youtube.com/watch?v=P_3DXcB9-xE https://www.youtube.com/watch?v=P_3DXcB9-xE We also make other cheap but reliable $0,30 moisture and sound sensors and $3 wearable carbon cloth infrared heaters.
  - ljf 4y ago
    Just reading your profile - wow, that all sounds amazingly interesting. Wish I had something to offer right now ;)
    - morphle 4y ago
      You do have something to offer: a little of your time. I would love to hear from you what you found amazingly interesting. Could you email me so I can ask?
mszcz 4y ago
Zamel, a polish company, makes something similar called Supla MEW-01 [0] to measure energy consumption. It's got WiFi connectivity, a tiny webserver and a REST API. It seems it's all open source [1]. Their app can use either their server or a self-hosted server. If I understand correctly, you can also consume the meter's data by contacting it directly via the API. I've ordered one on a rave recommendation from a friend, haven't yet had time to familiarize myself with it or test it. Planning to use it to accurately measure heat pump's energy consumption. [0] https://supla.zamel.com/en/product-montage-category/energy-meters/ https://supla.zamel.com/en/product-montage-category/energy-m... [1] https://github.com/SUPLA https://github.com/SUPLA edit: mistakes, GitHub link
meatjuice 4y ago
You can use home assistant instead though. It has built-in power monitoring feature.
destitude 4y ago
There is also IoTaWatt which is also open source and supports 14+ sensors.
- noxon 4y ago
  I’ve had an IoTaWatt running for years without any issues. I’ve used it to pinpoint the exact time two refrigerator compressors failed. It’s been handy for all kinds of other stuff.
kumarvvr 4y ago
How is RaspberryPi a long term, reliable solution? Its storage is prone to failure or errors.
- mavhc 4y ago
  USB connected SSD
- XzAeRosho 4y ago
  We installed hundreds of RPi for energy monitoring in a huge project, and after 3 years of operation, we only had like 3 or 4 SD corruption errors which only killed the GUI, but the rest of the system kept chugging as usual (I wonder if there's a common bug in the OS, since the corruption errors killed only the GUI). I kept hearing that argument about the RPi, but in our experience, it's just not the case. We shipped a second batch with additional improvements a year ago (external SSD, external battery for UPS, and external WiFi or 3G/4G dongle), and we have been error free.
  - aulin 4y ago
    All my RPis had some kind of corruption sooner or later. At some point we blamed the shitty sdcard, but it happens with the supposedly good ones too. With the shitty ones I had unrecoverable boot and fs corruptions. With the good ones it is more subtle, some library is corrupted, some python module fails import, you can fix it by reinstalling the failing component but it always leaves me with some anxiety to trust it for serious stuff.
    - nsteel 4y ago
      The other common thing to blame is your PSU. But regardless, things have moved on and for a reliable, serious system you can move the rootfs or ditch the SD card entirely and forget about this issue. Yes, I appreciate this is a more expensive solution. I guess not everyone got the memo else this thread wouldn't even exist. Maybe the foundation need to release a version without an SD card. That would force people to take note of the various other booting options.
Saris 4y ago
I find it odd that they're using a Pi for this, it's not really a good solution for permanent installs, and is overly complex (and slow) for just monitoring a few sensors. It could be done entirely on an ESP8266 or ESP32 for much less cost and complexity. Other design choices that I find strange: - Entire RaspberryPi available but only 2 CT inputs. - Requires 2 plugs, vs monitoring line voltage from the same input that powers the Pi. - LCD display on the front, when it's going to be installed somewhere I don't see it. - Boots from SD card, which will fail eventually, or get corrupted when power fails and comes back on rapidly multiple times as is typical during blackouts. - Custom 433mhz link, instead of using something standard like zigbee or wifi.
- antx 4y ago
  Right?! I was watching a video yesterday by Matthias Wandel and they were using the Emporia smart home monitor. This thing has 16 inputs and it seemed to be built upon an ESP32! For some reason I can't find the video anymore... Edit: ha! function_seven beat me to it... (7 hours ago), it's not on his "main" channel
zhala 4y ago
I've had great success using home assistant's built in energy monitor dashboard and a ESP32 based power monitor from CircuitSetup. Home assistant supports exporting metrics via Prometheus which I then graph using grafana for fancier dashboarding. https://www.home-assistant.io/ https://www.home-assistant.io/ https://circuitsetup.us/product/expandable-6-channel-esp32-energy-meter/ https://circuitsetup.us/product/expandable-6-channel-esp32-e...
nsteel 4y ago
I like that some things in their shop (e.g. https://shop.openenergymonitor.com/current-o-p-100a-max-clip-on-current-sensor-ct/ https://shop.openenergymonitor.com/current-o-p-100a-max-clip...) have a link back to a "learn" page (https://learn.openenergymonitor.org/electricity-monitoring/ct-sensors/introduction https://learn.openenergymonitor.org/electricity-monitoring/c...) explaining how it works. Cool!
pomatic 4y ago
For UK users, the "Bright" product (see app stores) - which is also part-branded "Glow", almost like they want to set themselves up to fail - from Hildebrand allows for real-time access to smart-meter data (as in minute to minute, not delayed by 24 hours or even 30 minutes) via MQTT. It's essentially a modified consumer HID for smartmeters (the now ubiquitous little screens issued by energy companies to show consumption on an LCD display). It's cheaper, as well as more accurate, than the other devices mentioned here, albeit at the expense of providing a breakdown by circuit.
- ralphhughes 4y ago
  I've avoided smart-meter data so far as it shows zero watts no matter how much I export (I don't have an export contract, it's a DIY PV install and no point with current pricing) hence why I'm looking at ones with a seperate sensor. It frustrates me no end that my IHD doesn't show export, only import!

133 points by pabs3 4y ago

Is it me or do the costs seem a little punchy? The heat pump monitoring system is 646 GBP. At local electrical prices, I'd have to save nearly 6 megawatts to see any kind of return.. and that's just on hardware cost, not including install.

ilyt 4y ago
Low volume means your NRE costs are good part of the price Also heat meter they use is almost 300 on its own so that's already near half the price
ezconnect 4y ago
My heat pump comes with an app for energy monitoring and remote control and stores 2 years of energy usage. Too bad it doesn't have an API to integrate with other stuff.
- c_o_n_v_e_x 4y ago
  This is the way forward. I see so many IoT start-ups coming up with sensor packages to retrofit onto existing equipment, however it almost always never makes economic sense due to the installation cost. The sensors and monitoring hardware ideally should be included in the machine/appliance at the factory.

function_seven 4y ago

Funny seeing this link just after watching Matthias’ video on his Emporia install[0] Several comments on that video say it can be Tasmotized. It runs on an ESP32. Amazon’s got them for $165, and that’s with 16 circuits plus the main. [0] https://youtu.be/siJZYFCmU68 https://youtu.be/siJZYFCmU68

ilyt 4y ago
Yeah it's a steal for that price
tda 4y ago
I saw the same video, and had the same thoughts. I saw a comment mentioning flashing the Emporia with ESPHOME, of which I am a great fan. What I really like about that option is you can push all the logic to the "edge" device with ease (including hosting a webserver), or just merely expose the data and use e.g homeassistant to manage it. I'm sure you could probably also have it post the data directly to clickhouse if you want. All this to say esphome is really great and I love its flexibility.
0xQSL 4y ago
I was planning to build something similar with esp32 until i found the emporia. It's a bit of a hassle to install (don't think anything can be done about that) and I didn't really like the official ui, but it works great with home assistant / esphome. [0] [0] https://gist.github.com/flaviut/93a1212c7b165c7674693a45ad52c512 https://gist.github.com/flaviut/93a1212c7b165c7674693a45ad52...
flaviut 4y ago
Not Tasmotized--ESPHome! Instructions are at https://gist.github.com/flaviut/93a1212c7b165c7674693a45ad52c512 https://gist.github.com/flaviut/93a1212c7b165c7674693a45ad52..., and I'm around in the discussion forums at https://github.com/emporia-vue-local/esphome/discussions https://github.com/emporia-vue-local/esphome/discussions to help out with getting this set up. And I agree--it's really a great deal, and it's the only one of these products that comes with UL listing and can run open-source firmware.
- function_seven 4y ago
  I don’t know why but I was using “tasmotized” to mean ESPHome. I run both of them on various devices. Weird mix-up to make on my part :) Thanks for the links! I think I might pull the trigger on one of these

evolve2k 4y ago

GitHub repo: https://github.com/emoncms/emoncms https://github.com/emoncms/emoncms

cricalix 4y ago
That's only the web UI. The code and so on for the hardware is at https://github.com/openenergymonitor https://github.com/openenergymonitor

cricalix 4y ago

It's a nice project - I use it at home for a very simple setup to see what my house power consumption is; shows how I can go from 5-6 kWh per day to > 9 kWh just by using the oven. Worked out how to run the emoncms aspect in a LXC container, instead of in Docker, so it'd fit into my preferred way of doing things [0]. The forums can be a bit like posting into the void - a few views, no comments. I've got a bug issue and bug fix PR up, and it's been there for a few months with no traction. It's the web UI rather than core code, but it's not even had a response from the core committers/project owners. [0]: https://www.cricalix.net/2022/10/19/running-emoncms-in-a-linux-container/ https://www.cricalix.net/2022/10/19/running-emoncms-in-a-lin...

snickmy 4y ago

Just leaving a comment here, if you are an electrical engineer and you are interested in working on thing like this, I'd love to talk to you.

IndrekR 4y ago
Contact me. Have worked with designing/engineering/manufacturing similar measurement systems before and am quite interested in getting more done in the field. The e-mail address is in the profile.
morphle 4y ago
morphle { at } ziggo { dot com}. I'm making a very reliable and professional $2 power meter. We make our own microcontroller to replace the $0,03 Padauk. To prove our microcontroller we build better 18650 battery chargers dischargers and power meters. Also a remote monitoring system for the even more reliable analog power meters. https://www.youtube.com/watch?v=P_3DXcB9-xE https://www.youtube.com/watch?v=P_3DXcB9-xE We also make other cheap but reliable $0,30 moisture and sound sensors and $3 wearable carbon cloth infrared heaters.
- ljf 4y ago
  Just reading your profile - wow, that all sounds amazingly interesting. Wish I had something to offer right now ;)
  - morphle 4y ago
    You do have something to offer: a little of your time. I would love to hear from you what you found amazingly interesting. Could you email me so I can ask?

mszcz 4y ago

Zamel, a polish company, makes something similar called Supla MEW-01 [0] to measure energy consumption. It's got WiFi connectivity, a tiny webserver and a REST API. It seems it's all open source [1]. Their app can use either their server or a self-hosted server. If I understand correctly, you can also consume the meter's data by contacting it directly via the API. I've ordered one on a rave recommendation from a friend, haven't yet had time to familiarize myself with it or test it. Planning to use it to accurately measure heat pump's energy consumption. [0] https://supla.zamel.com/en/product-montage-category/energy-meters/ https://supla.zamel.com/en/product-montage-category/energy-m... [1] https://github.com/SUPLA https://github.com/SUPLA edit: mistakes, GitHub link

meatjuice 4y ago

You can use home assistant instead though. It has built-in power monitoring feature.

destitude 4y ago

There is also IoTaWatt which is also open source and supports 14+ sensors.

noxon 4y ago
I’ve had an IoTaWatt running for years without any issues. I’ve used it to pinpoint the exact time two refrigerator compressors failed. It’s been handy for all kinds of other stuff.

kumarvvr 4y ago

How is RaspberryPi a long term, reliable solution? Its storage is prone to failure or errors.

mavhc 4y ago
USB connected SSD
XzAeRosho 4y ago
We installed hundreds of RPi for energy monitoring in a huge project, and after 3 years of operation, we only had like 3 or 4 SD corruption errors which only killed the GUI, but the rest of the system kept chugging as usual (I wonder if there's a common bug in the OS, since the corruption errors killed only the GUI). I kept hearing that argument about the RPi, but in our experience, it's just not the case. We shipped a second batch with additional improvements a year ago (external SSD, external battery for UPS, and external WiFi or 3G/4G dongle), and we have been error free.
- aulin 4y ago
  All my RPis had some kind of corruption sooner or later. At some point we blamed the shitty sdcard, but it happens with the supposedly good ones too. With the shitty ones I had unrecoverable boot and fs corruptions. With the good ones it is more subtle, some library is corrupted, some python module fails import, you can fix it by reinstalling the failing component but it always leaves me with some anxiety to trust it for serious stuff.
  - nsteel 4y ago
    The other common thing to blame is your PSU. But regardless, things have moved on and for a reliable, serious system you can move the rootfs or ditch the SD card entirely and forget about this issue. Yes, I appreciate this is a more expensive solution. I guess not everyone got the memo else this thread wouldn't even exist. Maybe the foundation need to release a version without an SD card. That would force people to take note of the various other booting options.

Saris 4y ago

I find it odd that they're using a Pi for this, it's not really a good solution for permanent installs, and is overly complex (and slow) for just monitoring a few sensors. It could be done entirely on an ESP8266 or ESP32 for much less cost and complexity. Other design choices that I find strange: - Entire RaspberryPi available but only 2 CT inputs. - Requires 2 plugs, vs monitoring line voltage from the same input that powers the Pi. - LCD display on the front, when it's going to be installed somewhere I don't see it. - Boots from SD card, which will fail eventually, or get corrupted when power fails and comes back on rapidly multiple times as is typical during blackouts. - Custom 433mhz link, instead of using something standard like zigbee or wifi.

antx 4y ago
Right?! I was watching a video yesterday by Matthias Wandel and they were using the Emporia smart home monitor. This thing has 16 inputs and it seemed to be built upon an ESP32! For some reason I can't find the video anymore... Edit: ha! function_seven beat me to it... (7 hours ago), it's not on his "main" channel

zhala 4y ago

I've had great success using home assistant's built in energy monitor dashboard and a ESP32 based power monitor from CircuitSetup. Home assistant supports exporting metrics via Prometheus which I then graph using grafana for fancier dashboarding. https://www.home-assistant.io/ https://www.home-assistant.io/ https://circuitsetup.us/product/expandable-6-channel-esp32-energy-meter/ https://circuitsetup.us/product/expandable-6-channel-esp32-e...

nsteel 4y ago

I like that some things in their shop (e.g. https://shop.openenergymonitor.com/current-o-p-100a-max-clip-on-current-sensor-ct/ https://shop.openenergymonitor.com/current-o-p-100a-max-clip...) have a link back to a "learn" page (https://learn.openenergymonitor.org/electricity-monitoring/ct-sensors/introduction https://learn.openenergymonitor.org/electricity-monitoring/c...) explaining how it works. Cool!

pomatic 4y ago

For UK users, the "Bright" product (see app stores) - which is also part-branded "Glow", almost like they want to set themselves up to fail - from Hildebrand allows for real-time access to smart-meter data (as in minute to minute, not delayed by 24 hours or even 30 minutes) via MQTT. It's essentially a modified consumer HID for smartmeters (the now ubiquitous little screens issued by energy companies to show consumption on an LCD display). It's cheaper, as well as more accurate, than the other devices mentioned here, albeit at the expense of providing a breakdown by circuit.

ralphhughes 4y ago
I've avoided smart-meter data so far as it shows zero watts no matter how much I export (I don't have an export contract, it's a DIY PV install and no point with current pricing) hence why I'm looking at ones with a seperate sensor. It frustrates me no end that my IHD doesn't show export, only import!