4 ms·

Show HN: Finding and plotting solar panels in drone videos using computer vision

29 points by yeldarb 4y ago

jwonged 4y ago
This is really cool. I have friends running solar panel deployment companies and this would be extremely helpful.
- yeldarb 4y ago
  Nice! I’d love an intro if they’re interested in using drones/computer vision to streamline their work
yeldarb 4y ago
Had a lot of fun building this; did an in-depth writeup here as well: https://blog.roboflow.com/georeferencing-drone-videos/ https://blog.roboflow.com/georeferencing-drone-videos/
justchad 4y ago
I think you could productize this and sell it to solar companies. I imagine this data would be helpful to them for things like selling add-ons, upgrades, etc.
- j-sizz 4y ago
  I could see it be productized for anyone needing to do drone imagery!
- yeldarb 4y ago
  Love that idea -- and I think there are probably several startups that could be spun up on top of this (off the top of my head: search & rescue, monitoring swimmers in triathlons, helping governments identify zoning violations like unregistered pools, monitoring core infrastructure like pipelines for potential hazards like excavators nearby, finding people with bonfires in high risk fire areas, tracking wildlife, finding boats fishing in restricted areas, counting cars in parking lots, monitoring construction progress, etc) I would be thrilled to have someone pick this repo up and run with it. We're really focused on the developer tools and core infrastructure behind the computer vision part. We don't have the bandwidth to capitalize on all these opportunities (and this is only in the aerial space which is a tiny portion of the use-cases we've already seen for the technology; engineers at over 2/3 of the Fortune 100 have used Roboflow for things in every industry from retail to broadcasting to manufacturing to agriculture to healthcare). Having meaningful businesses built on top of our tools is a great sign that we're building something useful (and we'd be ecstatic to help them succeed if they want to become a customer)!
  - deleted 4y ago
    [deleted]
dogman144 4y ago
Candid question but you’ll have to trust that I’m asking it in good faith - What considerations are you making about your neighbors’ privacy, both about flying drones overhead, and then also ID’ing their use of solar? That video looks like 30+ homes now exposed as owning Solar and open to whatever marketing comes their way now. I can never get an answer out of drone operators about this. Since home owners can’t control who flies over head, the onus is on the pilot for thinking about it. I can’t tell if pilots ever do, but if they do, what conclusions do they come to? Edit - I get the laws haha, to the point of my comment, what do pilots feel is right to do vs what’s legal? This is what I mean by rarely getting a straight answer.
- yeldarb 4y ago
  As I understand it, the current state of the law (in the US at least) is that airspace is considered a public space governed by the FAA and you have no expectation of privacy in your front/back yard. It's basically the same as satellite imagery being made publicly available on eg Google Earth. Whether this is or is not "right" in the age of ubiquitous drone availability is up to us (via our government) to decide/change. Disclaimer: IANAL and before someone starts a company based on this, they should definitely consult one.
  - socialismisok 4y ago
    The pilot must maintain visual line of sight with the drone at all times, sufficient to determine heading of the drone by eye, unassisted by binoculars. It must not fly over people or vehicles with people in them. State privacy laws may provide restrictions above FAA airspace guidelines. Drone operators could get in trouble for taking off or landing on private property. Source: I'm a commercial license holder and have done some personal research into what's ok for the purposes of drone mapping. Edit: That appears to be in Class B airspace, starting at 680 feet above mean sea level. Ground level there appears to be 250 feet above sea level, so flying a drone means you could go 430 feet above ground level before you do something the FAA gets real angry about. As a drone operator, you can fly 400 feet above the ground OR 400 feet above any structure you are surveying. So it's something this pilot may want to be very, very careful about.
socialismisok 4y ago
Heads up, if you haven't already, make sure you have your commercial drone license! Anything past flying only for recreation requires a commercial license. The FAA says "if there's any doubt, get the commercial license". Having gone through it myself for mapping my forest land, it's not too difficult. You'll want to study up beforehand, but it's not too challenging.
cinntaile 4y ago
How does it distinguish between solar collectors and solar panels?
- yeldarb 4y ago
  It doesn't currently, this[1] is the dataset of ~50 images I collected that I trained the model on. I'm not really an expert so I just labeled the things I thought looked like solar panels. It's mostly meant to be an example -- if you want to use something like this in a production environment you should definitely spend more than the ~2 hours on image collection, dataset labeling, and training that I did for this! [1] https://universe.roboflow.com/brad-dwyer/aerial-solar-panels/model/5 https://universe.roboflow.com/brad-dwyer/aerial-solar-panels...
  - cinntaile 4y ago
    Yeah I was just wondering, it's probably non-trivial to distinguish between them. Cool project though!
  - ok_dad 4y ago
    Yea, I spotted a few panel-like objects that weren't captured in the example on the repo. Not sure if they were panels, but now I understand most of this is a framework for doing your own analysis. I suppose using your code, someone could also recognize pickup trucks, people, pools, etc. I think it's really neat that you can do stuff like this with drones these days, and am sad I live too close to a military airbase to use one for anything other than backyard piloting.
aeontech 4y ago
Very cool project! Reminds me of https://www.dronedeploy.com https://www.dronedeploy.com - I think some solar companies use this to help map roofs and generate panel layouts.

29 points by yeldarb 4y ago

jwonged 4y ago

This is really cool. I have friends running solar panel deployment companies and this would be extremely helpful.

yeldarb 4y ago
Nice! I’d love an intro if they’re interested in using drones/computer vision to streamline their work

yeldarb 4y ago

Had a lot of fun building this; did an in-depth writeup here as well: https://blog.roboflow.com/georeferencing-drone-videos/ https://blog.roboflow.com/georeferencing-drone-videos/

justchad 4y ago

I think you could productize this and sell it to solar companies. I imagine this data would be helpful to them for things like selling add-ons, upgrades, etc.

j-sizz 4y ago
I could see it be productized for anyone needing to do drone imagery!
yeldarb 4y ago
Love that idea -- and I think there are probably several startups that could be spun up on top of this (off the top of my head: search & rescue, monitoring swimmers in triathlons, helping governments identify zoning violations like unregistered pools, monitoring core infrastructure like pipelines for potential hazards like excavators nearby, finding people with bonfires in high risk fire areas, tracking wildlife, finding boats fishing in restricted areas, counting cars in parking lots, monitoring construction progress, etc) I would be thrilled to have someone pick this repo up and run with it. We're really focused on the developer tools and core infrastructure behind the computer vision part. We don't have the bandwidth to capitalize on all these opportunities (and this is only in the aerial space which is a tiny portion of the use-cases we've already seen for the technology; engineers at over 2/3 of the Fortune 100 have used Roboflow for things in every industry from retail to broadcasting to manufacturing to agriculture to healthcare). Having meaningful businesses built on top of our tools is a great sign that we're building something useful (and we'd be ecstatic to help them succeed if they want to become a customer)!
- deleted 4y ago
  [deleted]

dogman144 4y ago

Candid question but you’ll have to trust that I’m asking it in good faith - What considerations are you making about your neighbors’ privacy, both about flying drones overhead, and then also ID’ing their use of solar? That video looks like 30+ homes now exposed as owning Solar and open to whatever marketing comes their way now. I can never get an answer out of drone operators about this. Since home owners can’t control who flies over head, the onus is on the pilot for thinking about it. I can’t tell if pilots ever do, but if they do, what conclusions do they come to? Edit - I get the laws haha, to the point of my comment, what do pilots feel is right to do vs what’s legal? This is what I mean by rarely getting a straight answer.

yeldarb 4y ago
As I understand it, the current state of the law (in the US at least) is that airspace is considered a public space governed by the FAA and you have no expectation of privacy in your front/back yard. It's basically the same as satellite imagery being made publicly available on eg Google Earth. Whether this is or is not "right" in the age of ubiquitous drone availability is up to us (via our government) to decide/change. Disclaimer: IANAL and before someone starts a company based on this, they should definitely consult one.
- socialismisok 4y ago
  The pilot must maintain visual line of sight with the drone at all times, sufficient to determine heading of the drone by eye, unassisted by binoculars. It must not fly over people or vehicles with people in them. State privacy laws may provide restrictions above FAA airspace guidelines. Drone operators could get in trouble for taking off or landing on private property. Source: I'm a commercial license holder and have done some personal research into what's ok for the purposes of drone mapping. Edit: That appears to be in Class B airspace, starting at 680 feet above mean sea level. Ground level there appears to be 250 feet above sea level, so flying a drone means you could go 430 feet above ground level before you do something the FAA gets real angry about. As a drone operator, you can fly 400 feet above the ground OR 400 feet above any structure you are surveying. So it's something this pilot may want to be very, very careful about.

socialismisok 4y ago

Heads up, if you haven't already, make sure you have your commercial drone license! Anything past flying only for recreation requires a commercial license. The FAA says "if there's any doubt, get the commercial license". Having gone through it myself for mapping my forest land, it's not too difficult. You'll want to study up beforehand, but it's not too challenging.

cinntaile 4y ago

How does it distinguish between solar collectors and solar panels?

yeldarb 4y ago
It doesn't currently, this[1] is the dataset of ~50 images I collected that I trained the model on. I'm not really an expert so I just labeled the things I thought looked like solar panels. It's mostly meant to be an example -- if you want to use something like this in a production environment you should definitely spend more than the ~2 hours on image collection, dataset labeling, and training that I did for this! [1] https://universe.roboflow.com/brad-dwyer/aerial-solar-panels/model/5 https://universe.roboflow.com/brad-dwyer/aerial-solar-panels...
- cinntaile 4y ago
  Yeah I was just wondering, it's probably non-trivial to distinguish between them. Cool project though!
- ok_dad 4y ago
  Yea, I spotted a few panel-like objects that weren't captured in the example on the repo. Not sure if they were panels, but now I understand most of this is a framework for doing your own analysis. I suppose using your code, someone could also recognize pickup trucks, people, pools, etc. I think it's really neat that you can do stuff like this with drones these days, and am sad I live too close to a military airbase to use one for anything other than backyard piloting.

aeontech 4y ago

Very cool project! Reminds me of https://www.dronedeploy.com https://www.dronedeploy.com - I think some solar companies use this to help map roofs and generate panel layouts.