6 ms·
A drone that calculates coordinates using a camera and Google Maps
- 542458 3y agoIIRC many cruise missiles do a similar thing, except with radar and topographical maps instead of cameras and photos. Obviously the cruise missiles cost a hair more as well.
- dboreham 3y agoFirst generation Tomahawk did this (TERCOM) but later blocks acquired image matching guidance which is presumably today very advanced (I heard about it first around 1988).
- chasd00 3y agoThe YouTube channel TheOperationRoom has a very well animated play by play (almost to the minute) of the air and ground war in gulf war 1 in Iraq/kuwait. In one of the videos he mentions tomahawks having to take a long route into Baghdad because it was the only one with enough terrain for the missile to follow to the target. This was 1991 so maybe older inventory. https://youtube.com/playlist?list=PLErys4h2oiuyKCuzZhpHhCeRwSoQVEazb&si=OiCvb0YjlrqKbKDs https://youtube.com/playlist?list=PLErys4h2oiuyKCuzZhpHhCeRw...
- whartung 3y agoTomahawk missile routes early on took quite a bit of planning because of this. They could only follow terrain that they’d recognized. It had other capabilities (mostly inertial at the time), but the “clever” stuff came from following well map routes. Back in the day, TI had version of their Explorer Lisp machine contained on a single 256 pin chip. These were being considered for the next generation guidance packages on the tomahawk.
- numlock86 3y agoThe missile knows where it is at all times. It knows this because it knows where it isn't.
- fyt2024 3y ago[dead]
- dboreham 3y agoJust like Tomahawk missiles (see DSMAC).
- dilyevsky 3y agoStorm Shadows/SCALP-EGs and Taurus have that too
- neodypsis 3y agoCan this be used for fail-safe navigation of consumer-grade drones? I.e., to return to "home" safely?
- the__alchemist 3y agoNot required; assume you are not being jammed in those cases.
- neodypsis 3y agoYou are assuming GPS can only fail by being jammed; also consider the possibility of the hardware module itself failing.
- the__alchemist 3y agoRedundant GPS modules if that is a consideration. The camera tech in the article is for use in GPS-degraded and denied areas.
- neodypsis 3y agoFor example: pre-load satellite images and restrict navigation to radius covered by said images. In case of GPS failure, fail-safe to using image navigation for getting back "home".
- roger10-4 3y agoAssuming loss of GPS, no, not fail-safe. Weather conditions (or anything that obscures a view of terrain) can cause this type of navigation to fail.
- kumarm 3y agowhat happens with changes due to some natural events (Say flooding etc) ?
- snodnipper 3y agoclearly could be a problem...but you are really looking at feature extraction / terrain analysis and best guessing with what is available (little different to a human doing the same job). The main thing here is that storage is so cheap and light that these these systems become easily possible. Terrain, features + building heights...filter if you need on building height / terrain...work with what is left...
- deleted 3y ago[deleted]
- elif 3y agoAs an aside, it is amusing that the younger generation engineers phrase it as "calculating GPS coordinates" rather than "latitude/longitude" Sort of like calling a bank teller "an ATM without the machine"
- aendruk 3y agoA while back I saw web feeds described as “like podcasts, but for reading”.
- aqfamnzc 3y agoI've recently discovered that you can buy audiobook transcripts.
- SOLAR_FIELDS 3y agoThat sounds like a boo… wait a minute
- goodpoint 3y agoWhoa, a printed ebook!
- livrem 3y agoAnd a TTRPG (table-top RPG) is like a RPG, but played using pencils and paper and dice instead of on a computer or console.
- cameronh90 3y agoIn a sense, they are right. There are several coordinate systems, but the one everyone uses (WGS84) was developed around the time of GPS and intended to be used for that purpose. So GPS coordinates isn’t really a bad way to describe them.
- SOLAR_FIELDS 3y agoTechnically if they’re only using Google Maps they’re probably working off a projection of that coordinate system (Web Mercator).
- dgfitz 3y agoDTED data is like a fingerprint. This isn’t much of a story.
- cleverwebble 3y agoThe story is that these young engineers built a 500$ drone that consumes this kind of data to do mapping. In 24 hours for a hackathon no less. If the US government didn't already have this kind of tech, they would spend millions just for the same prototype they built. And probably tens or hundreds of millions for a final product. I think that's a story
- thorncorona 3y agoConsidering they didn't actually deploy (the route was simulated), I would be skeptical of this.
- kortilla 3y agoIt’s only a story if it wasn’t known to cost around this range in the first place. People can do weekend hackathon image recognition projects that aren’t story worthy but would have been billion dollar companies 15 years ago
- geor9e 3y agoIt's easy to shallowly dismiss work with a metaphor for how it works. LLM training is like a marble rolling down a valley. But hacking together a working proof of concept warms the heart.
- cozzyd 3y agoWe'll see how well it works on a featureless ice sheet....
- mattmaroon 3y agoUnless your drone somehow makes it to Antarctica that would be hard to imagine happening, and even if it did, it could just continue on in one direction until it sees a feature again. Or fly higher. I’ve driven across the Great Lakes when frozen but even from the ground there are landmarks you can see.
- npsomaratna 3y agoQuestion: how do you know it's safe to drive over them? Wouldn't there be areas of thin ice through which the vehicle might sink?
- mattmaroon 3y agoThe coast guard actually samples the ice and marks lanes. There are islands that people live on up there and when it freezes enough you can drive back to the mainland. There were lots of people who just did their own thing but yes, that would otherwise be a risk without testing and I’m sure too cautious to be one of them. Now though I don’t think it gets cold enough where I was at (Lake Erie near the Ohio/Michigan border) to freeze enough in the winters anymore. It’s been a solid 20 years since I knew people who drove on it so I’m not sure it’s still a thing. NYT actually wrote an article about how the lack of freezing is killing a brisk (pun intended) winter business there and mentions it. I used to have family who lived on the next island north. https://www.nytimes.com/2023/03/05/us/put-in-bay-ohio-ice.html https://www.nytimes.com/2023/03/05/us/put-in-bay-ohio-ice.ht...
- neodypsis 3y agoIsn't most of Antartica restricted air space?
- krisoft 3y ago
- MichaelMug 3y agoCongrats to the team. I'd like to see more details about the drone design, camera used, power plant.
- MattRix 3y agoHow do you even print an object that large in 24hrs, nevermind actually testing/iterating on the design? It seems a little disingenuous to say those aspects were done in 24 hours unless I’m missing something.
- NegativeLatency 3y agoIt’s multiple parts so multiple printers, I’ve printed some plane parts from lightweight PLA and this seems pretty reasonable to me. Especially so if you imagine prior experience and multiple people. It would get tricky if you had to iterate the design though.
- thepasswordis 3y agoBambu carbons print that fast, and I think that's what they had at the gundo hackathon.
- romanzubenko 3y agoDuring the hackathon the team only did a simulated flight, not a real flight, so take the results on effectiveness with a grain of salt. In any environment with significant seasonal changes, localization based on google maps will be a lot harder.
- Zetobal 3y agoI guess if it's really a possibility for military use they won't use google maps...
- fnordpiglet 3y agoOccurred to me that in a war or over the water this wouldn’t be useful. But I think it will be a useful technology (that to be fair likely already exists), in addition to highly accurate dead reckoning systems, when GPS is knocked out or unreliable, as secondary fall back navigation.
- jnwatson 3y agoFor only $300 plus shipping from Ali Express you get a high accuracy inertial navigation system. Only weighs 10 grams. The future is scary. It is now straightforward and inexpensive for lots of folks to construct jam-resistant Shahed-style drones. https://www.aliexpress.com/item/1005006499367697.html https://www.aliexpress.com/item/1005006499367697.html
- geor9e 3y agoGoogle Maps app can also do this, from your phone camera at street level. My phones GPS and compass are garbage so I use it sometimes. https://smartphones.gadgethacks.com/how-to/scan-your-surroundings-with-google-maps-live-view-calibrate-your-location-0323460/ https://smartphones.gadgethacks.com/how-to/scan-your-surroun...
- SOLAR_FIELDS 3y agoSeems like a really good use case for downtown anywhere, because otherwise the buildings make your gps go haywire and navigation sucks. Though I will say, and certain providers try not to admit this too loudly, a much better way to handle those downtown scenarios is to map out and keep track of the location of WiFi signals and use their relative strength as detected by your device to triangulate your position instead. Works really well in super dense areas like cities
- loxdalen 3y agoThat is used in cities by Google at least (as long as 'Wi-Fi scanning and Bluetooth scanning' is turned on in which is default)
- geor9e 3y agoApple too, for a long time now. I used to use my 2015 iPad WiFi edition for navigation despite it not having a GPS chip. It worked surprisingly well as long as buildings were around.
- ChumpGPT 3y agoThis is already being utilized in Ukraine since GPS guidance doesn't exist in large areas. I've also read that both Switchblade and Lancet drones have this ability.
- oneshtein 3y agoLancet drones just use mobile phone with an Ukrainian SIM for navigation.
- causality0 3y agoThere are so many problems with this article. If an area is so "remote" it doesn't have GPS coverage, the Google Maps imagery quality is going to be garbage as well. It claims it works day or night but how does it work at night? Not only will detail from the camera be reduced but the available satellite imagery will be greatly reduced in detail as well. If the team has only conducted a simulated flight isn't the headline just plain wrong? Maybe I missed it in the article but does the processing take place on the drone or at a control station?
- alx_the_new_guy 3y ago>if the area is so "remote" it doesn't have GPS coverage Or if GPS signal is being jammed. >imagery quality is going to be garbage Presumably, this relies on fairly limited compute resources, so it maybe probably downscales the image from it's camera to something like 256x256. Also, for machine vision stuff, too detailed an image can produce a lot of noise, so you'd need to pass it through some kind of low-pass filter anyway.
- thinkingemote 3y agoGPS is calculated from signals from a range of satellites far above us in orbit in space. It's not like cellular towers with coverage. There are no real remote areas with GPS - some areas and times of day will have less satellites overhead so calculating a position will be harder. There's more and more of these satellites (from usa, russian, eu, china etc) and modern chips will try calculate position from the signals from many of them rather than one "species" But yes, remote areas will have less mapping imagery quality because they are remote and uninteresting and don't have roads or people or companies to buy ads on the map. They will buy cheaper imagery in remote areas.
- JustARandomGuy 3y agoThis article strongly reminded me of the "helicrane" system developed by NASA for the last Mars probe, which oriented itself by recognizing the terrain below it and using that to orient itself toward the right drop location: https://www-robotics.jpl.nasa.gov/what-we-do/flight-projects/mars-2020-rover/terrain-relative-navigation/ https://www-robotics.jpl.nasa.gov/what-we-do/flight-projects... Fun stuff. Wonder if there is any requirements for how "bumpy" the terrain needs to be to get recognized properly by the system.
- wokwokwok 3y agoUnless I'm missing something extraordinary this is: - lacking any details of technical implementation - full of ads - substantiated only by a single thread on X, which is where this article should link to (much as I dislike X), not to a page full of ads. $500? 1 day? Cool. I'd love to know more; unfortunately, there is no more to know, because this page is just click bait and arbitrary statements like: > which uses cameras to position itself, using imagery that doesn’t rely on light to work means this drone can fly anywhere in the world it has imagery for at any time of the day or night. > The team built this impressive drone during the El Segundo Defense Tech Hackathon hosted by 8VC, Entrepreneur First, and Apollo Defense in collaboration with the. <--- the what? These are obviously wrong and probably AI generated. This is spaaaaammmm... Link to the X thread or get rid of it.
- rebolek 3y agoX threads aren't unfortunately very useful for people who don't have account on X. Linking to the original source is much better. If the original source is only X thread, authors should reconsider their life choices. It's never too late.
- gloosx 3y agoI wonder: if you can just measure the gyroscope readings and velocity, then knowing a starting coordinate, could you just calculate the current coordinate? What are the unknown parts of this equation which make a sattelite / other methodology a must?
- dayjaby 3y agoYour position would drift insanely fast. In a drone, gyro readings and velocity are being used in the ekf2 filter to calculate your position. But a GPS position is required to prevent longtime drift. Obviously, in GPS deprived situations, you have to think about alternatives.
- gliptic 3y agoThe unknown part is drift caused by measurement error, which will stack up very quickly.
- magicalhippo 3y agoThat's called dead reckoning[1]. The Kalman filter[2], which pops up on this site rather frequently, is often used for updating the current state. The issue is that sensors are not perfect. Not just noise, but they might be slightly off in one direction more often compared to another for example. These errors accumulate, and so you can be quite off after not that long of a time. [1]: https://en.wikipedia.org/wiki/Dead_reckoning https://en.wikipedia.org/wiki/Dead_reckoning [2]: https://en.wikipedia.org/wiki/Kalman_filter https://en.wikipedia.org/wiki/Kalman_filter
- gloosx 3y agoThanks for all the answers guys, of course I missed the most interestins parts in my naive theorizing :)
- magicalhippo 3y agoStay curious! Almost always there's good reasons if a seemingly-obvious solution isn't much used. Sometimes it can be hard to understand why without a lot of in-depth knowledge, as it can depend on somewhat non-obvious aspects, typically in the practical realizations like in this case. With perfect sensors, dead reckoning would work like a charm. However I find that thinking about the problem, coming up with these what-if solutions and then figuring out why they don't work, can be quite fruitful. Often leading to new knowledge that might actually be relevant down the line, and if not it's a great exercise in problem solving.
- dna_polymerase 3y agoDoes this have any merit aside from satisfying intellectual curiosity? I assume GPS receivers to be quite cheap these days?
- wrigby 3y agoIn the context - a hackathon sponsored by the US Department of Defense - it has great utility. GPS (and any radio-based location system) is quite vulnerable to denial by enemy jamming. This technique would by extremely relevant in a war between peers, and probably provides a much lower cost option than high-precision inertial navigation systems. Tangentially, this isn't really new - ground-pointed RADAR system combined with a good terrain dataset can also be used.
- dilyevsky 3y agoLow cost weapons systems
- KaiserPro 3y agoA small team managed to implement relocalisation (the technical name for this) in 24 hours is reasonably interesting. If you want to try yourself you can use colmap (https://colmap.github.io/faq.html#register-localize-new-images-into-an-existing-reconstruction https://colmap.github.io/faq.html#register-localize-new-imag...) to do the same thing. I suspect that colmap not only does lat:lon but gives you a heading as well. (well I know it does, thats how it ) Now, had they made it happen _on the drone_ that would be more interesting. It looks like it was a simulated flight, especially as there is no rolling shutter wobble. Moreover, if you want real time, you need a monster GPU, unless they've done something clever.
- phreeza 3y agoNot sure how they do it but I think it's quite feasible to extend a kalman filter to include camera intput referenced to an image. E.g. https://doi.org/10.3390/aerospace9090503 https://doi.org/10.3390/aerospace9090503
- kierenj 3y ago"GPS coordinates" is a bit of a weird one. Surely they mean, "coordinates" or "position" or "longitude and latitude". GPS is a system used to self-locate, and find coordinates. This doesn't use GPS..
- dang 3y agoOk, we've taken GPS out of the title above.
- meindnoch 3y ago>we designed, 3d printed and built a <$500 drone with that calculates GPS coordinates without a signal using a camera + google maps Without a GPS signal, I assume. Unless Google Maps is stored locally on their drone.
- defrost 3y agoFrom the original link for this post: The drone uses a camera mounted underneath it to position itself with imagery from Google Maps highlighting similarities in the images to get a rough estimate of the co-ordinates. Doesn’t Google Maps still require internet, you may ask? Google Maps allows users to download segments of maps ahead of time, usually for use when you are travelling or camping out in remote areas. In this instance, the team used this feature to their advantage, allowing the drone to continue operating regardless of having a GPS satellite connection. The entire point of such a build is to operate autonomously with local data in the presence of jamming | signal loss for other reasons.
- AnarchismIsCool 3y agoYou can download osm and satellite datasets for thousands of square miles in a few GB. If you need very high resolution satellite it's gonna be on the order of 1GB per ~10sqmi depending on what you're up to.
- xyzal 3y agoI sense potential for anti-anti-drone warfare.
- mkaszkowiak 3y agoSurprised by the amount of negative comments. Kudos to the team! This is very impressive to accomplish in 24h with a 3-man team.
- mornanding 3y agoTake care, what you wish for: https://www.youtube.com/watch?v=9fa9lVwHHqg https://www.youtube.com/watch?v=9fa9lVwHHqg Just in case you are too young to know this movie.
- gengelbro 3y agoThe future of warfare does seem to be incredibly cheap autonomous (or nearly so) drones. I know Palmer Lucky's working on this, but his offering is still incredibly high priced... Who's looking at this problem with the perspective that these should be 'ammo' and not 'aircraft'?