4 ms·
Since you've opened up yourself to questioning :)...Thanks for sharing, I apologize for this very laymanny question: I clicked on a swimming pool in New York C
by danso 10y ago
Since you've opened up yourself to questioning :)...Thanks for sharing, I apologize for this very laymanny question:
I clicked on a swimming pool in New York City...there aren't a ton of them in NYC, but very few of the matches have even a spot of blue in them...I know the algorithm is more than just "look for more blue patches"...if I were to explain this to another layperson, what is the most obvious explanation for something that seems more non-intuitive than expected?
Screenshot of my panel: http://imgur.com/H0wo5jK http://imgur.com/H0wo5jK
http://nyc.terrapattern.com/?_ga=1.84865689.1830936426.1464201975&lat=40.7256043&lng=-73.97539890000002 http://nyc.terrapattern.com/?_ga=1.84865689.1830936426.14642...
- patrickyeon 10y agoI'm not a part of this project, but if you look at your tile it's about 2/3 trees (by area), and the results are mostly tiles full of trees. Out of the results from your search, I picked out another tile [0] that I thought was more "swimming pool" with fewer "distractions". The results look like they're more in line with what you were hoping for. You could iterate this way a bit until you find the best prototype for a swimming pool. 0: http://nyc.terrapattern.com/?_ga=1.84865689.1830936426.1464201975&lat=40.6979118&lng=-73.97814490000002 http://nyc.terrapattern.com/?_ga=1.84865689.1830936426.14642...
- workergnome 10y agoNot Kyle, but another of the team involved in the project. When we built the training model, we used OpenStreetmap data to find locations of ~1,000,000 "things". A thousand churches, a thousand water towers, a thousand playgrounds, and so on. For each of those locations, we downloaded a satellite image. The neural net was then trained to look for the things that make each one of those things distinct; what makes a playground different than a church? It could be patterns, it could be colors, it could be any number of things. (For more precise details, you'll need to talk to Aman or Kyle.) It compares lots of things to lots of things, makes some guesses, and then sees whether those guesses help it correctly determine what we told it was in each tile. Once the model is trained, it's identified the 1024 "features" that are most significant in correctly distinguishing types of things from each other. We then run every tile of a geographical region through that feature determiner, which converts each tile into a point in our 1024 dimensional space. The search function then identifies a tile, looks up its location, and finds the 100 things closest to it within the 1024 dimensional space. So, TL;dr: It's not looking for colors, it's looking for computable features, which may or may not be color-specific. (Actually, they're highly non-color-specific: the training model randomly "wiggles" the color to makes sure that it doesn't get too tied to a very precise color.)
- dockd 10y agoIn my experience in the USA, OpenStreetMap data that comes from TIGER (?) imports, like heliports, are close but wrong. Playgrounds and watertowers are usually accurate because someone added them by hand. Churches are mixed. Other items are confusing; a hospital is typically a single point, but they tend to be some of the largest buildings in small towns. Any thoughts on how that affects your model?
- maxerickson 10y agoMost of the messy point features in the US were imported from GNIS. TIGER is the primary source for the messy line features. Sticking to features modeled as areas would generally avoid the spatial accuracy problems with GNIS.
- workergnome 10y agoWe found the same—using OSM data that just had points was problematic, both because of accuracy and because it tended to often be the front door, not the centroid of the object. I believe we limited our model generation to selecting places that had outlines, and computed the centroid of that outline. One of the benefits of our technique is that we didn't need to be comprehensive—we can throw out lots of places and still have enough to be useful for the model.
- maxerickson 10y agoAny plans to take imagery with suitable licensing and produce a list of items that seem to be missing in OSM? (Google prohibits feature extraction in their TOS and claims copyright, so OSM can't use information derived from their imagery)
- danso 10y agoThanks for the explanation...yeah, as I said, you're talking to a layperson :). I just realized that it was possible that the training was done on images where the color scale was changed, so thinking about it in terms of "well blue patches are so easy to see" is obviously wrong.
- kcimc 10y agoeverything david (workergnome) said, and also: in the tile you point to, "swimming pool" is most interesting/recognizable feature, but most of the image is just "trees and asphalt". if you pick another image where the pool takes up more of the image, you'll find more of what you're looking for: http://nyc.terrapattern.com/?_ga=1.84865689.1830936426.1464201975&lat=40.7935293&lng=-73.93626840000002 http://nyc.terrapattern.com/?_ga=1.84865689.1830936426.14642...
- JorgeGT 10y agoInterestingly, it worked amazingly well detecting small round swimming pools in Pittsburgh: http://pgh.terrapattern.com/?lat=40.3944695&lng=-79.98947650000002 http://pgh.terrapattern.com/?lat=40.3944695&lng=-79.98947650... This would have been very handy when the Greek government was scanning for undeclared swimming pools!
- erex78 10y agoTry with a better tile: http://nyc.terrapattern.com/?lat=40.7198568&lng=-73.98089090000002 http://nyc.terrapattern.com/?lat=40.7198568&lng=-73.98089090.... It works beautifully.