3 ms·

Is there a mapping from, say, a geo location to a list of Umbra files which cover that location? I'd hate to download 42TB of data and then have to grep through

Is there a mapping from, say, a geo location to a list of Umbra files which cover that location? I'd hate to download 42TB of data and then have to grep through it :-D

gloyoyo 2y ago
Things like this would instantaneously make the world a better place.
marklit 2y ago
The JSON files in the S3 bucket can be downloaded in isolation from any other format and they're pretty small. I did some geo-enrichment of them in a previous blog post where I found the country and waters of Umbra's ship imagery. https://tech.marksblogg.com/yolo-umbra-sar-satellites-ship-detection.html https://tech.marksblogg.com/yolo-umbra-sar-satellites-ship-d... The above relies on network calls to OSM but with Capella, I found a way to get the smallest GeoFabrik partition for each image using a single GeoJSON file. The code could probably be modified to work on Umbra's feed with a bit of work. https://tech.marksblogg.com/capella-open-data-free-satellite-sar-imagery.html https://tech.marksblogg.com/capella-open-data-free-satellite... Lastly, Umbra have ~24 locations they image frequently but there is an 'ad hoc' folder with a lot of subject names in English that give away the location and subject matter. This might be easier to look through for interesting imagery. aws s3 --no-sign-request ls 's3://umbra-open-data-catalog/sar-data/tasks/ad hoc/' | grep -i 'tesla\|nvidia\|saudi'
afm-umbra 2y ago
Hi! Our Archive Catalog STAC API indicates which items are in our Open Data Catalog on AWS. You can use the STAC Search endpoints to filter by this property alongside location. Instructions in our docs: https://docs.canopy.umbra.space/docs/archive-catalog-searching-via-stac-api#search-for-items-in-the-open-data-catalog https://docs.canopy.umbra.space/docs/archive-catalog-searchi... Unfortunately we don't directly link to the s3 assets for those items at this time :( So you'll still have to pull the list of files and grep by task ID.

Is there a mapping from, say, a geo location to a list of Umbra files which cover that location? I'd hate to download 42TB of data and then have to grep through it :-D

gloyoyo 2y ago

Things like this would instantaneously make the world a better place.

marklit 2y ago

The JSON files in the S3 bucket can be downloaded in isolation from any other format and they're pretty small. I did some geo-enrichment of them in a previous blog post where I found the country and waters of Umbra's ship imagery. https://tech.marksblogg.com/yolo-umbra-sar-satellites-ship-detection.html https://tech.marksblogg.com/yolo-umbra-sar-satellites-ship-d... The above relies on network calls to OSM but with Capella, I found a way to get the smallest GeoFabrik partition for each image using a single GeoJSON file. The code could probably be modified to work on Umbra's feed with a bit of work. https://tech.marksblogg.com/capella-open-data-free-satellite-sar-imagery.html https://tech.marksblogg.com/capella-open-data-free-satellite... Lastly, Umbra have ~24 locations they image frequently but there is an 'ad hoc' folder with a lot of subject names in English that give away the location and subject matter. This might be easier to look through for interesting imagery. aws s3 --no-sign-request ls 's3://umbra-open-data-catalog/sar-data/tasks/ad hoc/' | grep -i 'tesla\|nvidia\|saudi'

afm-umbra 2y ago

Hi! Our Archive Catalog STAC API indicates which items are in our Open Data Catalog on AWS. You can use the STAC Search endpoints to filter by this property alongside location. Instructions in our docs: https://docs.canopy.umbra.space/docs/archive-catalog-searching-via-stac-api#search-for-items-in-the-open-data-catalog https://docs.canopy.umbra.space/docs/archive-catalog-searchi... Unfortunately we don't directly link to the s3 assets for those items at this time :( So you'll still have to pull the list of files and grep by task ID.