sid_tf

5 ms·

1. 1.▲
   Show HN: Rasteret-library for fast table like access to Satellite Imagery(github.com)

   3 points by sid_tf 7mo ago|0 comments
2. 2.▲
   by sid_tf 9mo ago

   OP here. Imagery file downloads still dominate today because they’re currently the simplest way to get reliable GPU throughput from disk for geospatial images. While in truth for majority of affordable AWS VMs, network is faster than disk.
3. 3.▲
   Stop selling files: The case for streaming tensors in GeoAI(blog.terrafloww.com)

   2 points by sid_tf 9mo ago|1 comments
4. 4.▲
   by sid_tf 2y ago

   Thanks! I will be posting more on this, especially as we try out more use cases like ML dataset curation, globally distributed time series analysis, and more. Surely will take your feedback into account of having variations in AOI sizes. He
5. 5.▲
   by sid_tf 2y ago

   Sure! Glad you shared your honest opinion. But I just want to reiterate that the blog and its subsequent library which will be released is not being done to create a new standard. All throughout the blog its been clearly stated that this is
6. 6.▲
   by sid_tf 2y ago

   Hi Sid here one of authors of blog. STAC being open and extensible, makes it a double edge sword yes. Quite refreshing to hear this from someone who was at Radiant coz, it shows we still haven't reached a great way of sharing data yet.
7. 7.▲
   by sid_tf 2y ago

   I share the same feelings, hence I along with OP, made this attempt of creating a library based on whatever seemed most performant and closest to regular data engineering world. 1. Geoparquet for metadata (iceberg catalog could be added lat
8. 8.▲
   by sid_tf 2y ago

   Agree on both fronts! STAC is pretty complex. My attempt here was to make raw data access easy and fast, not to solve STAC, which I believe stac-geoparquet basically makes an attempt to fix (makes it columnar and hence faster to query at sc
9. 9.▲
   by sid_tf 2y ago

   Hi, Sid here from Terrafloww, essentially this blog and library's attempt is based on the fact that COG has emerged as the standard format used by NASA and ESA and others over the past 5 years. And there is way more data in COG and con
10. 10.▲
    5x faster satellite data retrieval(blog.terrafloww.com)

    7 points by sid_tf 2y ago|1 comments
11. 11.▲
    by sid_tf 2y ago

    Hi everyone, I built this on open standards of cloud native geo, especially STAC Geoparquet and GeoArrow and PyArrow, and the library will be open sourced soon. No GDAL dependencies.