7 ms·
My job requires pulling large data dumps produced by research from a national lab from public S3 buckets. TB's of data. This research is publicly funded, the d
by floatrock 1y ago
My job requires pulling large data dumps produced by research from a national lab from public S3 buckets. TB's of data.
This research is publicly funded, the data produced is public data, and it enables an entire ecosystem of business activity. imho, this is a good use of public funding and research, and hosting it in S3 buckets is a good solution that makes huge quantities of data easily accessible to people who would use this.
I don't use NOAA data, but this has chilling effects for my business (is my national lab next?). There is nothing "efficient" about forcing agencies to get rid of data and service hosting that works well at scale.
(If DOGE was actually about increasing efficiency of digital services like it's pre-rename/pre-takeover US Digital Services agency was actually doing, we'd be building a TB or PB-scale S3 alternative for government agencies to use, but we all know that's not the constructive efficiency they're doing here)