5 ms·
A 16TB Mirror of Data.gov on Source.Coop
- deleted 2y ago[deleted]
- ChrisArchitect 2y ago[dupe] Discussion: https://news.ycombinator.com/item?id=42970039 https://news.ycombinator.com/item?id=42970039
- SubiculumCode 2y agoThat is the point. "redundant" duplication of data is needed.
- m3kw9 2y agoHow do they guarantee none of it is modified?
- badlibrarian 2y agoBagIt and sha256 and dropping Harvard's name and "look, squirrel!" https://en.wikipedia.org/wiki/BagIt https://en.wikipedia.org/wiki/BagIt
- nsriv 2y agoComment history certainly living up to your name.
- ck2 2y agoThe public facing data was never the problem. We have no idea what is being nuked off the backend, copied offline and into AI Employee records, Tax records, medical records, things like that. Then there is the problem of private servers plugged into government networks that are obviously bypassing firewalls and prime targets for foreign governments because they aren't secured and designed to be remote accessed.
- ethagnawl 2y ago> Then there is the problem of private servers plugged into government networks that are obviously bypassing firewalls and prime targets for foreign governments because they aren't secured and designed to be remote accessed. This isn't getting ... any attention. (Though, I've contacted my congressional representative and I urge everyone else to do the same.) Any concerns have been dismissed as FUD and allayed by reassurances that _their access is read-only_, which is a wet fucking blanket if ever there was one. I know if I were a nation state with access to Pegasus or similar systems, I'd be actively targeting these DOGEngineers. But, sure, cry me a fucking river about DeepSeek.
- bongodongobob 2y agoDo you have any examples of being able to get sensitive info from an LLM? I've never heard of it.
- frontalier 2y agoone of the kids was asking on twitter which llm to use for pdf parsing
- haunter 2y agoI'm surprised there is no torrent available
- RIMR 2y agoFor real, I have a 20TB drive available, and I would seed this indefinitely.
- monkeyfun 2y agoYo just since you mention that -- got any recs for a 20tb drive? Currently the biggest thing i rock is just a seagate 8TB nas HDD, which i nabbed pretty cheap, but these days the archiving i do kinda makes me wanna step up even bigger.
- amiga386 2y agohttps://diskprices.com/?locale=us&condition=new&capacity=20-&disk_types=external_hdd,external_hdd25,internal_hdd,internal_hdd25,internal_sshd,internal_sas https://diskprices.com/?locale=us&condition=new&capacity=20-...
- doctoboggan 2y agoI got this on Black Friday for $270: https://www.newegg.com/wd-elements-20tb-black-usb-3-0/p/N82E16822234519?Item=N82E16822234519 https://www.newegg.com/wd-elements-20tb-black-usb-3-0/p/N82E... Its $350 now however, but that's still not bad for 20TB
- ANighRaisin 2y agohttps://www.amazon.com/dp/B0B2PZWD81?tag=synack-20&linkCode=osi&th=1 https://www.amazon.com/dp/B0B2PZWD81?tag=synack-20&linkCode=...
- r3trohack3r 2y agoIf I had to guess this is the problem > This is a regularly updated mirror p2p software really struggles with mutability. We need stable chunking (I.e. rolling hash chunking around file boundaries) and seeders to seed addressable chunks (similar to bitswap) to preserve seeders from the previous revision when a 16TB archive partially changes. This is something my team is actively researching alongside other p2p problem statements. If it interests you, you know rust, and you’re looking for a job, email me.
- deleted 2y ago[deleted]
- deleted 2y ago[deleted]