6 ms·
Seems a bit of a waste to dedicate an entire 360TB disc to a single text document like a bible, which is probably just a few KBs... /s More seriously, they don
by toyg 7y ago
Seems a bit of a waste to dedicate an entire 360TB disc to a single text document like a bible, which is probably just a few KBs... /s
More seriously, they don't talk about reading capabilities (retrieval speed etc). And what if it gets scratched? What is the error tolerance? At that density, a single speck of dust could have dramatic implications...
I hope this reaches industrial viability, because we desperately need a digital format that can approximate the lifespan of simple paper. At the moment we are chained to a maintenance nightmare of periodic hops between formats, with deadly consequences any time we miss a single jump.
- bshipp 7y agoI don't disagree, but it's not really different with spinning rust. the solution would likely be similar: seal it in an enclosure to prevent intrusion of dust, scratches, etc.
- butteroverflow 7y agoI believe HDDs slowly lose stored data if you don't rewrite it periodically? I remember reading some data recovery forum a few years back with the local experts saying something about 10 years of reliable data storage for an HDD lying on a shelf. After that, all bets are off.
- bergoid 7y ago> spinning rust TIL https://etherealmind.com/network-dictionary-spinning-rust/ https://etherealmind.com/network-dictionary-spinning-rust/ > Spinning Rust – term for conventional hard disk drives with motors and using ferrous-based platters for data storage. Probably derogatory now that Flash Drives are beginning to replace conventional drives.
- AnIdiotOnTheNet 7y agoTIL? Goddamnit, how old am I?
- anentropic 7y agoand/or add some degree of redundancy and error correction to the storage codec
- andrey_utkin 7y agoBut the rust which is supposed to be spun, doesn't live long when not being spun? So far the most viable "solution" is to store data in the cloud service like Backblaze or AWS S3, where it's someone else headache to maintain high enough duplication and swap the drives as they reach their EOL.
- orbital-decay 7y agoYeah, actual museum-grade archival is so much more than just having an aging-resistant media. You also need to be able to read and decode it many years into the future, which is really tricky to guarantee - you can't assume the future generations will know how to make a reading device and remember your formats/encodings. So it's a bit like unzip.zip problem.
- unhammer 7y agorelevant: http://www.vpri.org/pdf/tr2015004_cuneiform.pdf http://www.vpri.org/pdf/tr2015004_cuneiform.pdf talks about archiving computer programs so they may be read by future civilizations
- megablast 7y agoJust put the instructions in a plain txt file as the first file on the disc.
- stefs 7y agoyou'd have to know the (physical) reading mechanism (plus encoding) to read the README.txt itself.
- TuringTest 7y agoThat's why you put the ASCII encoding as well, plus the blueprints for a digital computer capable of running EMACS to decode it.
- aardshark 7y agoWell encoding is not an issue. Any civilisation who have the physical means to read the disc will be able to figure out the encoding fairly simply.
- orbital-decay 7y agoIt isn't that simple, many lost languages have only been restored because of the dual language books. Similarly, I think what matters here is the higher-order redundancy. A single encoding that can be lost, is not straightforward to figure out, and holds the clue to a massive storage, isn't the most future proof decision; it's a single point of failure.
- Cthulhu_ 7y agoWhat would IMO be a better solution is something like the pyramids - something huge, with a lot of data written down / chiseled in without any weirdness like parity bits or binary code, and a lot of redundancy. Imagine the pyramids but made out of modern materials, resistant to erosion and earthquakes. Ceramics? Silicon? Either way it'd have to be legible without the need of a microscope or computers. Write the same text down in a few dozen vastly different languages, so you've got a modern day Rosetta Stone. And of course, build it somewhere remote and seal it. Bonus points for a stable atmosphere, fill it with a heavy noble gas or make it a vacuum. (I'm not well versed in any related sciences, I'm just sounding off some random ideas)
- titanomachy 7y agoThere is an ongoing project to carve knowledge on clay tablets and seal it in a salt mine in Austria. Sounds like it checks some of your boxes. https://www.theatlantic.com/technology/archive/2017/01/human-knowledge-salt-mine/512552/ https://www.theatlantic.com/technology/archive/2017/01/human...
- carapace 7y agoWow! https://www.memory-of-mankind.com/how-is-information-kept-legible-for-1-million-years/ https://www.memory-of-mankind.com/how-is-information-kept-le... > The geology of the mountain will allow the MOM archive to fully close itself by a natural phenomenon: the salt “flows” with a speed of 2 cm/year into any void. This will protect the archive from the greatest threat; man himself. > The pressure which results from the weight of the mountain and a hypothetical ice shield of 5 km thickness is approximately a fifth of the burst pressure of the used materials.
- rtkwe 7y agoIt depends on your goal, there's long term storage that assumes we'll retain the technology and knowledge required to read it (or it will be easily reproduced, ie the reader technology is trivial to produce in the future because technology has advanced really far) and then there's the civilization restart archive that assumes we'll be anywhere from cave people up to basically where we are today. Really for the second type I think both the macro scale and a micro scale (though not digitally encoded for most of it) in combination along with something like the Rosetta Disk [0] from the Long Now project is probably the way to ensure it's actually readable. The large scale text would provide a boot strap to get optics set up that could read the smaller etched text on archives that could then setup the tech to read the even finer etched stuff and so on maybe eventually reaching disks like the one in the article where we're able to store digital files and the knowledge to read them was introduced in more human readable formats. [0] http://rosettaproject.org/disk/concept/ http://rosettaproject.org/disk/concept/
- bufferoverflow 7y agoWhat if HDD platter gets scratched? What if SSD memory gets scratched? What if <any storage> gets <X mechanical damage>?
- klez 7y agoThose are not touted as a very-long-term archival solution. This one is.
- toyg 7y agoThe point of this tech is precisely to overcome the limitations of previous ones. > What if <any storage> gets <X mechanical damage>? It's more like "How much X damage can storage Y tolerate before losing Z amount of data?" You evaluate the different tech then you pick the best option. Maybe some of this could be mitigated with logical techniques (e.g. make data redunant over 2 or 3 different parts of the disc, sacrificing capacity for durability), but it really depends on whether the process allows for this or completely borks out as soon as a scratch happens. They don't say anything about that and I think it's a pretty important aspect of any long-term storage solution.
- syn0byte 7y agoBD-Rom is already pushing sane limits. It's why an important if under reported "feature" of BD-Rom over DVD was harder, more scratch resistant plastic coating. If you really need the lifespan of paper... http://ollydbg.de/Paperbak/ http://ollydbg.de/Paperbak/
- toyg 7y agoThanks for that link. It's clearly a joke and obsolete, but I wouldn't mind having something like that to backup a few small things (ssh keys, passwords meant to survive me, etc etc). After all, we will likely always have some sort of image-capturing device to leverage - unlike with discs of any sort.
- notacoward 7y agoJust to follow up, here's a list of the problems I know about in getting 3D (or 5D) storage to market. * Materials. You need something that can be manipulated or deformed at reasonable energy levels into two or more stable states to store data, then maintain that state for a useful lifetime without power. That's already a bit of a Goldilocks act, but it must also be non-reactive, not too brittle, not too expensive, etc. * Media manufacture. Recording even a single layer at these feature sizes is a non-trivial challenge. As layers increase, yield drops exponentially - even before you consider how the layers interact. * Read/write mechanisms. Focusing on a single layer on a moving medium, with nothing in the way, is also a challenge. Put other data-bearing layers in the way and it becomes much more difficult. Also, the "blast radius" for a single focus/alignment error becomes much larger, so you're going to need some serious error correction over and above what already exists for 2D. * Transfer speeds. These are already problematic even at 10TB. 360TB without a corresponding increase in transfer speeds would be a nightmare. A prototype involving a novel set of materials and/or mechanisms working once under ideal conditions is great. Science advances. Kudos for that. But that's only solving about one fifth of the problems that need to be solved to produce something of actual value in the market. You see a similar thing with battery technology. Everyone knows we need better batteries. There are always several companies claiming to have found the next breakthrough Almost invariably the new wonder material turns out to be a poor fit for real-world scale, economics, or conditions. Obviously we should keep trying, and keep learning, but nobody should get their hopes up too much too early.
- gnode 7y ago> And what if it gets scratched? What is the error tolerance? At that density, a single speck of dust could have dramatic implications... My understanding is that it doesn't matter. The data is embedded three dimensionally in glass. Assuming there was some small margin of glass around the patterned region, you could simply grind / polish off the scratches. Of course if you scratched it deep enough to destroy the data region then you'd be out of luck, but this can be made arbitrarily difficult. Furthermore, you can arbitrarily scale error tolerance with error correcting encodings; data can be distributed, such that damage in one or a few areas is still available elsewhere, similar to RAID 5 and 6.