3 ms·
Totally out-of-band for this thread, but... what are the uses for a multi-gigabyte key?! I'm clearly unaware of some cool tech, any key words I can search?
by kfrzcode 5y ago
Totally out-of-band for this thread, but... what are the uses for a multi-gigabyte key?! I'm clearly unaware of some cool tech, any key words I can search?
- dTal 5y agoI'm no expert but I would guess it's just a fancy word for "file", as in "key-value store", as opposed to a god-proof encryption key.
- antpls 5y agoIn this case, wouldn't the value be multi gigabit, not the key?
- oneplane 5y agoWell, you'd refer to an object by its key, so while the value of the object would have the data, you could stil refer to your objects as keys, the same way we refer to files on a filesystem. It's not the file that is big, but the blocks it represents.
- epistasis 5y agoWhen I say "key" I mean the blob that gets stored, but I may be misremembering or misusing S3 terms... it was large amounts of DNA sequencing data, and one of the first tasks was to add S3 support for indexed reads to our internal HTSlib fork, and since then somebody else's implementation has been added to the library. In any case, I quickly forgot about most of the details of S3 when I no longer had to deal with it directly...
- kfrzcode 5y agoThat makes perfect sense, assume I'm a pleb! Thanks for the follow-up, large files/values make sense. My head was in huge cryptographic keys for some purpose