5 ms·

Impressive. Will you share more information about the specific details (i.e. hardware and configuration) for the set up you're running with?

merb 7y ago
well probably with compression
- jolmg 7y ago
  I wonder if the 300MBps figure might also be with compression.
  - adrian_b 7y ago
    No, the LTO-7 transfer speed is 3 Gb/s a.k.a. 300 MB/s without compression. The compression in drive may be useful for automated backups, but if you use the tape for an archive of files selected by yourself, it is better to disable the drive compression. If you have compressible files, you can compress them with better algorithms on the computer, before storing them on the tape.
    - merb 7y ago
      > you can compress them with better algorithms on the computer is that always true? what if I have dozen's of pdf's which are similar and compressed (most pdfs are)? wouldn't de-duplication also reduce the size? I mean with millions/billions/trillions of files of the same format.
      - adrian_b 7y ago
        For example on a computer you can use algorithms like lrzip, which search for very long distance redundancies (i.e. not in small data windows like traditional algorithms). This usually achieves a decent compression even on normally incompressible files, e.g. on collections of movies or on collections of PDF files, because it may find repetitions at least e.g. in the headers of the files or of the file sections. If there are similar files, then there are chances that lrzip will find repetitions between files, even if a traditional compression would not find repetitions inside a single file. If de-duplication is possible, then that would also be much more efficient than enabling the compression option of the tape drive.
deleted 7y ago
[deleted]
basicplus2 7y ago
Ok now i am embarressed.. I was out by factor of 10... i am getting 50Mbps.. copying NAS to tape For what its worth.. Network Router: TG789vas v2 NAS: Synology DS1815+ Switch: (for Server, Tape Drive, Tape Library & Their Associated UPS ) Airpho Gigabit AR-GS108 Server: X3650 M3 Running Windows 2012 R2 Tape Library: IBM TS3100 3573 L2U Tape Drive: IBM LTO6 8Gib Fibre Channel 35P1624 Feature Code 8348 Tape Drive Fibre Channel Card: Avago AFBR-57F5PZ Server Fibre Card: Emulex LPE12002 Using NO compression I understand the new IBM LTO 8 Drives can get up around 750 to 800Mbps

merb 7y ago

well probably with compression

jolmg 7y ago
I wonder if the 300MBps figure might also be with compression.
- adrian_b 7y ago
  No, the LTO-7 transfer speed is 3 Gb/s a.k.a. 300 MB/s without compression. The compression in drive may be useful for automated backups, but if you use the tape for an archive of files selected by yourself, it is better to disable the drive compression. If you have compressible files, you can compress them with better algorithms on the computer, before storing them on the tape.
  - merb 7y ago
    > you can compress them with better algorithms on the computer is that always true? what if I have dozen's of pdf's which are similar and compressed (most pdfs are)? wouldn't de-duplication also reduce the size? I mean with millions/billions/trillions of files of the same format.
    - adrian_b 7y ago
      For example on a computer you can use algorithms like lrzip, which search for very long distance redundancies (i.e. not in small data windows like traditional algorithms). This usually achieves a decent compression even on normally incompressible files, e.g. on collections of movies or on collections of PDF files, because it may find repetitions at least e.g. in the headers of the files or of the file sections. If there are similar files, then there are chances that lrzip will find repetitions between files, even if a traditional compression would not find repetitions inside a single file. If de-duplication is possible, then that would also be much more efficient than enabling the compression option of the tape drive.

deleted 7y ago

[deleted]

basicplus2 7y ago

Ok now i am embarressed.. I was out by factor of 10... i am getting 50Mbps.. copying NAS to tape For what its worth.. Network Router: TG789vas v2 NAS: Synology DS1815+ Switch: (for Server, Tape Drive, Tape Library & Their Associated UPS ) Airpho Gigabit AR-GS108 Server: X3650 M3 Running Windows 2012 R2 Tape Library: IBM TS3100 3573 L2U Tape Drive: IBM LTO6 8Gib Fibre Channel 35P1624 Feature Code 8348 Tape Drive Fibre Channel Card: Avago AFBR-57F5PZ Server Fibre Card: Emulex LPE12002 Using NO compression I understand the new IBM LTO 8 Drives can get up around 750 to 800Mbps