4 ms·

> SQlite requires real on-disk file You can run SQLite with an In Memory database, I use it quite a lot for unit tests. https://www.sqlite.org/inmemorydb.html

> SQlite requires real on-disk file You can run SQLite with an In Memory database, I use it quite a lot for unit tests. https://www.sqlite.org/inmemorydb.html https://www.sqlite.org/inmemorydb.html

heftig 3y ago
I think that point is about it not supporting streaming compression where the output of the packer is immediately fed into something like a pipe or a TCP connection. You can do this with both tar and ZIP. If all you have is SQLite, you need to fully create the local database (be it in a file or in memory) before you can transmit it somewhere else to be stored or unpacked.
0x457 3y ago
Yes, but I think they meant something like this: pack archive | ssh host2 pack extract Which is a weird gripe - in this use case, `tar` makes most sense to use. It's not like this format claims to be a full replacement for tar or anything close to that.
- theamk 3y ago
  That's exactly what they do - they explicitly call out this format as replacement to tar and zip at least: > Most popular solutions like Zip, gzip, tar, RAR, or 7-Zip are near or more than three decades old. While holding value for such a long time (in the computer world) is testimony to their greatness, the work is far from done. > Pack tries to continue this path as the next step and proposes the next universal choice in the field.
  - 0x457 3y ago
    Oh, for some reason I thought they promote it as archival container for situations with a lot of files.
    - OttoCoddo 3y ago
      Yes, I am. Pack can hold millions of files with no problem. One field in which it shines is that, aside from being fast at processing large amounts of data, it can process many small files much faster than similar tools or even many popular file systems. About piping, it can be done, and it is on my list. I will finish features based on their popularity and making sense. As Pack has random access support, you can choose a file in a big pack, and it can stream it out to the output. It is already able to unpack partially to your file system (using --include="file path in pack"); streaming/piping it would not be a problem.
- deleted 3y ago
  [deleted]

> SQlite requires real on-disk file You can run SQLite with an In Memory database, I use it quite a lot for unit tests. https://www.sqlite.org/inmemorydb.html https://www.sqlite.org/inmemorydb.html

heftig 3y ago

I think that point is about it not supporting streaming compression where the output of the packer is immediately fed into something like a pipe or a TCP connection. You can do this with both tar and ZIP. If all you have is SQLite, you need to fully create the local database (be it in a file or in memory) before you can transmit it somewhere else to be stored or unpacked.

0x457 3y ago

Yes, but I think they meant something like this: pack archive | ssh host2 pack extract Which is a weird gripe - in this use case, `tar` makes most sense to use. It's not like this format claims to be a full replacement for tar or anything close to that.

theamk 3y ago
That's exactly what they do - they explicitly call out this format as replacement to tar and zip at least: > Most popular solutions like Zip, gzip, tar, RAR, or 7-Zip are near or more than three decades old. While holding value for such a long time (in the computer world) is testimony to their greatness, the work is far from done. > Pack tries to continue this path as the next step and proposes the next universal choice in the field.
- 0x457 3y ago
  Oh, for some reason I thought they promote it as archival container for situations with a lot of files.
  - OttoCoddo 3y ago
    Yes, I am. Pack can hold millions of files with no problem. One field in which it shines is that, aside from being fast at processing large amounts of data, it can process many small files much faster than similar tools or even many popular file systems. About piping, it can be done, and it is on my list. I will finish features based on their popularity and making sense. As Pack has random access support, you can choose a file in a big pack, and it can stream it out to the output. It is already able to unpack partially to your file system (using --include="file path in pack"); streaming/piping it would not be a problem.
deleted 3y ago
[deleted]