5 ms·

I record and produce my own music as a hobby. Each project can easily reach gigabytes in size, and my biggest projects are eight gigabytes or so (eight drum mic

I record and produce my own music as a hobby. Each project can easily reach gigabytes in size, and my biggest projects are eight gigabytes or so (eight drum mics, guitar, bass, vocals, and synthesizers, all uncompressed 24/96 audio, often with a number of different takes). I go through HDDs very quickly. I know that for development and most uses bigger HDDs are unnecessary, but for media production these improvements are really valuable.

deleted 8y ago
[deleted]
randyrand 8y ago
Why not use FLAC? It gets 50-70% compression and is lossless.
- Paperweight 8y ago
  DAWs usually encode as WAVs for when you're working on stuff because it's faster. But it would be nice for them to losslessly compress your files down to FLAC when you're done and shut down the program! It would be interesting to have a media-friendly archive file format for the final tracks of completed projects that automatically compresses/decompresses WAVs as FLAC...and other raw data formats as their losslesss counterparts...closest thing I can find is zipx with wavpack.
  - PavlovsCat 8y ago
    > it would be nice for them to losslessly compress your files down to FLAC when you're done and shut down the program! Renoise does that. With software synths and sample-based instruments, the biggest chunk for me is always the vocals.. and I would have to have a lot of takes to get over 100mb. Of course, my music isn't the music people who record a bunch of live instruments make, it's not a fair comparison, but still, for my uses it's fine, and it's super fast. I wish there was an option to bake VST into songs, I would love to be able to share full songs as "source" (obviously it would have to be songs only made with freeware VST, but art is all about limitations etc. blah blah :)
    - Kye 8y ago
      You can attach zip files containing anything you want on Bandcamp. I put a few Serum presets in one EP.
- nineteen999 8y ago
  Audio mixing and mastering, particular with a lot of channels and hosted effects can be very CPU intensive task. As a general rule you wouldn't want to add compression/decompression to that process as well. Granted, the industry standard in this area (ProTools) is an absolute CPU hog to begin with, so it needs all the help it can get.
- golergka 8y ago
  When you have enough channels and plugins running in real time, you'd rather optimize for CPU rather than disk space.
  - loeg 8y ago
    Surely OP isn't working on all projects all the time, and could "archive" some in FLAC form?
    - colinthompson 8y ago
      My guess is that in terms of a time vs. money trade off, buying a new drive and shelving the old one is the preferred method of archiving. The maintenance required to convert all files to some compact format might be enough of a PITA (however minor), that it's simply more worth it to buy a new drive.
      - baroffoos 8y ago
        Would be good if the tools had an archive option that automatically saves all the files as flac and can decompress to wav again with a single button press.
        Kye 8y ago
        Reaper's Save As dialog will let you collect all samples and convert them with the project file. I wish all DAWs had that.
- rewgs 8y ago
  WAV is the standard, period. That won't change for the foreseeable future.
- soundwave106 8y ago
  Offhand I actually don't know of too many DAW programs that can record the individual tracks in FLAC format. Reaper does. Checking the Wiki (https://en.wikipedia.org/wiki/List_of_hardware_and_software_that_supports_FLAC https://en.wikipedia.org/wiki/List_of_hardware_and_software_...), it looks like Cakewalk Sonar does as well. But that leaves a lot of major players (Protools, Logic, Cubase, Ableton Live, FL Studio, etc.) that cannot. It's not something I personally would do because (as others imply) IMHO the CPU trade-off is not worth it. Usually I use a blend of plug-ins (which take up no space) and recorded hardware, consequently the amount per track ends up being more like 100-600MB and not gigabytes. This is rather manageable. However, I will note that sample based software synthesizers and sample packs can be huge these days, even despite in many cases lossless compressing being applied to the sample library. Omnisphere 2 for instance comes with a 60GB+ sample library (and that's before you add the add-ons like Moog Tribute). At the current extreme end, orchestral sample company Spitfire offers a string library (https://www.spitfireaudio.com/shop/a-z/hans-zimmer-strings/ https://www.spitfireaudio.com/shop/a-z/hans-zimmer-strings/) that is 183GB in size and a sampled piano that's a whopping 211GB compressed (https://www.spitfireaudio.com/shop/a-z/hans-zimmer-piano/ https://www.spitfireaudio.com/shop/a-z/hans-zimmer-piano/).
  - veridies 8y ago
    And that's why when I use Omnisphere (which I love, BTW), I send my projects to my best friend's computer; there's no way in hell I could fit that on my computer's internal SSD. Even the relatively small software instruments (I've been really into Soniccoture's Glass/Works, for instance) use up like 8 GB apiece.
- veridies 8y ago
  Basically what everyone else said. DAWs all prefer uncompressed WAV or AIFF, and it takes quite a bit of time to convert back and forth to FLAC. Plus, even if I did that I'd still have to use external HDDs, just cheaper ones.
pmoriarty 8y ago
With that much data, I am curious as to how you do your backups. Do you backup off-site at all?
- veridies 8y ago
  Not offsite, which I know I should. I use macOS, so I just have a Time Capsule set up with a giant HDD plugged into that for stuff I'm working on presently. Stuff I don't use actively I just make sure to put on two different HDDs in different places, and so I have two whole parallel sets of HDDs which I occasionally synchronize by hand. The whole system is very awkward, and I would be delighted if I really could rent reliable, trustworthy, offsite storage for a reasonable price.
  - thirdsun 8y ago
    You can. I've been using Arq [1] for years. You can select a storage provider of your choice (I use Dropbox), but Arq also provide its own cloud storage these days if you prefer to keep it as simple as possible. After the initial upload it's feasible even with large files since it of course only uploads incremental, block-level changes. I let it run on a daily schedule during the night. [1] https://www.arqbackup.com/ https://www.arqbackup.com/

deleted 8y ago

[deleted]

randyrand 8y ago

Why not use FLAC? It gets 50-70% compression and is lossless.

Paperweight 8y ago
DAWs usually encode as WAVs for when you're working on stuff because it's faster. But it would be nice for them to losslessly compress your files down to FLAC when you're done and shut down the program! It would be interesting to have a media-friendly archive file format for the final tracks of completed projects that automatically compresses/decompresses WAVs as FLAC...and other raw data formats as their losslesss counterparts...closest thing I can find is zipx with wavpack.
- PavlovsCat 8y ago
  > it would be nice for them to losslessly compress your files down to FLAC when you're done and shut down the program! Renoise does that. With software synths and sample-based instruments, the biggest chunk for me is always the vocals.. and I would have to have a lot of takes to get over 100mb. Of course, my music isn't the music people who record a bunch of live instruments make, it's not a fair comparison, but still, for my uses it's fine, and it's super fast. I wish there was an option to bake VST into songs, I would love to be able to share full songs as "source" (obviously it would have to be songs only made with freeware VST, but art is all about limitations etc. blah blah :)
  - Kye 8y ago
    You can attach zip files containing anything you want on Bandcamp. I put a few Serum presets in one EP.
nineteen999 8y ago
Audio mixing and mastering, particular with a lot of channels and hosted effects can be very CPU intensive task. As a general rule you wouldn't want to add compression/decompression to that process as well. Granted, the industry standard in this area (ProTools) is an absolute CPU hog to begin with, so it needs all the help it can get.
golergka 8y ago
When you have enough channels and plugins running in real time, you'd rather optimize for CPU rather than disk space.
- loeg 8y ago
  Surely OP isn't working on all projects all the time, and could "archive" some in FLAC form?
  - colinthompson 8y ago
    My guess is that in terms of a time vs. money trade off, buying a new drive and shelving the old one is the preferred method of archiving. The maintenance required to convert all files to some compact format might be enough of a PITA (however minor), that it's simply more worth it to buy a new drive.
    - baroffoos 8y ago
      Would be good if the tools had an archive option that automatically saves all the files as flac and can decompress to wav again with a single button press.
      - Kye 8y ago
        Reaper's Save As dialog will let you collect all samples and convert them with the project file. I wish all DAWs had that.
rewgs 8y ago
WAV is the standard, period. That won't change for the foreseeable future.
soundwave106 8y ago
Offhand I actually don't know of too many DAW programs that can record the individual tracks in FLAC format. Reaper does. Checking the Wiki (https://en.wikipedia.org/wiki/List_of_hardware_and_software_that_supports_FLAC https://en.wikipedia.org/wiki/List_of_hardware_and_software_...), it looks like Cakewalk Sonar does as well. But that leaves a lot of major players (Protools, Logic, Cubase, Ableton Live, FL Studio, etc.) that cannot. It's not something I personally would do because (as others imply) IMHO the CPU trade-off is not worth it. Usually I use a blend of plug-ins (which take up no space) and recorded hardware, consequently the amount per track ends up being more like 100-600MB and not gigabytes. This is rather manageable. However, I will note that sample based software synthesizers and sample packs can be huge these days, even despite in many cases lossless compressing being applied to the sample library. Omnisphere 2 for instance comes with a 60GB+ sample library (and that's before you add the add-ons like Moog Tribute). At the current extreme end, orchestral sample company Spitfire offers a string library (https://www.spitfireaudio.com/shop/a-z/hans-zimmer-strings/ https://www.spitfireaudio.com/shop/a-z/hans-zimmer-strings/) that is 183GB in size and a sampled piano that's a whopping 211GB compressed (https://www.spitfireaudio.com/shop/a-z/hans-zimmer-piano/ https://www.spitfireaudio.com/shop/a-z/hans-zimmer-piano/).
- veridies 8y ago
  And that's why when I use Omnisphere (which I love, BTW), I send my projects to my best friend's computer; there's no way in hell I could fit that on my computer's internal SSD. Even the relatively small software instruments (I've been really into Soniccoture's Glass/Works, for instance) use up like 8 GB apiece.
veridies 8y ago
Basically what everyone else said. DAWs all prefer uncompressed WAV or AIFF, and it takes quite a bit of time to convert back and forth to FLAC. Plus, even if I did that I'd still have to use external HDDs, just cheaper ones.

pmoriarty 8y ago

With that much data, I am curious as to how you do your backups. Do you backup off-site at all?

veridies 8y ago
Not offsite, which I know I should. I use macOS, so I just have a Time Capsule set up with a giant HDD plugged into that for stuff I'm working on presently. Stuff I don't use actively I just make sure to put on two different HDDs in different places, and so I have two whole parallel sets of HDDs which I occasionally synchronize by hand. The whole system is very awkward, and I would be delighted if I really could rent reliable, trustworthy, offsite storage for a reasonable price.
- thirdsun 8y ago
  You can. I've been using Arq [1] for years. You can select a storage provider of your choice (I use Dropbox), but Arq also provide its own cloud storage these days if you prefer to keep it as simple as possible. After the initial upload it's feasible even with large files since it of course only uploads incremental, block-level changes. I let it run on a daily schedule during the night. [1] https://www.arqbackup.com/ https://www.arqbackup.com/