3 ms·
I used a similar test when I was picking an MP3 encoder to use when ripping my CDs for use on a portable device in the early '00s, back when size mattered. Mine
by tzs 11y ago
I used a similar test when I was picking an MP3 encoder to use when ripping my CDs for use on a portable device in the early '00s, back when size mattered. Mine wasn't quite "A X B", though. I wonder if that makes a difference?
Mine was "A X not-X B". I had a command line program that I could run and give two files, the reference file (typically a straight uncompressed rip from the CD) and a test file, typically an MP3 made from the reference file.
My program would then conduct a run of N trials. For each trial, it would assign the reference file as file A, the test file as file B, and it would randomly assign either the reference or test as file X. There were buttons I could press to listen to file A, file B, file X, or the file that was not file X. When I thought I had figured out whether X was A or B, I could signal my choice, and the next run would start. At the end, it would tell me how many I had gotten right.
To make sure I wasn't picking up clues from any slight delay from increased overhead in starting playing an MP3 file compared to starting a wave file, the program tossed in a random delay before executing a play command.
If I were doing this again, I think I would also toss in some minor randomization of the volume level on playback.
Anyway, the results were about what I expected. I do not claim to be particular astute at subtle audio listening, and found that the LAME encoder at 128 kbps was fine.
I was able to easily hear problems with BladeEnc at that bitrate. For instance, the opening piano chords of Cat Steven's "Morning Has Broken" just completely disintegrated with BladeEnc. I could also hear a problem with the trumpet on Dire Straits "Your Latest Trick". It's hard to describe, but if I were to compare it to being hit in the face with a baseball bat, the original and the LAME MP3 were like getting hit with a solid bat, and the BladeEnc MP3 was like getting hit with a hollowed out bat...the shell was there, but it couldn't do much damage.
When I say I could hear these problems, I mean that I could pick out the MP3 with BladeEnc every time in repeated runs of 20 trials when I was testing with those two tracks.