3 ms·

Incredible separation, I don't think it's attainable by any other means. Should be super useful for speech in noisy environments. I have a question though, is

Incredible separation, I don't think it's attainable by any other means. Should be super useful for speech in noisy environments. I have a question though, is capturing lateral movements of a single spot on the instrument enough to represent how it sounds for a human ear? I think it's equivalent to a polarizer filter as it doesn't seem to be capturing depth axis vibrations.

infogulch 4y ago
> it doesn't seem to be capturing depth axis vibrations Good point, the paper mentions x-axis and y-axis, but doesn't mention z-axis. Maybe depth vibrations could be resolved as changes to the interference pattern?
- pbhjpbhj 4y ago
  Do human ears resolve sound in more than one dimension? I've always considered that, per ear, we only get a sequence of compressions and rarefactions on the ear drum, that other aspects of hearing are through combination or 'cheating' (skin sensitivity and such). So, would it matter?
  - infogulch 4y ago
    No, but a thing vibrating in any dimension will still produce sound waves.
  - taeric 4y ago
    You can pinpoint with your two ears where sound is coming from, fairly well. Takes some training, of course. That said, I get the impression this is more complicated than the autocorrelation of multiple sensors?
  - kimburgess 4y ago
    There’s binaural localisation from phase and amplitude differences, but importantly also monoaural cues from frequency response. Your pinna act as a set of directional filters - which is part of why some binaural recordings can quite literally feel as though they’re in your head. What’s interesting with this is that while you can’t get those directional filters, you could use a system like this to provide 3 or more ‘sensors’ (eg the chip packet demo) within a scene and isolate signals the same way as an array mic.
jcims 4y ago
These example audio at the bottom. Seems the answer is no. But you could potentially use it as a means to isolate the sound from the recorded audio. You would have to synchronize the phases though because the optical speed of sound is c.
pishpash 4y ago
Be careful what you wish for, I can see a future where it's like EM today, the entire environment saturated with spread-spectrum (audio) noise and everyone has to wear a filtering+array gain device in their ear.

infogulch 4y ago

> it doesn't seem to be capturing depth axis vibrations Good point, the paper mentions x-axis and y-axis, but doesn't mention z-axis. Maybe depth vibrations could be resolved as changes to the interference pattern?

pbhjpbhj 4y ago
Do human ears resolve sound in more than one dimension? I've always considered that, per ear, we only get a sequence of compressions and rarefactions on the ear drum, that other aspects of hearing are through combination or 'cheating' (skin sensitivity and such). So, would it matter?
- infogulch 4y ago
  No, but a thing vibrating in any dimension will still produce sound waves.
- taeric 4y ago
  You can pinpoint with your two ears where sound is coming from, fairly well. Takes some training, of course. That said, I get the impression this is more complicated than the autocorrelation of multiple sensors?
- kimburgess 4y ago
  There’s binaural localisation from phase and amplitude differences, but importantly also monoaural cues from frequency response. Your pinna act as a set of directional filters - which is part of why some binaural recordings can quite literally feel as though they’re in your head. What’s interesting with this is that while you can’t get those directional filters, you could use a system like this to provide 3 or more ‘sensors’ (eg the chip packet demo) within a scene and isolate signals the same way as an array mic.

jcims 4y ago

These example audio at the bottom. Seems the answer is no. But you could potentially use it as a means to isolate the sound from the recorded audio. You would have to synchronize the phases though because the optical speed of sound is c.

pishpash 4y ago

Be careful what you wish for, I can see a future where it's like EM today, the entire environment saturated with spread-spectrum (audio) noise and everyone has to wear a filtering+array gain device in their ear.