6 ms·

When I saw the headline, I thought they might provide some more insights or maybe a novel ideas on how to overcome the latency problems. Very disappointing publ

When I saw the headline, I thought they might provide some more insights or maybe a novel ideas on how to overcome the latency problems. Very disappointing public relationship piece. I agree with others, latency will always be an issue over a distance. Thought Leadership ... ha ha ... I'm impressed by their leadership, I didn't expect latency and timing matters in Music. Yet, I'm also a novice and ignorant :)

reikonomusha 6y ago
I agree. At the end the conclusion is that it’s a “step in the right direction,” which was underwhelming as a piano student myself.
cush 6y ago
Yeah seems to just be for async music lessons.
pishpash 6y ago
Latency isn't physically solvable though. You'll need another network not the internet.
- klodolph 6y ago
  It’s more or less workable for local (metropolitan) networks.
- AmericanChopper 6y ago
  Over surprisingly short distances you run into issues with the speed of light. I did live sound engineering when I was younger, and worked in some studio recordings, and the conventional wisdom of the field is that musicians will begin to get distracted by latency greater than 10ms (which you have to care about when sending foldback to a musician, even when all of your equipment is in the same room). 10ms only gets light 2/3rds of the straight line distance between LA and NY. After you start accounting latency in infrastructure components, round trips, and the fact that cables aren't laid in straight lines between two users, the idea of live musical collaboration over even short distances starts to seem implausible.
  - bhj 6y ago
    The threshold is more like 3ms in my experience. When tracking vocals with headphones (no acoustic latency) anything higher will start feeling weird. This is also why Thunderbolt is preferred over USB for recording; you can get in and out of the CPU with effects much faster.
    - saurik 6y ago
      3ms by sound is only 3.36ft away.
      - AmericanChopper 6y ago
        Distance from the source of sound is actually very important in live performances. There have been some empirical studies on it, but it’s still something people often get rather opinionated about. There is a reason though that a small ensemble can play to the beat of something like a drum, but a large ensemble like an orchestra can’t. There’s plenty of writing about how orchestras lag behind conductors and how different sections of orchestras have to take their timing queues differently depending on where they’re situated. 10ms is what I was always told was the generally accepted threshold after which a musician start to experience increased difficulty as a result of the latency. Which largely aligns with my own experience with audio latency. From there the difficulty just keeps increasing, and the performance quality keeps degrading until at some point the musicians and the audience gives up.
        pmiller2 6y ago
        Thanks for writing this. I made the exact same point in another subthread, that 10ms is enough to mess with your brain. My only experience of it is when the audio and the visual out of sync by only about 10ms while watching something (I forget what). I can't watch anything like that for any real length of time, and I'm not even trying to play along.
        saurik 6y ago
- smolder 6y ago
  The established technique and one that many people have independently invented (myself included) is to chain the performers so one person hears only a metronome and each other person hears the previous members on the chain, forwarding along the audio in sync. As I've said elsewhere in the thread zoom is the wrong tree to bark up since these tools exist.
  - hunter2_ 6y ago
    As a musician, audio engineer, and software engineer, this just blew my mind. I can't believe I've never heard of or thought of this until now. But my primary focus has been non-audio software through the pandemic, so I haven't been actively trying to find solutions to this. Thank you. What applications would you recommend? Can it also do video, if not each link in the chain, at least one camera for the conductor (the node providing the metronome audio)? I realize the conductor would hear nobody at all, until playing back a recording from the end of the chain. Playback of said recording could begin after the song, or one measure into the song if there are no tempo/time changes (NINJAM style).
    - smolder 6y ago
      Someone else in this thread linked to software like I described: https://github.com/gwillen/solstice-audio-test https://github.com/gwillen/solstice-audio-test I will try to search around and get you some more examples. I can't remember off the top of my head what else worked that way.
    - pas 6y ago
      There's a sea shanty called the Wellerman that recently blow up on TikTok, and listening to it I was amazed how in sync the whole thing was despite all the layers. (It uses the same chain technique, but not "live".)
      - hunter2_ 6y ago
        Not-live overdubbing with perfect sync has been going on since the dawn of multi-track recording, although the popularity of including video from each layer (and DIY without a tracking engineer running the session) surged in popularity during the pandemic. With modern editing in a DAW, quantizing every phrase, word, or even syllable to the grid (or other layers) isn't difficult at all, just a bit tedious.
- MrStonedOne 6y ago
  I'm not sure on the percentage of assuming latency is only coming from the network/internet layer.
- Bud 6y ago
  Latency can be radically improved with SoundJack and tweaks to router settings, combined with audio equipment that introduces as little latency as possible. (i.e., don't use cheap USB mics.) Do all of this, and you can collaborate really well with people in the same geographic area as you. Of course you can't get around the speed of light, but you can do a lot better than the default setup or Zoom will give you.
  - saurik 6y ago
    Yeah: it is maybe worth noting explicitly for people that the speed of sound is sufficiently slower than the speed of light that two people laying instruments on opposite sides of a small stage can actually, if they have pickup mics and headphones using software carefully designed to minimize latency, be reasonably far apart over the Internet and have the same experience (such as between a bunch of musicians living in San Francisco, or all in the same region of Los Angeles).
    - Bud 6y ago
      Even about two orders of magnitude further than that, based on the work done so far. For instance, 22.5ms latency has been achieved at a distance of 900 miles (between the middle of Kentucky and Boston) with SoundJack and this setup: Both port-forwarded, both using Fast Music Boxes, both on fiber internet connections. First user had an MXL770 XLR mic and an Audient EVO4 interface. Second user also had an XLR mic and an audio interface. San Francisco is 7 miles wide.
    - pmiller2 6y ago
      I think you're underestimating the amount of latency that the human ear can detect. If the audio is as little as 10 ms out of sync, either way, someone will notice that.
      - kilnr 6y ago
        How does this impact large orchestras? Some of these musicians have got to be (way) over 10 m apart. Even 10 m at the speed of sound is almost 30 ms.
- layoutIfNeeded 6y ago
  You'll need faster-than-light communication actually.
Bud 6y ago
Professional classical musician here. The real problem here is latency, and I'm good friends with the folks who are working the hardest on that issue for real musicians wanting to collaborate with each other in real time. The most important work is being done with SoundJack. https://www.ianhowellcountertenor.com/soundjack-comprehensive-user-guide https://www.ianhowellcountertenor.com/soundjack-comprehensiv...
- kgarten 6y ago
  That's a great guide! Thanks for sharing. Much more what I would have expected from the parent link :)
- silasdavis 6y ago
  From the home page of sound jack site (https://www.ianhowellcountertenor.com/soundjack-real-time-online-music https://www.ianhowellcountertenor.com/soundjack-real-time-on...): > In practice, musicians ignore sound and watch a conductor when separated by such distances [of 100 feet]. It had never occurred to me that a conductor was a kind of clock at an approximately uniform distance from the performers.
  - sam_dal 6y ago
    Conductor is the metronome.
  - saberdancer 6y ago
    Uniform distance matters little for a conductor. Performers watch visual cues from him and speed of light is very fast (unlike sound). If you are 100 meters away, you have delay of about a third of a second if you use sound, but for light it will be a fraction of a millisecond.
    - croon 6y ago
      > Uniform distance matters little for a conductor. Performers watch visual cues from him and speed of light is very fast (unlike sound). Doesn't matter for the performers, but it matters for the conductor.

reikonomusha 6y ago

I agree. At the end the conclusion is that it’s a “step in the right direction,” which was underwhelming as a piano student myself.

cush 6y ago

Yeah seems to just be for async music lessons.

pishpash 6y ago

Latency isn't physically solvable though. You'll need another network not the internet.

klodolph 6y ago
It’s more or less workable for local (metropolitan) networks.
AmericanChopper 6y ago
Over surprisingly short distances you run into issues with the speed of light. I did live sound engineering when I was younger, and worked in some studio recordings, and the conventional wisdom of the field is that musicians will begin to get distracted by latency greater than 10ms (which you have to care about when sending foldback to a musician, even when all of your equipment is in the same room). 10ms only gets light 2/3rds of the straight line distance between LA and NY. After you start accounting latency in infrastructure components, round trips, and the fact that cables aren't laid in straight lines between two users, the idea of live musical collaboration over even short distances starts to seem implausible.
- bhj 6y ago
  The threshold is more like 3ms in my experience. When tracking vocals with headphones (no acoustic latency) anything higher will start feeling weird. This is also why Thunderbolt is preferred over USB for recording; you can get in and out of the CPU with effects much faster.
  - saurik 6y ago
    3ms by sound is only 3.36ft away.
    - AmericanChopper 6y ago
      Distance from the source of sound is actually very important in live performances. There have been some empirical studies on it, but it’s still something people often get rather opinionated about. There is a reason though that a small ensemble can play to the beat of something like a drum, but a large ensemble like an orchestra can’t. There’s plenty of writing about how orchestras lag behind conductors and how different sections of orchestras have to take their timing queues differently depending on where they’re situated. 10ms is what I was always told was the generally accepted threshold after which a musician start to experience increased difficulty as a result of the latency. Which largely aligns with my own experience with audio latency. From there the difficulty just keeps increasing, and the performance quality keeps degrading until at some point the musicians and the audience gives up.
      - pmiller2 6y ago
        Thanks for writing this. I made the exact same point in another subthread, that 10ms is enough to mess with your brain. My only experience of it is when the audio and the visual out of sync by only about 10ms while watching something (I forget what). I can't watch anything like that for any real length of time, and I'm not even trying to play along.
        saurik 6y ago
smolder 6y ago
The established technique and one that many people have independently invented (myself included) is to chain the performers so one person hears only a metronome and each other person hears the previous members on the chain, forwarding along the audio in sync. As I've said elsewhere in the thread zoom is the wrong tree to bark up since these tools exist.
- hunter2_ 6y ago
  As a musician, audio engineer, and software engineer, this just blew my mind. I can't believe I've never heard of or thought of this until now. But my primary focus has been non-audio software through the pandemic, so I haven't been actively trying to find solutions to this. Thank you. What applications would you recommend? Can it also do video, if not each link in the chain, at least one camera for the conductor (the node providing the metronome audio)? I realize the conductor would hear nobody at all, until playing back a recording from the end of the chain. Playback of said recording could begin after the song, or one measure into the song if there are no tempo/time changes (NINJAM style).
  - smolder 6y ago
    Someone else in this thread linked to software like I described: https://github.com/gwillen/solstice-audio-test https://github.com/gwillen/solstice-audio-test I will try to search around and get you some more examples. I can't remember off the top of my head what else worked that way.
  - pas 6y ago
    There's a sea shanty called the Wellerman that recently blow up on TikTok, and listening to it I was amazed how in sync the whole thing was despite all the layers. (It uses the same chain technique, but not "live".)
    - hunter2_ 6y ago
      Not-live overdubbing with perfect sync has been going on since the dawn of multi-track recording, although the popularity of including video from each layer (and DIY without a tracking engineer running the session) surged in popularity during the pandemic. With modern editing in a DAW, quantizing every phrase, word, or even syllable to the grid (or other layers) isn't difficult at all, just a bit tedious.
MrStonedOne 6y ago
I'm not sure on the percentage of assuming latency is only coming from the network/internet layer.
Bud 6y ago
Latency can be radically improved with SoundJack and tweaks to router settings, combined with audio equipment that introduces as little latency as possible. (i.e., don't use cheap USB mics.) Do all of this, and you can collaborate really well with people in the same geographic area as you. Of course you can't get around the speed of light, but you can do a lot better than the default setup or Zoom will give you.
- saurik 6y ago
  Yeah: it is maybe worth noting explicitly for people that the speed of sound is sufficiently slower than the speed of light that two people laying instruments on opposite sides of a small stage can actually, if they have pickup mics and headphones using software carefully designed to minimize latency, be reasonably far apart over the Internet and have the same experience (such as between a bunch of musicians living in San Francisco, or all in the same region of Los Angeles).
  - Bud 6y ago
    Even about two orders of magnitude further than that, based on the work done so far. For instance, 22.5ms latency has been achieved at a distance of 900 miles (between the middle of Kentucky and Boston) with SoundJack and this setup: Both port-forwarded, both using Fast Music Boxes, both on fiber internet connections. First user had an MXL770 XLR mic and an Audient EVO4 interface. Second user also had an XLR mic and an audio interface. San Francisco is 7 miles wide.
  - pmiller2 6y ago
    I think you're underestimating the amount of latency that the human ear can detect. If the audio is as little as 10 ms out of sync, either way, someone will notice that.
    - kilnr 6y ago
      How does this impact large orchestras? Some of these musicians have got to be (way) over 10 m apart. Even 10 m at the speed of sound is almost 30 ms.
layoutIfNeeded 6y ago
You'll need faster-than-light communication actually.

Bud 6y ago

Professional classical musician here. The real problem here is latency, and I'm good friends with the folks who are working the hardest on that issue for real musicians wanting to collaborate with each other in real time. The most important work is being done with SoundJack. https://www.ianhowellcountertenor.com/soundjack-comprehensive-user-guide https://www.ianhowellcountertenor.com/soundjack-comprehensiv...

kgarten 6y ago
That's a great guide! Thanks for sharing. Much more what I would have expected from the parent link :)
silasdavis 6y ago
From the home page of sound jack site (https://www.ianhowellcountertenor.com/soundjack-real-time-online-music https://www.ianhowellcountertenor.com/soundjack-real-time-on...): > In practice, musicians ignore sound and watch a conductor when separated by such distances [of 100 feet]. It had never occurred to me that a conductor was a kind of clock at an approximately uniform distance from the performers.
- sam_dal 6y ago
  Conductor is the metronome.
- saberdancer 6y ago
  Uniform distance matters little for a conductor. Performers watch visual cues from him and speed of light is very fast (unlike sound). If you are 100 meters away, you have delay of about a third of a second if you use sound, but for light it will be a fraction of a millisecond.
  - croon 6y ago
    > Uniform distance matters little for a conductor. Performers watch visual cues from him and speed of light is very fast (unlike sound). Doesn't matter for the performers, but it matters for the conductor.