3 ms·

I've thought about it a little, it seems really hard. But that's a really interesting idea you have there. Are there any docs or blog posts or something you can

• jancsika 9y ago
  I think the server part would be pretty straightforward. For example, using Jack you could port the system outs (or Firefox outs) into something like Pure Data and do the decomposition there into the frequency/amp pairs. From there you could either send to an ssh tunnel or feed into whatever process is running on the server that sends messages to the client. On the client side, I'm not so sure. Keeping with Pure Data, you could instantiate in the background and have it listen on a localhost port, then forward the pairs and resynthesize them. If you want I can make a demo patch to show you what this sounds like.
  • tombh 9y ago
    Interesting. I've actually completely rewritten the app (see the webext-rewrite branch), so now the main code lives in a webextension (ie inside a tab). Researching, I can't unfortunately see any way to get the audio for a tab :( So we'd have to use your approach of connecting to the outside of Firefox somehow. So then the other thing is how to make it as convenient as possible to open up the audio connection. It's gonna have to be something like `ssh texttop -p1234` for the imagery and `texttop_audio_client.sh -p1235` for the audio? There's no way to combine them I don't think?
    • jancsika 9y ago
      So when you do `ssh texttop -p1234` how do the mouse movements and clicks get sent from the client to the server?
      • tombh 9y ago
        Just through SSH, they're essentially identical to keyboard input, just wrapped in different ANSI escape codes.