4 ms·
Cool project! As many games lack APIs, you could potentially analyze the raw audio and the graphics in real time, and use machine learning for detecting certain
by iverjo 10y ago
Cool project! As many games lack APIs, you could potentially analyze the raw audio and the graphics in real time, and use machine learning for detecting certain events, such as goals in rocket league
- StavrosK 10y agoHmmm, good idea, I didn't think of analyzing the sound. You can pretty easily tell when the "boom" goal sound plays, but not who scored. Maybe you can tell the latter by reading the screen, though. I will have a play when I get back home, although I still need to find a quick method to take screenshots in Windows.
- jdironman 10y agoBrace yourself, Ctrl+Print Screen. I'm just messing with you, I don't know a quick method myself.
- daeken 10y agoThis one is actually way easier than Super Hexagon! You can use a memory cheat tool to look for the current scores, then watch for changes in those addresses. I'd be happy to hunt that down and write up an implementation if you want; I'd love to have the Hue lights in my theater change for Rocket League.
- StavrosK 10y agoThat's actually a great idea! Do you want to email me? My email is in my profile.
- deleted 10y ago[deleted]
- nsedlet 10y agoI've been working on a weekend project to make lights that react meaningfully to music, by taking into account beats and chords. Here's a video of it: https://www.youtube.com/watch?v=h5sRgSmRGpg https://www.youtube.com/watch?v=h5sRgSmRGpg It uses chordify.net to extract the beats and chords from the song. Code is here: https://github.com/nick264/music-processor-master https://github.com/nick264/music-processor-master
- StavrosK 10y agoThat looks fantastic, how do you synchronize the music with the lights? Presumably chordify doesn't return time information?
- nsedlet 10y agoYes Chordify has time information - it's pretty accurate too, and works for folk, rock, classical, whatever. It's just a matter of timing the lights with the audio output. My setup is a Raspberry Pi as a master, and an Arduino to talk to the lights (which is necessary because the RPi's pins are too slow to send signals to an addressable LED strip). The RPi sends chord and beats in real time as they happen, over USB. Every few seconds it syncs the light show clock with the audio player clock.