4 ms·
I make holiday light shows with an open source program called XLights[0]. I'm sure you've seen the videos[1] of what people[2] can do. Usually the top comment
by jedberg 6mo ago
I make holiday light shows with an open source program called XLights[0]. I'm sure you've seen the videos[1] of what people[2] can do. Usually the top comment is "man that is cool but I wouldn't want to be their neighbor!" followed by "my neighbors love my light shows".
Creating the sequences is time consuming, and lot of people end up buying them or sharing them, but those are rarely as good as the ones you make for yourself.
Some folks have dabbled with using AI to create the sequences. I think the biggest issues are lack of training data and it's a very visual art, so there needs to be a better feedback between the text representation and the visual manifestation.
So if you're into using AI to make physical world things better, that would be a good place to look!
[0] https://xlights.org https://xlights.org
[1] https://youtu.be/enhhtPZMwCE?t=119 https://youtu.be/enhhtPZMwCE?t=119
[2] https://www.youtube.com/watch?v=z5dfpe_-Lgg https://www.youtube.com/watch?v=z5dfpe_-Lgg
- rationalist 6mo agoWarning: Do NOT click on [1] unless you have 25 minutes to spend transfixed on a video. Holy cow...
- jedberg 6mo agoIt takes about 10 hours per minute of song to make a sequence like that. Imagine if AI could help speed that up!
- bombcar 6mo agoI wonder if you can break down the sequences into segments (parts) and then the AI doesn't have to know how to control LEDs directly, but can instead put sequences together in accordance with the music. Maybe even process MIDI files somehow ...
- jedberg 6mo agoWhen we do it as humans, that's basically how we do it. We may have an overall idea for a theme across the song, but usually you're zoomed into a few seconds of music and adding light effects to it.
- bombcar 6mo agoI assume you've seen this https://news.ycombinator.com/item?id=47675446 https://news.ycombinator.com/item?id=47675446 which is related
- jedberg 6mo agoI had not, thanks! Interestingly, using FFT for this has been around for a long time, but combining it with transformers could have interesting new results.
- bombcar 6mo agoIt's interesting to me that you can have something like this that is "hard to build" but "easy to verify" - humans are really good at telling if something is "off" about the visualization.