5 ms·

Same boat lol. Saw the open-source comments and decided to buy one so I could make a sheet-music reader that changes pages automatically using facial cues from

Same boat lol. Saw the open-source comments and decided to buy one so I could make a sheet-music reader that changes pages automatically using facial cues from an ESP32-CAM

chrisweekly 6y ago
What a great idea! How can I learn if/when you build that music reader app?
semi-extrinsic 6y ago
I'm slightly astonished (have been for a while) at the fact that no-one (as far as I know) have developed a Guitar Hero style e-ink sheet-music reader. Imagine how much easier you'd make life for kids learning how to play music! Software and hardware wise, it's got to be well within the realm of feasibility.
- scoopdewoop 6y ago
  You should check out Rocksmith. Its guitar hero with real guitar, pretty cool stuff. I don't see how a scrolling format like guitar hero would fit the slow refresh rate of an e-ink display, but perhaps you imagine something different.
  - yayr 6y ago
    Absolutely love that toy, unfortunately they stopped producing DLCs for it some time ago to do something else... I wonder what that is.
    - NikolaeVarius 6y ago
      Custom DLC is still going strong
    - Zero_Negative 6y ago
      They are working on RockSmith 2, you don't know this from me.
      - codeofficer 6y ago
        I remember a couple years ago getting Rocksmith for my ps4 and absolutely loving it. The controller mappings were a little unnatural in places but I did reasonably well with reading their notation/tab. Fast forward to when I tried to pick it up again a few weeks ago ... I can't read their notation/tab for the life of me. It's so confusing. Need to rewire my brain somehow.
  - viraptor 6y ago
    Or Yousician. I'm not a fan of the Rocksmith presentation which relies on small position differences and colours, but there are alternatives.
- delgaudm 6y ago
  I ordered my remarkable2 yesterday. Wrt sheet music, Not exactly what you were talking about but there was a great app called jammit that did something similar --playing along with sheet music with existing songs, and either isolating the instrument or muting it. The app just disappeared one day and the community reverse engineered the app and you can still get it under the facetious name "crammit" on Mac and windows. I found it very helpful to learn drum set notation.
- dbenn8 6y ago
  The Kala Ukulele app is a chords only version of this. It also includes videos showing how to play each section, and it plays accompaniment into your headphones as you play along. I found it super helpful, and I believe it's based on technology originally developed for teaching guitar. Not sure if it's open for programming your own songs in or not, and much of the library is behind a paywall.
- Polylactic_acid 6y ago
  ePaper does not refresh fast enough to do the falling notes thing you are thinking of. An ipad works infinitely better, costs less second hand (I got an ipad air 2 dirt cheap and its still getting updates) and it does more. Also my experience with using those things is that you would be better off spending the time to learn sheet music because once you get past twinkle twinkle little star, the falling note style videos don't work. You can't keep up with them live and paused they only show you the very short term future.
  - _AzMoo 6y ago
    Yep, you might as well just learn to read music the traditional way. It's very common for musicians to be reading the sheet music a long way ahead of the actual music being played, especially while playing fast and complex pieces. Having said that, an e-ink reader that could read visual cues would be awesome, but I feel it could be very frustrating unless it was incredibly smart. Maybe some kind of blink gestures might be useful.
    - Polylactic_acid 6y ago
      I think the best UI would just be a page change foot pedal. Not particularly difficult to implement and very reliable.
      - kawera 6y ago
        That's what many big-name classical pianists use, a pedal hooked to an iPad.
        dkarbayev 6y ago
        Why iPad though? I’ve seen a specialized electronic music sheet (seemingly based on e-ink) in some videos, I guess pages are flipped using a pedal since I didn’t notice any visible interaction with it to do so, e.g. https://youtu.be/oB-gF2Ncphg https://youtu.be/oB-gF2Ncphg
- xwdv 6y ago
  Probably because you could just make an application like that on an iPad...
- scrozier 6y ago
  Not sure about the Guitar Hero bit, but there’s a really nice, albeit very expensive, e-ink “sheet music” device. Product name is Gvido (not a typo). I’ve been using it professionally for about a year. Clunky UI, but hugely nicer than carting around books and sheet music. Form factor is more like traditional sheet music size than is an iPad, and it opens like a book—two side-by-side big, non-backlit pages. Turn pages with a Bluetooth pedal.
  - ableal 6y ago
    Thanks, link for convenience: https://www.gvidomusic.com/ https://www.gvidomusic.com/
- remarkableguy 6y ago
  you mean like this? not animated but up the same street. nothttps://www.padformusician.com/en/products/18-18-padmu-3.html#/1-version-single https://www.padformusician.com/en/products/18-18-padmu-3.htm...

Same boat lol. Saw the open-source comments and decided to buy one so I could make a sheet-music reader that changes pages automatically using facial cues from an ESP32-CAM

chrisweekly 6y ago

What a great idea! How can I learn if/when you build that music reader app?

semi-extrinsic 6y ago

I'm slightly astonished (have been for a while) at the fact that no-one (as far as I know) have developed a Guitar Hero style e-ink sheet-music reader. Imagine how much easier you'd make life for kids learning how to play music! Software and hardware wise, it's got to be well within the realm of feasibility.

scoopdewoop 6y ago
You should check out Rocksmith. Its guitar hero with real guitar, pretty cool stuff. I don't see how a scrolling format like guitar hero would fit the slow refresh rate of an e-ink display, but perhaps you imagine something different.
- yayr 6y ago
  Absolutely love that toy, unfortunately they stopped producing DLCs for it some time ago to do something else... I wonder what that is.
  - NikolaeVarius 6y ago
    Custom DLC is still going strong
  - Zero_Negative 6y ago
    They are working on RockSmith 2, you don't know this from me.
    - codeofficer 6y ago
      I remember a couple years ago getting Rocksmith for my ps4 and absolutely loving it. The controller mappings were a little unnatural in places but I did reasonably well with reading their notation/tab. Fast forward to when I tried to pick it up again a few weeks ago ... I can't read their notation/tab for the life of me. It's so confusing. Need to rewire my brain somehow.
- viraptor 6y ago
  Or Yousician. I'm not a fan of the Rocksmith presentation which relies on small position differences and colours, but there are alternatives.
delgaudm 6y ago
I ordered my remarkable2 yesterday. Wrt sheet music, Not exactly what you were talking about but there was a great app called jammit that did something similar --playing along with sheet music with existing songs, and either isolating the instrument or muting it. The app just disappeared one day and the community reverse engineered the app and you can still get it under the facetious name "crammit" on Mac and windows. I found it very helpful to learn drum set notation.
dbenn8 6y ago
The Kala Ukulele app is a chords only version of this. It also includes videos showing how to play each section, and it plays accompaniment into your headphones as you play along. I found it super helpful, and I believe it's based on technology originally developed for teaching guitar. Not sure if it's open for programming your own songs in or not, and much of the library is behind a paywall.
Polylactic_acid 6y ago
ePaper does not refresh fast enough to do the falling notes thing you are thinking of. An ipad works infinitely better, costs less second hand (I got an ipad air 2 dirt cheap and its still getting updates) and it does more. Also my experience with using those things is that you would be better off spending the time to learn sheet music because once you get past twinkle twinkle little star, the falling note style videos don't work. You can't keep up with them live and paused they only show you the very short term future.
- _AzMoo 6y ago
  Yep, you might as well just learn to read music the traditional way. It's very common for musicians to be reading the sheet music a long way ahead of the actual music being played, especially while playing fast and complex pieces. Having said that, an e-ink reader that could read visual cues would be awesome, but I feel it could be very frustrating unless it was incredibly smart. Maybe some kind of blink gestures might be useful.
  - Polylactic_acid 6y ago
    I think the best UI would just be a page change foot pedal. Not particularly difficult to implement and very reliable.
    - kawera 6y ago
      That's what many big-name classical pianists use, a pedal hooked to an iPad.
      - dkarbayev 6y ago
        Why iPad though? I’ve seen a specialized electronic music sheet (seemingly based on e-ink) in some videos, I guess pages are flipped using a pedal since I didn’t notice any visible interaction with it to do so, e.g. https://youtu.be/oB-gF2Ncphg https://youtu.be/oB-gF2Ncphg
xwdv 6y ago
Probably because you could just make an application like that on an iPad...
scrozier 6y ago
Not sure about the Guitar Hero bit, but there’s a really nice, albeit very expensive, e-ink “sheet music” device. Product name is Gvido (not a typo). I’ve been using it professionally for about a year. Clunky UI, but hugely nicer than carting around books and sheet music. Form factor is more like traditional sheet music size than is an iPad, and it opens like a book—two side-by-side big, non-backlit pages. Turn pages with a Bluetooth pedal.
- ableal 6y ago
  Thanks, link for convenience: https://www.gvidomusic.com/ https://www.gvidomusic.com/
remarkableguy 6y ago
you mean like this? not animated but up the same street. nothttps://www.padformusician.com/en/products/18-18-padmu-3.html#/1-version-single https://www.padformusician.com/en/products/18-18-padmu-3.htm...