7 ms·
Open Source Hardware Hearing Aid Part 1
- holy_city 7y agoThis is a really cool project. The one issue I see is that the Teensy isn't what you'd call power efficient (compared to some more domain-specific DSPs, that is). >That seemed incredibly expensive. I haven’t done much electronics, but digital signal processing doesn’t seem that expensive? The cost is in R&D, not just for human trials but for DSP engineer salaries. It's an extremely specialized skillset and the companies that hire for it look for PhDs most of the time. In particular, optimizing adaptive filtering to clock in the dozens of cycles per buffer with fixed point DSPs to maximize battery life, while providing features like feedback reduction, noise cancellation, working around the infamous "cocktail party" problem, with modern features like Bluetooth... all with audio fidelity on par with some serious audiophile gear. My understanding is that there are also some other market forces too like very long lifecycle management and low volumes for new products, but idk how real that is. Point is, I don't think those devices are really overpriced - at least no more than any other medical device paid for by insurance companies. EDIT: I'm reading some of their documents and a few things jump out at me. They mention supporting FFT/IFFTs on the platform. This stands out to me since doing that on a battery powered device is unusual. Firstly because it's not cheap in cycles, and secondly because useful FFTs require rather large buffers of memory which harms your latency, and may come at a premium. When I've seen them required (e.g, a codec), it was typically on a dedicated FPGA with the algorithm burned in, not running on the DSP.
- terminalhealth 7y agoThe question is how much these additional fancy features actually improve the product over what is feasible DiY? How much longer is the battery life?
- holy_city 7y agoI'm no expert in the field, but it's my understanding that those features are why modern devices allow people to hear in noisy environments. Feedback reduction especially, which is not easy to deal with (tl;dr, the mic/speaker are mechanically coupled, with a poor seal and loud enough environment you get feedback and the DSP has to compensate). And in terms of battery life, I don't know. I do know that most battery powered audio devices with DSP throw floating point math out the window from the get-go, and I haven't seen a job opening for DSP in hearing aids that didn't mention fixed point math in awhile. I don't know of any processors that fit the bill there however, those things usually have a proprietary IDE/debugger/flasher you need to pay for.
- azalemeth 7y agoI'm reasonably sure it would be possible to implement appropriate DSP Voodoo Magic (aka finite response filters) on the Teensy that does a _pretty_ good job of all of these things. However, I agree with the OP that it does have a fairly large number of shortcomings: -- The number of man-years that have been spent on commercial products is huge, and they provide a highly optimised solution in a competitive domain. My late grandfather had, in the 1970s, a hearing aid with feedback reduction powered by an analogue computer (aka "electronics") that hung around his neck. -- A lot of the tuning parameters of these algorithms really are hardware specific and would require quite a lot of tuning /iteration -- At the end of the day, a Teensy is a moderately large rectangular board that will not fit behind your ear, has nonzero power requirements, and is a general purpose CPU. A 3D printed case is an expensive way of making a plastic box to put it in. If you were going to go down the open hardware route, you'd start somewhere very different, with power efficient dedicated DSP units on a small, thick multilayer board milled to be a bit more ergonomic. A modern hearing aid needs a new battery every month or so, and is powered by a 0,54 g 1.4 V 180 mAh battery (that is a 4x6 mm cylinder [h x d]). You're not going to get anything like that for a general purpose CPU. Still, this is a fun project, and I commend people doing it. As ever with anything to do with the USA and healthcare products, however, I can't help but think that their efforts would be better spent trying to get universal healthcare. The cost to the NHS for two hearing aids, multiple fitting appointments included, is around £400.
- jdietrich 7y agoHearing aid processing chips are incredibly sophisticated and specialised - just check out the block diagram in this datasheet: https://www.onsemi.com/pub/Collateral/SA3291-D.PDF https://www.onsemi.com/pub/Collateral/SA3291-D.PDF That chip is doing graphic equalisation, multi-band dynamic range compression, noise cancellation, feedback cancellation, data logging and wireless communication with an absolute maximum power dissipation of 50mW. It's a $100 chip for good reason.
- jacquesm 7y agoThe costs of a chip have very little to do with what is in them. It's a $100 chip for a good reason: profits. Because if you can't hear then $100 extra is very little money. Once the first silicon samples are in and the numbers are large enough it is very rare to see a chip that would command such figures in other fields, there is no reason that I am aware of that would justify this price.
- rrss 7y ago> numbers are large enough How many people have hearing aids, though? Seems like the market for this would be much smaller than other things and therefore the price higher.
- shae 7y agoWhile writing this blog post I've discovered that way more people have hearing problems than actually buy hearing aids. The largest part is the expense, but another part is the stigma. No one wants to wear a hearing aid if they're under the age of forty or so.
- throwaway9298 7y ago50 yo. congentitally profoundly deaf person here. Cochlear implant fitted last month. My quality of life has been utterly transformed: I can't imagine what life would have been like if I had had one from birth. If appropriate for the patient, the healthcare system should skip the hearing aid and go straight for an implant. If you happen to be reading this, and have a hearing loss, explore cochlear implants whatever your age. Whilst I wish the OS hearing aid project every success, what we really need is open source implants - the pricing is even more insane than hearing aid technology and is relatively well understood. The existing, certified implants could be used, but with an OS/DIY processor - circumventing many of the potential certification issues.
- rrss 7y ago> This stands out to me since doing that on a battery powered device is unusual This is absolutely not true. I would bet that > 50% of all devices shipping with a digital signal processor are doing FFT/IFFT at some point. > useful FFTs require rather large buffers of memory Loads of realtime FIR filtering is implemented with overlap-add or overlap-save - i.e. block-based FFT/IFFT.
- cushychicken 7y agoPlus, many ffts actually benefit from fewer points and less bandwidth - especially in voice applications, where much of the spectral content is under 4kHz.
- aasasd 7y agoPretty sure that in my country Western imported hearing aids start around 300 or 500 dollars—mostly European ones. And afaik those aren't the ‘just blare at 5x the volume’ type but tuned by the audiologist to the patient's hearing profile. And they go behind the ear. 2000 bucks are the type with a dozen advanced effects, bluetooth connection to work as music player headphones, and adjustable with a remote or an app. So, people in the US might find it cheaper to order European aids or smuggle something from Canada. (BTW, afaik plane tickets cost way less if you buy them in the airport just before the flight.) ---- Also, personally I'd be wary of twiddling the params of a hearing aid since I'm not an audiologist nor any kind of doctor at all and don't know if my choice would cause more damage in the long term. And if audiologists mostly reside at hearing aid dealerships then I'm not sure they will just give you a chart of your hearing so you can walk home and tune your aid by it. Ah, and azalemeth's comment reminds me: if the board just has jacks for headphones then you can't even use the hearing charts without also knowing the frequency response for the headphones.
- jjeaff 7y agoIf it were that simple, people would be importing them and selling them already. Black market or not. But high end hearing aids take multiple in-person visits with experts for in-depth hearing tests and then impressions for a perfect fit, then hand adjusting to tune the fit and return visits to tune the sound and fit. The technology is probably not the most expensive part of high end hearing aids. It's the service.
- hadlock 7y agoMy eye doctor puts me in front of a bunch of lenses and then says "better... flip or worse?" over and over and we end up with a set of lenses. Without access to a trained doctor, at first glance (no pun intended) it seems like you could do a 95%+ job of fitting a hearing aid's sound profile using a better/worse UI on a phone app and some prerecorded sounds/speech samples. I have zero experience with hearing loss, though.
- aasasd 7y ago
- kcbanner 7y ago> No way I can get that kind of money, so I gave up on that idea. I'm curious if the Tympan solution has done this testing? What is the perceived downside to not doing human testing on what is presumably going to be a hobby project?
- shae 7y agoI asked Tympan about this, they said they've partnered with Boys Town National Research Hospital and with the National Institute on Deafness and Communication Disorders. Those two powerful partners are working on relaxing the laws some so that small companies/teams could create something like the Tympan. I'm still not sure if the Tympan is a "human use approved hearing aid" or if it's just for research purposes. Hopefully I'll have discovered that before I publish part 2.
- kcbanner 7y agoAh, interesting! Thanks!
- computator 7y agoThe solution to killing off outrageously-priced hearing aids is to leverage the smartphone. It has everything that's required to make an superlative hearing aid: excellent microphone, earphones, powerful CPU, and an all-day battery. A modern smartphone might not have a DSP but it has sufficient processing power to do the required audio processing. Many people who'd be embarrassed with visible hearing aids wouldn't mind walking around with AirPods or other visible Bluetooth earbuds these days. The hurdle is that the hearing aid manufacturers will be complaining to regulators that you can't sell a smartphone as a "medical device". The Apple AirPods with the "live listen" feature on iPhones (and iPads) is already being used by some people as a substitute hearing aid. You can use "live listen" with an actual hearing aid as well, but I've seen people using it with just AirPods and they seem to find it quite helpful. What's missing is the software to do the audio processing specific to that person's hearing loss. Plus overcoming the regulatory burden.
- ashildr 7y agoLatency.
- BrentOzar 7y ago> People who'd be embarrassed with visible hearing aids wouldn't mind walking around with AirPods or other visible Bluetooth earbuds these days. Had a relative who tried that with an app. The problem is that most folks still assume that if you've got headphones in your ears, you're listening to something else (not them.) Reactions varied from impatience (people who thought he was impolite for refusing to remove his headphones to focus on them) to anger (refusing to interact with him until he removed the headphones.)
- rassibassi 7y agoI agree that the smartphone could potentially be leveraged to do some audio processing in this context, but you have to consider the latency introduced by the forth and back over bluetooth. Not sure if such latency is a pleasent experience for the user.
- GregoryPerry 7y agoAnd the likely reason why this is not happening (in the commercial space at least) is FDA regulatory hurdles in having a product (and probably an entire company) shut down for making "unapproved" medical claims. I've got a set of Bose Hearphones, about $500, and which use the Bose Hear app. You can modify treble and bass but that's about it; even so if you are hard of hearing then the default iPhone sound profiles can be used to fine tune the in-ear audio and they work well as a low cost hearing aid. Same deal with my AirPods. Today Tim Cook could wave a magic wand and literally cure deafness for hard of hearing iPhone + AirPod users; ain't happening. No question Bose Hearphones with the Bose Hear app or AirPods with a complementing iPhone app could easily perform spectral analysis with an easy-to-use-equalizer, to increase and/or decrease the amplitude of specific areas of the auditory spectrum; this would be ideal for tinnitus patients and would without question put the entire hearing aid industry out of business. Current generation hearing aids are about $15 worth of analog parts that they are selling for thousands of dollars each, just by virtue of having invested in some horseshit FDA regulatory process when infinitely more capable technology has been available to hearing impaired individuals for well over two decades at this point. This is not complex, and what sucks about tinnitus is that it affects each person differently which in turn requires specific auditory tuning for each individual. But companies such as Bose or Apple that have the technology with more than sufficient computational horsepower to replace hearing aids simply refuse to do so, for whatever reasons that are likely FDA regulatory hurdle in nature. On a side note as to OP, $300 for a Teensy-based hardware platform with BT stack is f'ing outrageous, probably worse than what the actual hearing aid vendors are ripping off.
- imglorp 7y agoI wanted to applaud the hackability aspect here. Traditional aids are aimed at (1) old people who can't handle more than 4 buttons on a TV remote, who (2) are willing to accept whatever they're given and put up with inconveniences, and (3) don't notice their audiologist and aid vendor are kinda in cahoots to their detriment. There's all kinds of interesting things aid users might want to experiment with, once an audiologist gives them a profile of their hearing loss. Aids have programs that help for different situations, like crowded room, quiet conversation, etc, and the user may want to adjust those settings themselves.