8 ms·
Webcam Pulse Detector
- theschwa 14y agoThe paper that this is based on is also pretty fascinating: Eulerian Video Magnification for Revealing Subtle Changes in the World http://people.csail.mit.edu/mrub/vidmag/ http://people.csail.mit.edu/mrub/vidmag/
- fulafel 14y agoPatented :'(
- deleted 14y ago[deleted]
- zapdrive 14y agoWell, in my opinion, a patent like this is well deserved. I could be wrong, but the researchers have spent significant time on it and have discovered/invented something really unique.
- fulafel 14y agothat's the tragedy of it. something cool is invented and now it'll be fenced off and buried for 25 years in all likelihood, and/or becomes part of a big patent portfolio.
- deleted 14y ago[deleted]
- riquito 14y agodoesn't a patent imply that you must let other people use your idea in exchange of a fair price?
- shabble 14y agoICBW, but no, I don't think it does, except it perhaps a narrow set of circumstances. Compulsory Licensing[1] is maybe what you're thinking of, but from what I can tell seems to apply mostly to drug patents, or things {the,a} government wants from you. It has a wider applicability in copyrighted forms of IP, I believe. Patents that are part of some organised standard are often required to be placed under 'FRAND[2] (Fair, reasonable, and non-discriminatory)' compulsory licences to allow for interoperability whilst still allowing the patent holder to receive (reasonable) royalties if they wish. [1] https://en.wikipedia.org/wiki/Compulsory_licensing https://en.wikipedia.org/wiki/Compulsory_licensing [2] https://en.wikipedia.org/wiki/Reasonable_and_non-discriminatory_licensing https://en.wikipedia.org/wiki/Reasonable_and_non-discriminat...
- DannyBee 14y agoIt would be more correct to say that "patents that their owners contribute to some organised standard ..." If I add a patented process to an important standard, but I don't own the patents, you still don't get those patents just because they are part of some important standard.
- mikeash 14y agoNope.
- lloeki 14y agoNo, a patent implies that you publicly disclose the knowledge behind your discovery immediately, in exchange for the property of this knowledge being guaranteed† to be yours for a limited time, and its use guaranteed to become free when this time runs out. The alternative is not to disclose it, with the risk for you that nobody will reverse engineer or discover by themselves, or the risk for everyone else that this knowledge could be lost forever. † pending approval, and unless successfully challenged in court (where the patent applies).
- DannyBee 14y agoNo. In fact, patents are exactly the opposite. They only grant the right to exclude others from doing something. So if i own a patent on X, it gives me the right to prevent others from doing X. Even if i license my patent on X to you, it does not necessarily mean you can do X, because doing X may also require other patents that my patent is an extension of. In other words: Imagine we have patented processes, each building on the last. Patent A covers doing thing one Patent B covers doing thing one, then thing two Patent C covers doing thing one, then thing two, then thing three. Granting you only the right to perform patent C does not enable you to perform the process described by patent C, you'd still need licenses for patent B and patent A to do that.
- drpgq 14y agoWhat's exactly patented? I remember earlier papers on pulse detection than the one on the page.
- nightpool 14y agoPrevious discussion: http://news.ycombinator.com/item?id=4062216 http://news.ycombinator.com/item?id=4062216
- gluxon 14y agoWhat in the world? Is this magic?
- deleted 14y ago[deleted]
- AdamTReineke 14y agoOn each heartbeat, blood is pushed and makes the skin nearly unperceivably redder. By watching for and tracking this subtle change, you can extract a heartbeat.
- huhtenberg 14y ago> ... unperceivably redder But why is he analyzing the green channel then? :)
- mkopinsky 14y agoLook at the absorption spectra at http://omlc.ogi.edu/spectra/hemoglobin/index.html http://omlc.ogi.edu/spectra/hemoglobin/index.html. Green is ~510nm, red is ~650nm, blue is ~475nm. The difference between the absorption of Hb and HbO2 in the red range is the reason why pulse oximeters use red. In this case, we don't care about differentiating oxy- vs. deoxy-hemoglobin, we just care about the total absorption. Since more light is absorbed at green than at red, it will show more of an effect with pulse. I am not confident in this explanation, and still don't know why green over blue.
- acuozzo 14y ago> I am not confident in this explanation, and still don't know why green over blue. I'm not sure either, but I can tell you that if you examine digitized (RGB) 35mm film -- across all 35mm film stocks -- the blue channel is the most noisy. So my guess is: He might have chosen green over blue due to the blue channel being noisier.
- 14y ago
- dyno12345 14y agoI want to point it at crowds and get an aggregate crowd-pulse rate! Measure the excitement!
- toomuchtodo 14y agoI expect to see this used by DJs, where the momentum of the music is controlled by the crowd.
- acgourley 14y agoNeed way more light than that for a standard camera... now, maybe with an IR camera...
- toomuchtodo 14y agoPerhaps stage lighting could be used to illuminate the crowd...green lighting perhaps? :)
- hcarvalhoalves 14y agoHow precise is this, do we have data? I'm guessing it depends on the refresh rate of your webcam.
- pokpokpok 14y agoit should still be very accurate though right? and so decently precise over a period of time?
- nl 14y agoIt's precise enough for the application. Webcams typically have a 15-30 fps framerate. Heartrates are typically 30-200 bpm (~= 0.5 to 3.3 bps).
- vacri 14y agoThe duration of the pulse is much shorter than the beat, though. Should still be visible at that framerate, just noting that pulses aren't sinewaves :)
- afhof 14y agoIt seems that the Nyquist-Shannon sampling rate would be too low for the results to be accurate.
- Qantourisc 14y agoNo ? The frequency needs to be at-least double this seems the be the case. However webcam noise and the algorithm might increase the need.
- dr_ 14y agoInteresting. There was a Rock Health company that created an app using this technology. The app is called Cardiio. I know the founders were from MIT/Harvard but can't recall if they were the same people who conducted this research.
- pstuart 14y agoAdd some software to do expression analysis a la Paul Ekman [1] and one has a remote non-invasive "lie detector". [1] https://www.paulekman.com/ https://www.paulekman.com/
- sagarun 14y agoJust like lie to me
- timothybone 14y agoThis looks great for a music performance stunt -- the audience doesn't know but the DJ rigged up a webcam as a trigger!
- jacobjbernstein 14y agoAwesome. Could open up a whole field of applications.
- john2x 14y agoLike allow robots to detect if something is alive or dead. :D
- tamersalama 14y agoI haven't been amazed for a while. Thank you.
- leed25d 14y agoGreat App for poker players
- ndr 14y agoImagine it integrated in Google Glass...
- dlgeek 14y agoHas anyone been able to get it to work? Whenever I try to open the stats display, I get: OpenCV Error: Assertion failed (p.checkVector(2, CV_32S) >= 0) in polylines, file /tmp/buildd/opencv-2.3.1/modules/core/src/drawing.cpp, line 2064
- Inufu 14y agoI have the same problem and have opened an issue: https://github.com/thearn/webcam-pulse-detector/issues/1 https://github.com/thearn/webcam-pulse-detector/issues/1 Maybe somebody that knows more about OpenCV than I do can figure out what's wrong.
- dlgeek 14y agoI did a git pull this morning, and it's working now.
- shabble 14y agoworks for me on OSX 10.7.5, with opencv @2.4.4_3+python27 installed via macports. I did have to downgrade to the ffmpeg (ffmpeg @1.2_1+gpl2+nonfree) port (from ffmpeg-devel) due to build errors in opencv, but worked ok after that. Couple of the openMDAO packages didn't install either, but didn't seem to harm anything.
- Osiris 14y agoThere is already an Android app[1] that does something similar. You put your finger up to the rear-camera and it detects your heart rate. [1] https://play.google.com/store/apps/details?id=si.modula.android.instantheartrate&hl=en https://play.google.com/store/apps/details?id=si.modula.andr...
- chewxy 14y agoIt works differently. This one works by magnification of tiny changes (colour, movement, etc) See also: http://people.csail.mit.edu/mrub/vidmag/ http://people.csail.mit.edu/mrub/vidmag/
- lucaspiller 14y ago[Not a Python user] What is OpenMDAO and how do I install it on OS X?
- AUmrysh 14y agoThis might work: http://openmdao.org/forum/questions/548/how-do-i-install-openmdao-on-os-x-to-an-existing-virtual-env http://openmdao.org/forum/questions/548/how-do-i-install-ope...
- nu2ycombinator 14y agoIs there a demo link for this application?
- mikaelf 14y agoSo strange that tye dont put up a live demo!
- fomojola 14y agoIts a native app: hard to have a live demo for a native app.
- addandsubtract 14y ago@shit_hn_says
- masonhensley 14y agoI haven't tried it out, but give this a shot it was linked on the original research paper's site[1]: http://videoscope.qrclab.com/ http://videoscope.qrclab.com/ [1]http://people.csail.mit.edu/mrub/vidmag/ http://people.csail.mit.edu/mrub/vidmag/
- LAMike 14y agowhat if someone created passwords based off of your brainwaves (assuming every brainwave is unique as a fingerprint)
- MasterScrat 14y agoThe concept of "passthoughts" has been discussed recently. http://abcnews.go.com/blogs/technology/2013/04/passthoughts-brainwave-based-passwords-a-reality/ http://abcnews.go.com/blogs/technology/2013/04/passthoughts-...
- vacri 14y agoIt'll be interesting to see how robust that is against different levels of alertness. I clicked through but couldn't see any info on using it on tired people - and your EEG changes significantly with alertness level. Depends on what they're measuring though.
- Swizec 14y agoCool fact, a Slovenian company that is now SF based has made this tech into an iPhone app a few months ago. -> http://www.azumio.com/apps/cardio-buddy-2/ http://www.azumio.com/apps/cardio-buddy-2/ I really like their apps and I'm quite proud that they originate from my neck of the woods.
- deleted 14y ago[deleted]
- huhtenberg 14y agoIt's a nicely designed app, but it doesn't work that well. Told me I had 60, 62, 61, 59... BPM when in fact it was over 75.
- runeb 14y agoGive it a video feed from a political debate and live-tweet the politicians pulse on different topics. I foresee a future of politicians sporting bangs and bob cuts.
- regularfry 14y agoThey're already so heavily made-up for the cameras I would be surprised if this worked.
- evan_ 14y agoNecks might not be, or hands. This would probably be a bad metric though, you might accidentally be selecting for sociopathic traits or something which might be undesirable in a politician.
- mikaelf 14y agoWhy isn there a live demo?
- tocomment 14y agoThis would be an awesome application for google glass! Does anyone know if it's possible? Imagine being able to look at someone and know their pulse. You'd have a wearable lie detector.
- pathdependent 14y agoI haven't downloaded this yet, but I certainly will. If it is accurate and reasonably precise (yea, what does that mean?), I'd like to have it running in the background, gathering data as I work, while also gathering statistics about my work. I, like most of the people here, am a productivity junky. I wonder if a heightened pulse could indicate mounting stress, which necessitates a break. Sure, I have other machinery that could indicate mounting stress -- like my mind -- but the quantitative, off-loaded metric shifts responsibility in a way that could be helpful. "I'm not really stressed," says me to my brain. "No, your heart rate is quite high," says my computer to me.
- evan_ 14y agoYou could get better results with a Bluetooth pulse monitor.
- mkopinsky 14y agoThat probably requires wearing something, potentially on your finger. Webcam is much less intrusive.
- evan_ 14y agoTypically a chest strap but yeah no disagreements here, it would be less convenient.
- shabble 14y agoTurns out that the fingertip pulse oximeter[1] I have works surprisingly well on a toe. Probably only applicable if you work from home though. [1] http://www.nonin.com/OEMSolutions/WristOx2-Model-3150-OEM http://www.nonin.com/OEMSolutions/WristOx2-Model-3150-OEM
- hac 14y agoI've gotten this far trying to install this on Lion: brew install gfortran sudo easy_install scipy sudo port install opencv +python27 export PYTHONPATH=/opt/local/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/:$PYTHONPATH wget http://openmdao.org/releases/0.5.0/go-openmdao.py http://openmdao.org/releases/0.5.0/go-openmdao.py sudo python ./go-openmdao.py cd ~/Downloads/webcam-pulse-detector-master/openmdao-0.5.0 . bin/activate cd ~/Downloads/webcam-pulse-detector-master && python get_pulse.py Hope it's helpful to anyone else doing the same. OpenCV is segfaulting now, but I may update this later if I get it.
- hokkos 14y agoI got it working in ML with : brew upgrade brew tap homebrew/science brew install opencv brew install gfortran sudo easy_install scipy mkdir OpenMDAO cd OpenMDAO/ brew install wget wget http://openmdao.org/releases/0.5.0/go-openmdao.py http://openmdao.org/releases/0.5.0/go-openmdao.py export PYTHONPATH=/usr/local/Cellar/opencv/2.4.4a/lib/python2.7/site-packages/:/System/Library/Frameworks/Python.framework/Versions/2.7/Extras/lib/python/:/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/:$PYTHONPATH sudo python ./go-openmdao.py cd openmdao-0.5.0/ . bin/activate #get the project in webcam-pulse-detector I used the github app cd ../../webcam-pulse-detector/ python get_pulse.py
- indubitably 14y ago> brew install gfortran gulp. fortran?
- jedanbik 14y agoCool! Reminds me of this question on Stack Overflow: http://stackoverflow.com/questions/12416772/is-there-an-equivalent-of-the-matlab-idealfilter-for-python-in-scipy-or-other http://stackoverflow.com/questions/12416772/is-there-an-equi...