4 ms·
Amazing - the meta concepts behind the "Descriptive Camera" are limited only by the imagination, the resolution of the sensing devices, the ubiquity/bandwidth o
by ghshephard 15y ago
Amazing - the meta concepts behind the "Descriptive Camera" are limited only by the imagination, the resolution of the sensing devices, the ubiquity/bandwidth of the data pipe, and the ability to manage/train the backend human workforce and maintain a consistent level of quality. I'm pretty certain, that within 3-5 years, a billion dollar company will emerge using the basic concepts captured by the "descriptive camera." That is, a remote sensing device feeding data into a human-backed work-management queue, and returning some type of structured higher-level processing of the remote-sensing device's data in close to real-time.
Just off the top of my head:
o Flora/Fauna identification
o Scene analysis (Car Crashes/Building Wreckages)
o Medical analysis
o Substance analysis
o Structural integrity review
o Online Translators. Today.
I'm pretty certain companies would be more than happy to pay $1000+ for 3-4 hours of a real-time translator than worked through a smartphone for business trips. Ubiquitous high bandwidth wireless (LTE)/High Resolution Mics/Cameras/smartphones are the enabling technologies which trigger this class of application.
- mbesto 15y agoMedical analysis I don't think I would rely on a description from a Mechanical Turk human for describing what they see in a pictue. Is that a tibia or a fibula?!?
- ghshephard 15y agoRight - you don't send to Mechanical Turk. You instead send it to a highly trained backend workforce, presumably highly skilled in the vertical that you are doing analysis on. And, it's not just a picture, but video/sound/other sensing. Who knows what the next advances in remote telemetry will be.
- anandkulkarni 15y agoIndeed, we do this kind of work today in MobileWorks, using exactly this fact. Once your workforce is skilled all kinds of new opportunities of this nature open up.
- ghshephard 15y agoNice. I guess we don't need to look too far to see that soon-to-be-billion dollar company then. Have you considered doing real-time feedback to a device that has remote telemetry (video/sound/pictures/etc...)?
- anandkulkarni 15y agoWe've done some work in this vein already, as a matter of fact: real-time communication between the crowd and cameras / robots. We're currently supporting a few fast camera-driven smartphone applications that developers have built on the platform. I think what you're after, though, is more comprehensive integration: a remote telemetry system that has crowd intelligence baked into its circuits along several media, rather than one: analyzing simultaneous audio and video. I don't think this would be difficult for a developer to build, and it's a great idea.
- jrabone 15y agoYou can always require Mechanical Turks to pass qualification tests before they work on your HITs. There are also pre-existing qualifications like language and location. Of course, you need to pay well enough to get enough people to bother, but I imagine one could build a reasonably skilled workforce for many areas if your training material is good and you have an objective measure of the correct answer. This image description application is both perfect and terrible for Mechanical Turk though - it's an ideal task for a human rather than a computer, but it's also impossible to score the result objectively, so you'll have to pay everyone, all the time, or introduce another level of scoring - "Is this an accurate description?" "Does this description read fluently in $LANGUAGE" etc.
- mbesto 15y agoSo why is this "technology" ground-breaking then? I thought the point of this is that it that you 1. take picture 2. send over the internets 3. wait 3~6min to get a response on what the picture is about. Try scaling this out..."highly-trained" means poor scalability and lots of liability.
- ghshephard 15y agoThe technology isn't ground breaking - it's the combination of five or six technologies that are maturing at the same time that make this sort of application (real time human assessment of remote telemetry) work.
- JunkDNA 15y agoLots of US hospitals already use offshore radiology services who interpret various medical imaging tests taken in the overnight hours an report back the findings.
- emmelaich 15y agoI think the fauna/flora possibility is the strongest. There are lots of amateur gardeners (me:-) who would love to snap something and find out what it is (and hence how best to feed, water and shade it). I've often thought this should be possible with an android/iphone app.
- hammock 15y agoThis already exists- remember Google Goggles? Except in this implementation it's a little more hipster/artsy since it prints it out for you on receipt paper. Honestly, as a camera, it is a step backwards. Photographs efficiently capture many times more information than a simple text description. However, what it is a good demonstration of is the growing cognitive abilities of image-reading machines.
- anjc 15y agoIt's not trying to be more hipster by printing descriptions, the pictures are described via Mechanical Turk (from humans), this is why it's interesting.