7 ms·
Google Goggles
- Maciek416 17y agoCan anyone who has an Android phone who has tried this out for a few hours/days report on how well this works in practice? This looks pretty fantastic, especially if it can also read stuff like QR codes, etc.
- jimmyjim 17y agoIt works exactly as advertised. Delightfully accurately.
- deleted 17y ago[deleted]
- danfitch 17y agoTried it out searched a book cover...worked searched some text on a page worked... I wasn't going outside in 20 degree weather to check on the locations but from inside it kinda worked... not bad
- gchucky 17y agoJust gave it a test and it works pretty well. The image needs to be clear, but it was able to read the American Express logo off of my bill, a website address off of a keychain, and the Time Warner logo off of the remote. Edit: I tried an image of the Centrino and Vista logos side by side on my laptop and its top result was for a German book. It did get the Centrino logo in the Other results, though.
- amohr 17y agogoogle just started a campaign for "favorite places" google.com/favoriteplaces that uses QR - I assume these are not entirely unrelated.
- deleted 17y ago[deleted]
- harry 17y agoThis works really well. Picked out the KU logo and Swingline staplers perfectly. Choked on a big box o Jolly Ranchers. I'll prolly keep futzing with this for the rest of the day now.
- harry 17y agoTook a picture of a Halflife 2 poster I have in my office (http://store.valvesoftware.com/productpages/prints/product_HL2DogvStriderPoster.html http://store.valvesoftware.com/productpages/prints/product_H...) - not only did it return a strider battle youtube but also a wiki article on it.
- jfno67 17y agoWorked pretty good on logos around the office. Also great for business card, recognised all the data, but the add to contact was not selecting the most relevant data. It did great with QRCode too, but those were already easy to read. It's faster with Barcode Scanner.
- nym 17y agoWorked with a bottle of A1 steak sauce and a restaurant logo - although I think it used OCR actually for the 2nd one, but still impressive.
- nym 17y agoAugmented reality starts becoming more than just a pipe dream. Expect a lot more of this. P.S. Just went to ARdevcamp at Hacker Dojo last Saturday- it was a really exciting event. There were a lot more people than I expected, and lots of interesting discussion about this emerging space.
- jpwagner 17y agothere's some scary future uses for this. getting someone's number at a bar will be so much easier.
- pgbovine 17y agocell phone cams + face recognition + facebook ==> super creepy EDIT: since people post so many pics of themselves on facebook under all sorts of lighting conditions and angles, that might actually make face recognition somewhat feasible from a cell phone cam. of course, efficiently searching thru a corpus of millions of faces (each taken at several different angles) is an enormous technical challenge. i envision some app like Shazam being developed to recognize faces rather than songs ...
- talklittle 17y agoAnd the GPS info could narrow down the search in most cases.
- hristov 17y agoFor me this won't be very useful until someone develops the more crucial ass recognition technology.
- liuliu 17y agoI've done this kind of research 4 years ago based on general Internet image. That was a failure, but because of the rising of Facebook, it might work again. Someone already work on this for sometime: face.com.
- quilby 17y agoIve talked with one of the guys from face.com . They have put a lot of effort into making their system very fast and scalable. He told me that they built it from scratch and did not use OpenCV. Some parts were even written in assembly. Im pretty sure that this is the only web application that I use that has had major parts of it written in assembly.
- symesc 17y agoGoogle's relentless focus on speed within search is going to play perfectly in the realm of augmented reality. I anticipate a video version of this soon.
- Prolorn 17y agoDoesn't the "Places" feature count as video? http://www.google.com/mobile/goggles/#place http://www.google.com/mobile/goggles/#place
- Devilboy 17y agoIf I understand it correctly it just uses your GPS and magnetometer to work out where you are, it doesn't actually use the video data like it does for the still pictures you feed it.
- symesc 17y agoYes. But as per the other response here, I'm not sure it's using the video so much as the location and orientation to deliver results. I'd like to see a version, like the still-photos, whereby the search engine is translating in real time as new objects enter the frame. While I'm at it, I'd like it to perform these tasks with a T-800-style HUD. Droid indeed.
- fleaflicker 17y agothere's an Easter egg in the yelp iphone app that does something similar.
- thrdOriginal 17y agoFor those of us who may have done a couple searches on the Market wondering why this isn't showing up: google goggles requires Android version 1.6.
- jrockway 17y agoWhich Android products with Market don't have 1.6 yet?
- mbrubeck 17y agoAt least some of the HTC phones with "Sense" UI, like the Verizon Droid Eris, are still shipping with Android 1.5.
- jrockway 17y agoAh, the joys of unsupported third-party hacks :)
- thrdOriginal 17y agoThe Sprint HTC Hero which launched two months ago as well as T-Mobile's MyTouch both shipped with 1.5; the T-Mobile G1 can be upgraded to 1.5.
- benatkin 17y agoThe T-Mobile G1 was updated to 1.6 a couple of months ago. http://www.gsmarena.com/tmobile_g1_and_mytouch3g_get_android_16_donut_update-news-1154.php http://www.gsmarena.com/tmobile_g1_and_mytouch3g_get_android...
- simanyay 17y agomyTouches should be on 1.6 already. T-Mobile was pushing the update in October (November?).
- anguslong 17y ago
- GrandMasterBirt 17y agoimpressive. Yet another reason to get droid. I wonder if verizon will get google to make these tools exclusively for the droid only.
- nym 17y agoIt's already on the market available for phones other than Verizon's droid (tested on T-Mobile / G1).
- steveklabnik 17y agoReminds me of the first time I saw TinEye. Mobile is sweet, though.
- JCThoughtscream 17y agoOh, wow. With Google's backing, an AR future suddenly doesn't seem very far off at all.
- erikstarck 17y agoFirst there was the internet of Documents (www). Then there was the internet of People (social networks). And the internet of Places (maps, LBS, still happening). Soon we will see the internet of _Objects_ and something like Google Goggles will be the key driver. Documents -> People -> Places -> Objects. What's next?
- deleted 17y ago[deleted]
- wallflower 17y agoPerhaps not Google. Maybe Google and Facebook. Robert Scoble has an interesting perspective on the ambitions of Facebook. "Phase 1. Harvard only. Phase 2. Harvard+Colleges only. Phase 3. Harvard+Colleges+Geeks only. Phase 4. All those above+All People (in the social graph). Phase 5. All those above+People and businesses in the social graph. Phase 6. All those above+People, businesses, and well-known objects in the social graph. Phase 7. All people, businesses, objects in the social graph." http://scobleizer.com/2009/03/21/why-facebook-has-never-listened-and-why-it-definitely-wont-start-now/ http://scobleizer.com/2009/03/21/why-facebook-has-never-list...
- ntoll 17y agoDocuments -> People -> Places -> Objects. What's next? You should check out FluidDB from the FluidInfo guys... http://fluidinfo.com/ http://fluidinfo.com/
- selven 17y agoFully integrated augmented reality. Once we get mind-machine interfaces working, we could have an application that looks at every object around you, checks which one you're focusing on and somehow the entire Wikipedia article on it is already in your mind.
- bradgessler 17y agoThis is a great example of how Google could out-do the iPhone. The more non-trivial mobile applications have some processing that happen in the cloud. If Android phones could translate voice in real-time during a phone call and the iPhone could not, which phone would you consider buying? Realistically though Google wants their services and applications on all platforms; now if only the App store would approve these...
- paul9290 17y agoYeah but to me the quality of any manufacturer then Apple falls short. I've owned Windows Mobile, Andriod (HTC Hero) and now iPhone. iPhone for me is superior. Google i think needs to make their own device to match the quality/stability of the iPhone!
- stcredzero 17y agoYeah but to me the quality of any manufacturer then Apple falls short. If it had been written "qualaty" then it would've been a delicious Dilbert reference. (For more than one reason -- left as exercise, hint included.)
- deleted 17y ago[deleted]
- wallflower 17y agoI'm eagerly awaiting an AR app for language learning. See the native labels for objects like a VH-1 Popup video.
- eduardoflores 17y agowhy aren't they enabling this for PCs/Netbooks & webcams?
- ephermata 17y agoSpeculation: Because those aren't as mobile as a phone, and because Android needs something to differentiate itself from the iPhone. First seamless turn by turn directions, now this.
- migpwr 17y agoIt works surprisingly well! It also includes an option to rate the results at the bottom of the search results.
- mrtron 17y agoThe number of mashups I would like to do... Desperately awaiting an API.
- jodrellblank 17y agoOne step closer to photographing a sign in a foreign country and doing OCR followed by Google Translate, maybe followed by overlaying the translated text back on the sign. I think this would be a killer feature. I've never had much of a positive response when posting it as an idea previously - is it the case that if it really would be a killer feature, people would be all over the idea as well as the implementation, or is it possible to be a little supported idea that turns into a killer feature? (Edit: Or maybe it's just more a European thing where several foreign languages are a few hours drive in any direction?)
- roc 17y agoTo sell it to Americans, switch your example to restaurant menus. ;)
- jacobolus 17y agoI’ve seen a working demo of this in an iPhone app, a few months ago: it’s like some kind of dark magic to see the translated words show up in the still-moving picture. I don’t know if the guy has released his stuff yet though.
- litewulf 17y agoOne thought I had is that there really aren't enough different signs. In most foreign countries, I've been able to recognize signs for bathrooms and such, and most place names I can memorize (even if I can't read the language I can still think "okay, I want to go to the one with the squiggly second character"). I actually think this has high "cool factor", but have difficulty really coming up with uses. I think restaurant menus (as mentioned by my sibling comment) is probably the only real use, and even then knowing the name of the dish doesn't guarantee an item I'm able to eat. Also, when I go abroad, I am definitely not enabling data roaming. In some countries, buying a prepaid SIM requires lots of documentation which is difficult to do if wandering around doing tourist-y things, etc. (Sorry, I do think the idea is cool, I'm just trying to come up with reasons why its not the neatest thing since sliced bread)
- wglb 17y agoVery cool. It seems to work on the first few things I tried with my droid.
- cyen 17y agoreminds me of a much more practical version of some of the cool bits from the "sixth sense" interface that was presented at TED / all over the news awhile ago - http://www.pranavmistry.com/projects/sixthsense/ http://www.pranavmistry.com/projects/sixthsense/ . There, their prototype was also able to "look at" an object and return information about it immediately (e.g. you hold up a book in front of the camera, a processor recognizes it and pulls some relevant information, and the mini projector next to the camera projects the information back onto the book cover)
- quilby 17y agoWhere does the info for the landmark recognition feature come from? Is it from street view? I dont see how the landmark recognition feature could be useful. If you have a camera + 3g on your phone, you have a GPS.
- Retric 17y ago3g adds nothing to this. Any network of sufficient bandwidth would work.
- mbrubeck 17y agoThe latest iPod Touch has a video camera but no GPS. The same is true of various other non-phone handheld tablets. (Though landmark recognition might not be useful on those, since apparently it actually uses the GPS and compass as input...)
- natmaster 17y agoVery cool. I am interested in learning where they got their data from, and how they trained their image recognition algorithms.
- zooted 17y agohttp://images.google.com/imagelabeler/ http://images.google.com/imagelabeler/
- natmaster 17y agoPrevious work in the domain by others: Nokia: http://digital.venturebeat.com/2008/04/11/nokia-develops-navigating-system-based-on-image-recognition-landmarks/ http://digital.venturebeat.com/2008/04/11/nokia-develops-nav... (they use the golden gate as their example too) Also: http://www.mobvis.org/publications/MMT2007_Paletta.pdf http://www.mobvis.org/publications/MMT2007_Paletta.pdf, http://mirw09.offis.de/paper/What%20is%20That%20-%20Object%20Recognition%20from%20Natural%20Features%20on%20a%20Mobile%20Phone.pdf http://mirw09.offis.de/paper/What%20is%20That%20-%20Object%2... 'World browser': http://www.wikitude.org/ http://www.wikitude.org/ Using GPS together with the compass to get interesting results: 2006, Japan: http://www.nytimes.com/2006/06/28/technology/28locate.html http://www.nytimes.com/2006/06/28/technology/28locate.html and now there are iPhone applications http://www.youtube.com/watch?v=U2uH-jrsSxs&feature=player_embedded http://www.youtube.com/watch?v=U2uH-jrsSxs&feature=playe...
- cmelbye 17y agoDamn you for making me want an Android-based phone, Google! First free turn-by-turn navigation, now this. Argh. Once AT&T gets a good Android phone, I'm switching.
- jcapote 17y agoJust tried it on my G1; This works really well.