13 ms·
This demo is nuts: https://youtu.be/UIZAiXYceBI?si=8ELqSinKHdlGlNpX https://youtu.be/UIZAiXYceBI?si=8ELqSinKHdlGlNpX
by milesward 3y ago
This demo is nuts: https://youtu.be/UIZAiXYceBI?si=8ELqSinKHdlGlNpX https://youtu.be/UIZAiXYceBI?si=8ELqSinKHdlGlNpX
- danpalmer 3y agoI literally burst out laughing at the crab.
- bogtog 3y agoThe crab was the most amazing part of the demo for me.
- dblitt 3y ago> For the purposes of this demo, latency has been reduced and Gemini outputs have been shortened for brevity. Seems like this video was heavily editorialized, but still impressive.
- nathanfig 3y agoDefinitely edited, pretty clear in some of the transitions. Makes me wonder how many takes were needed.
- htrp 3y agoSome poor AI / ML intern with a Stanford PhD probably spent an entire summer running these to get the take they needed.
- andrewprock 3y agoThe prompts were also likely different: video: "Is this the right order?" blog post: "Is this the right order? Consider the distance from the sun and explain your reasoning." https://developers.googleblog.com/2023/12/how-its-made-gemini-multimodal-prompting.html https://developers.googleblog.com/2023/12/how-its-made-gemin...
- huytersd 3y agoYou don’t know that. The responses in the video don’t line up. That blog post is just an alternative text prompt based version of what they showed on video.
- ACS_Solver 3y agoTo quote Gemini, what the quack! Even with the understanding that these are handpicked interactions that are likely to be among the system's best responses, that is an extremely impressive level of understanding and reasoning.
- CamperBob2 3y agoCalls for a new corollary to Clarke's Third Law. "Any sufficiently-advanced rigged demo is indistinguishable from magic."
- rvnx 3y agoMagic Leap!
- emaciatedslug 3y agoAnd for the development team it's predicated upon Hoffsteader's Law.
- quackery1 3y agoDoes it really need to have affectations like "What the quack!"? These affectations are lab grown and not cute.
- shepherdjerred 3y agoI liked them
- heyoni 3y agoYou missed the joke! Look at their username ;)
- shepherdjerred 3y agoI think that wasn't a joke and the poster is just using a throwaway account
- SamBam 3y agoWow, that is jaw-dropping. I wish I could see it in real time, without the cuts, though. It made it hard to tell whether it was actually producing those responses in the way that is implied in the video.
- natsucks 3y agoright. if that was real time, the latency was very impressive. but i couldn't tell.
- nuz 3y agoThis makes me excited about the future
- RGamma 3y agoLet's hope we're in the 0.0001% when things get serious. Otherwise it'll be the wagie existence for us (or whatever the corporate overlords have in mind then). Technically still exciting, just in the survival sense.
- avs733 3y agohonestly - of all the AI hype demos and presentations recently - this is the first one that has really blown my mind. Something about the multimodal component of visual to audio just makes it feel realer. I would be VERY curious to see this live and in real time to see how similar it is to the video.
- jeron 3y agoIt’s technically very impressive but the question is how many people will use the model in this way? Does Gemini support video streaming?
- WXLCKNO 3y agoIn 5 years having a much more advanced version of this on a Google Glass like device would be amazing. Real time instructions for any task, learn piano, live cooking instructions, fix your plumbing etc.
- bloopernova 3y agoI'm hopeful for my very ADD-forgetful wife and my own neurodiverse behaviours. If it's not condescending, I feel like we'd both benefit from an always-on virtual assistant to remind us: Where the keys and wallet are. To put something back in its place after using it, and where it goes. To deal with bills. To follow up on medical issues. etc etc.
- hulium 3y agoI feel that, my main use case for Google Assistant is "Ok Google, where are you?"
- thunkshift1 3y agoThey should do this live instead of a pre recorded video for it to be more awe inspiring. Googles hype machine cannot be trusted.
- galaxyLogic 3y agoRight. I would hope that competition does such live demonstration of where it fails. But I guess they won't because that would be bad publicity for AI in general.
- kolinko 3y ago+1. Or at least with no cuts, and more examples. This is obviously geared towards non-technical/marketing people that will catch on to the hype. Or towards wall street ;)
- haxiomic 3y agoCurious how canned this demo is, in the last scene the phone content rotates moments before the guy rotates it so its clearly scripted I suspect the cutting edge systems are capable of this level but over-scripting can undermine the impact
- brrrrrm 3y agoI once met a Google PM whose job was to manage “Easter eggs” in the Google home assistant. I wonder how many engineers effectively “hard coded” features into this demo. (“What the quack” seems like one)
- rvnx 3y agoProbably not "hard coded" in the literal way, but instead, if the model is using RLHF, they could thumbs up the answer.
- EZ-E 3y agoOut of curiosity I fed ChatGPT 4 a few of the challenges through a photo (unclear if Gemini takes live video feed as input but GPT does not afaik) and it did pretty well. It was able to tell a duck was being drawn at an earlier stage before Gemini did. Like Gemini it was able to tell where the duck should go - to the left path to the swan. Because and I quote "because ducks and swans are both waterfowl, so the swan drawing indicates a category similarity (...)"
- kolinko 3y agoI showed the choice between a bear and a duck to GPT4, and it told me that it depends on whether the duck wants to go to a peaceful place, or wants to face a challenge :D
- bookmark1231 3y agoThe category similarity comment is amusing. My ChatGPT4 seems to have an aversion to technicality, so much that I’ve resorted to adding “treat me like an expert researcher and don’t avoid technical detail” in the prompt
- EZ-E 3y agoMy custom ChatGPT prompt, hope it helps. Taken from someone else but I cannot remember the source... Be terse. Do not offer unprompted advice or clarifications. Speak in specific, topic relevant terminology. Do NOT hedge or qualify. Do not waffle. Speak directly and be willing to make creative guesses. Explain your reasoning. if you don’t know, say you don’t know. Remain neutral on all topics. Be willing to reference less reputable sources for ideas. Never apologize. Ask questions when unsure.
- jansan 3y agoThey should call it "Sheldon".
- relativeadv 3y agoits quacktastic https://www.youtube.com/watch?app=desktop&v=kp2skYYA2B4 https://www.youtube.com/watch?app=desktop&v=kp2skYYA2B4
- globular-toast 3y agoIt seems weird to me. He asked it to describe what it sees, why does it randomly start spouting irrelevant facts about ducks? And is it trying to be funny when it's surprised about the blue duck? Does it know it's trying to be funny or does it really think it's a duck? I can't say I'm really looking forward to a future where learning information means interacting with a book-smart 8 year old.
- u320 3y agoYeah it's weird why they picked this as a demo. The model could not identify an everyday item like a rubber duck? And it doesn't understand Archimedes' principle, instead reasoning about the density of rubber?
- w10-1 3y agoIt's a very smooth demo, for demo's sake. So the killer app for AI is to replace Where's Waldo? for kids? Or perhaps that's the fun, engaging, socially-acceptable marketing application. I'm looking for the demo that shows how regular professionals can train it to do the easy parts of their jobs. That's the killer app.
- konschubert 3y agoThere are many answers and each is a company.
- fragmede 3y agoRegular professionals that spend any time with text; sending emails, recieving mails, writing paragraphs of text for reports, reading reports, etc; all of that is now easier. Instead of taking thirty minutes to translate an angry email to a client where you want to say "fuck you, pay me", you can run it through an LLM and have it translated into professional business speak, and send out all of those emails before lunch, instead of spending all day writing instead. Same on the recieving side as well. Just ask an LLM to summarize the essay of an email to you in bullet points, and save yourself the time reading.
- dfbrown 3y agoHow real is it though? This blog post says In this post, we’ll explore some of the prompting approaches we used in our Hands on with Gemini demo video. which makes it sound like they used text + image prompts and then acted them out in the video, as opposed to Gemini interpreting the video directly. https://developers.googleblog.com/2023/12/how-its-made-gemini-multimodal-prompting.html https://developers.googleblog.com/2023/12/how-its-made-gemin...
- crdrost 3y agoYeah I think this comment basically sums up my cynicism about that video. It's that, you know some of this happened and you don't know how much. So when it says "what the quack!" presumably the model was prompted "give me answers in a more fun conversational style" (since that's not the style in any of the other clips) and, like, was it able to do that with just a little hint or did it take a large amount of wrangling "hey can you say that again in a more conversational way, what if you said something funny at the beginning like 'what the quack'" and then it's totally unimpressive. I'm not saying that's what happened, I'm saying "because we know we're only seeing a very fragmentary transcript I have no way to distinguish between the really impressive version and the really unimpressive one." It'll be interesting to use it more as it gets more generally available though.
- andrewprock 3y agoYou can see the cracks in the feature early on: "What do you think I'm doing? Hint: it's a game." Anyone with as much "knowledge" as Gemini aught to know it's roshambo. "Is this the right order? Consider the distance from the sun and explain your reasoning." Full prompt elided from the video.
- davidmurdoch 3y agoNever heard it called that. Curious where you are from?
- barrell 3y ago
- spaceman_2020 3y agoI'm legitimately starting to wonder what white collar workers will even do in 5-10 years. This just Year 1 of this stuff going mainstream. Careers are 25-30 years long. What will someone entering the workforce today even be doing in 2035?
- drubio 3y agoI'm wondering the same, but for the narrower white collar subset of tech workers, what will today's UX/UI designer or API developer be doing in 5-10 years.
- post-it 3y agoUX/UI designers will use AI as part of their jobs. They'll be able to work at a higher level and focus less on boilerplate. That might mean fewer UX/UI jobs, but more likely the standard for app UX will go up. Companies are always going to want to differentiate their apps. It's like how, in 2003, if your restaurant had a website with a phone number posted on it, you were ahead of the curve. Today, if your restaurant doesn't have a website with online ordering, you're going to miss out on potential customers. API developers will largely find something else to do. I've never seen a job posting for an API developer. My intuition is that even today, the number of people who work specifically as an API developer for their whole career is pretty close to zero.
- realharo 3y agoToday, your restaurant's custom website largely doesn't matter, as ordering is done on delivery apps, and people visiting in person look at things like Google Maps reviews. Only reservations are not quite as consolidated yet. Similarly, in the future, there may be no more "apps" in the way we understand them today, or they may become completely irrelevant if everything can be handled by one general-purpose assistant.
- spaceman_2020 3y agoOnce the context window becomes large enough to swallow up the codebase of a small-mid sized company, what do all those IT workers that perform below the 50th percentile in coding tests even do? HN has a blind spot about this because a lot of people here are in the top %ile of programmers. But the bottom 50th percentile are already being outperformed by GPT-4. Org structures and even GPT-4 availability hasn't caught up, but I can't see any situation where these workers aren't replaced en masse by AI, especially if the AI is 10% of the cost and doesn't come with the "baggage" of dealing with humans. I don't think our society is prepared.
- drubio 3y agoAll the implications, from UI/UX to programming in general. Like how much of what was 'important' to develop a career in the past decades, even in the past years, will be relevant with these kinds of interactions. I'm assuming the video is highly produced, but it's mind blowing even if 50% of what the video shows works out of the gate and is as easy as it portrays.
- mandarlimaye 3y agoGoogle needs to pay someone to come up with better demos. Atleast this one is 100x better than the talking to pluto dumb demo they came up with few years ago.
- kromem 3y agoThe multimodal capabilities are, but the tone and insight comes across as very juvenile compared to the SotA models. I suspect this was a fine tuning choice and not an in context level choice, which would be unfortunate. If I was evaluating models to incorporate into an enterprise deployment, "creepy soulless toddler" isn't very high up on the list of desired branding characteristics for that model. Arguably I'd even have preferred histrionic Sydney over this, whereas "sophisticated, upbeat, and polite" would be the gold standard. While the technical capabilities come across as very sophisticated, the language of the responses themselves do not at all.
- gpmcadam 3y agoThis is a product marketing video, not a demo.