9 ms·
The live demo of this is brutal. https://x.com/ns123abc/status/1968469616545452055 https://x.com/ns123abc/status/1968469616545452055
by wronglebowski 1y ago
The live demo of this is brutal. https://x.com/ns123abc/status/1968469616545452055 https://x.com/ns123abc/status/1968469616545452055
- klik99 1y agoThis is why Jobs spent months prepping for each presentation. But hey, at least it's not all faked
- postalcoder 1y agoi love jobs but i do remember the “everybody please turn off your laptops” presentation. live demonstrations are tough - i wish apple would go back to them.
- paxys 1y agoTotally agree. Up until a few years ago failures during live demos on stage used to be a mark of authenticity, and companies playing recordings was always written off as exaggerated or fake. Now all of Apple's keynotes are prerecorded overproduced garbage.
- deleted 1y ago[deleted]
- gretch 1y agoWhen I was at Meta (then facebook), people lived and died by the live demo creedo. Pitches can be spun, data is cherry picked. But the proof is always in the pudding. This is embarrassing for sure, but from the ashes of this failure we find the resolve to make the next version better.
- gcr 1y agowhy did they choose to air this live? For an internal team sure absolutely, but for public-facing work, prerecorded is the way to go
- stonogo 1y agoThe same unwarranted sense of confidence that tells them this product is worth making tells them that they can easily pull off a live demo. This is called "culture fit"
- com2kid 1y agoOne of my internships was preparing Bill Gate's demo machines for CES. I setup custom machine images and ran through scripts to make sure everything went off w/o a hitch (I was doing just the demos for Tablet PC, each org presumably had their own team preparing the demos!) Not doing it live would've been an embarrassment. I don't think the thought ever crossed anyone's mind, of course we'd do it live. Sure the machines were super customized, bare bones Windows installs stripped back to the minimum amount of software needed for just one demo, but at the end of the day it sure as hell was real software running up there on stage.
- bee_rider 1y agoIf it was pre-recorded we’d know it was staged and that assume they didn’t have a working product. Their actual result was pretty bad, but, ya know, work in progress I guess.
- whywhywhywhy 1y agoWatch their big "Metaverse" presentation where its all vaporware and faked, presumably this is a cultural shift from that era.
- Anon1096 1y agoYep I hope that mindset never dies. Meta is one of the last engineering-first companies in big tech and willing to live demo something so obviously prone to mishaps is a great sign of it. It's not unlike SpaceX and being willing to iterate by crashing Starships for the world to see. You make mistakes and fix them, no big deal.
- neilv 1y ago"At least it's not faked" was my main reaction, too. Some other big-tech AI-related demos the last couple years have been caught being faked. Zuckerberg handling it reasonably well was nice. (Though the tone at the end of "we'll go check out what he made later" sounded dismissive. The blame-free post-mortem will include each of the personnel involved in the failure, in a series of one-on-one MMA sparring rounds. "I'm up there, launching a milestone in a trillion-dollar strategic push, and you left me @#$*&^ my @#*$&^@#( like a #@&#^@! I'll show you post-mortem!")
- garbawarb 1y agoI appreciate the live demo but I'm suprised they didn't at least have a prerecorded backup. I wanted to see how video calls work!
- paxys 1y agoConsidering there's no camera pointing to your face they can't be all that interesting.
- SoftTalker 1y agoI saw Jobs give a demo of some NeXT technology and the system crashed and rebooted right in the middle of it. He just said “oops” and talked around it until the system came back up.
- TIPSIO 1y agoIf you’ve ever used the current Meta Ray Ban and AI, this almost exactly happens when the connection is bad. Pure confusion but the AI still tries to give you an answer. I bet the device hardware is small/cheap and susceptible to interference
- krustyburger 1y agoEven if it’s small/cheap, if the item is scanned multiple times this will prevent any electrical infetterence.
- chatmasta 1y agoI don’t even think that’s a word!
- m3kw9 1y agonext time they need 1 public and 1 private router and shut the public off right before the demo.
- stavros 1y agoI have the Meta glasses and I've never noticed this, and don't even understand why it could be the connection's fault. The AI gets your audio and your image, if it gives the wrong answer, it's because the AI went wrong. How would the bad connection ever affect it?
- dmbche 1y agoThe ai is in the cloud Edit0: ie without internet access the ai is unable to produce an answer other than some prerecorded ones I guess In the live showcase the presenter even mentions that the wifi must have been bad for the ai to repeat the answer
- stavros 1y agoYou're saying "you've already used the first two ingredients, so go ahead and add the sauce" is the prerecorded response when it doesn't have a connection?
- 303uru 1y agoIt’s the WiFi, ya sure.
- klabb3 1y agoYeah I was also cringing at that cop out. It doesn’t appear connectivity related. Plus even if it was, it beautifully highlights the connectivity requirement which sucks for so many reasons.
- herval 1y agoTypical Meta product. I used to believe and wasted money on multiple generations of Quest & Ray-bans. I expect this device to be unsupported at launch, just like Quest Pro was
- hattmall 1y agoThe portal was like their best product and they just abandoned it.
- zmmmmm 1y agoIf you watch it carefully, he preempts the AI with "What do I do first" before it even answered the first time. This strongly suggests it did this in rehearsal to me and hence was far more than just "bad luck" or bad connectivity. Perhaps the bad connectivity stopped the override from working and it just kept repeating the previous response. Either way it suggests some troubling early implications about how well Meta's AI work is going to me, that they got this stuck on the main live demo for their flagship product on such a simple thing.
- deleted 1y ago[deleted]
- daemonologist 1y agoI think preempting the AI the first time was meant to be a feature (it's not trivial to implement and is something people often ask for). Failing from there definitely wasn't great, although it's kind of what I'd expect from an(y) LLM.
- WD-42 1y agoNo, he preempted it because it was about to list all the ingredients necessary to make a steak sauce, despite having them in front of him. These are glasses, it should have skipped that part and went straight to what to do first.
- mrandish 1y ago> Either way it suggests some troubling early implications about how well Meta's AI work is going I fully expect the AI to suck initially and then over many months of updates evolve to mostly annoying and only occasionally mildly useful. However, the live stage demo failing isn't necessarily supporting evidence. Live stage demos involving Wifi are just hard because in addition to the normal device functionality they're demoing, they need to simultaneously compress and transmit a screen share of the final output back over wifi so the audience can see it. And they have to do all that in a highly challenging RF environment that's basically impossible to simulate in advance. Frankly, I'd be okay with them using a special headset that has a hard-wired data link for the stage demo.
- joshdavham 1y agoFor those who didn't pick up on it, they were being sarcastic about the issue being wifi related haha
- deleted 1y ago[deleted]
- m3kw9 1y agoso when I talk but not to it, it may response like i accidentally say siri? Except is every time?
- explorigin 1y agoI've done live demos of AI. Even with the same queries, I got a different answers than my 4 previous practice attempts. My demos keep me on my toes and I try to limit the scope much more now. (I didn't have control over temperature settings.)
- hdjrudni 1y ago> (I didn't have control over temperature settings.) That's...interesting. You'd think they'd dial the temperature to 0 for you before the demo at least. Regardless, if the tech is good, I'd hope all the answers are at least decent and you could roll with it. If not....then maybe it needs to stay in R&D.
- danpalmer 1y agoReducing temperature to 0 doesn't make LLMs deterministic. There's still a bunch of other issues such as float math results depending on which order you perform mathematically commutative operations in.
- riffraff 1y agoI keep reading this but I don't get it: for the same input shouldn't the order of resulting operations be deterministic too?
- llmthrow0827 1y agoAll the VR/AR/XR demos are so insanely trivial and yet still manage to be much more difficult than current methods of doing things. Like, really, cooking? Normal method: * Search for a recipe * Leave my phone on a stand and glance at it if I forget a step Meta glasses: * Put glasses on (there's a reason I got lasek, it's because wearing glasses sucks) * Talk into the void, trying to figure out how to describe my problem as well as the format that I want the LLM to structure the response * Correct it when it misreads one of my ingredients * Hope that the rng gods give me a decent recipe Or basically any of the things shown off for Apple's headset. Strap on a giant headset just so I can... browse photos? or take a video call where the other person can't even see my face?
- SchemaLoad 1y agoThese companies are reaching really hard for use cases while ignoring the only ones VR actually works well for. If they just went all in on gaming it would be a much better product than trying to push AI slop cooking help.
- bee_rider 1y agoVR gaming seems like it is a bit of a niche, though. I think they want to sell glasses in quantities more like cellphones than gaming peripherals. I agree they are reaching (and not finding) for an application.
- ubb_server 1y agoI agree that VR gaming is a niche, but I think it could be explosively improved if we had the kind of all-in idealism that the previous commenter referred to. I think because VR gaming IS niche, we haven't yet delved into what VR/AR could do in non-gaming. An idea that I've had before is like 'augmented curated experiences' for all kinds of things--for example imagine playing a Magic the Gathering (or similar) card game, and watching your cards come to life on the board in hologram-esque 3D. Or while watching a sports match, being able to pull up the stats or numbers of any players, or flip through channels of POV camera from helmets. Car navigation that shows you what turns to make by augmenting lanes or signs with highlighting. Brick and mortar stores having a live wayfinding route to products in their store based on your grocery list, recognizing and highlighting items you like.
- anal_reactor 1y agoHearing this AI-generated voice awakens some primal aggression in me.
- HaZeust 1y agoI have mad respect to them for actually attempting this on the fly - especially a public company. Nothing really to gain versus a scripted demo, and absolutely everything to lose. Admirable.
- xandrius 1y agoObviously scripted, just the LLM didn't follow its part of the script.
- santiagobasulto 1y agoThis one was also pretty bad: https://x.com/jason/status/1968496622884495847?s=46&t=9d1Ha4u7n6p2xJT-kfdkkg https://x.com/jason/status/1968496622884495847?s=46&t=9d1Ha4... I think there’s some respect to give cause they’re doing it live and non-scripted.
- jansan 1y agoNon-scripted? You must be kidding.
- _1 1y agoI take it they meant pre-recorded. It was definitely scripted and practiced.
- whywhywhywhy 1y agoRespect for trying it live now Apple just does pre-recorded with a ton of VFX.
- anonu 1y agoIt was the WiFi though
- losvedir 1y agoOuch. Kudos for trying, though. I miss the days of live demos at Apple events, instead of all these polished videos of people standing in silly poses around the Apple campus.
- baby 1y agoThe demo gods were not present that day
- jjfoooo4 1y agoIt was painful even before it started malfunctioning