Meta's live staged demo fails; the "AI" recording plays before the actor acts

20 comments

There is a second part that is equally bad, but with Zuck:

https://old.reddit.com/r/interestingasfuck/comments/1nkbqyk/...

God, that's actually painful to watch. I can't believe I lasted two minutes.

Mark's definitely mastered optimizing for peak cringe factor while at 1.95T valuation.

I was going to say that’s two minutes I won’t get back (and I won’t) but, ya know, schadenfreude.

It's kind of like Peep Show, where the writers tried to engineer the most awkward social situations, only without the jokes.

Would be good to change the OP link to this - it's the same clip but plus a bit more.

I really missed seeing Zuck sweat.

I have a friend who does magic shows. He sells his shows as magic and stand-up comedy. It's both live entertainment, okay, but he is the only person I've ever seen use that tagline. We went to see him perform once and everything became clear when he opened the night.

"This is supposed to be a magic show," he told us. "But if my tricks fail you can laugh at it and we'll just do stand-up comedy."

Zuck, for a modest and totally-reasonable fee, I will introduce you to my friend. You can add his tricks (wink wink) to your newly-assembled repertoire of human charisma.

If your friend isn't already aware of Tommy Cooper [1], he's in for a treat.

[1]: https://en.wikipedia.org/wiki/Tommy_Cooper

He was so funny, people laughed when he died!

So, wait, is he just a shitty magician and a funny guy, or does he fail on purpose?

Credit where it’s due: doing live demos is hard. Yesterday didn’t feel staged—it looked like the classic “last-minute tweak, unexpected break.” Most builders have been there. I certainly have (I once spent 6 hours at a hackathon and broke the Flask server keying in a last minute change on the steps of the stage before going on).

Live demos are especially hard when you're selling snake oil.

Yeah, I just watched it again and I’m mostly confused why the guy interrupted what sounded like a valid response.

I wonder if his audio was delayed? Or maybe the response wasn’t what they rehearsed and he was trying to get it on track?

> I’m mostly confused why the guy interrupted what sounded like a valid response

I thought they were demonstrating interruption handling.

I think he was just trying to get it back on track instead of letting it go on about something that was completely off

Adrenaline makes people do interesting things

Live demos being hard isn't an excuse for cheating.

this isn't cheating. the models are unpredictable. This product is going out the door this month, there is no reason to cheat.

Despite the Reddit post's title, I don't think there's any reason to believe the AI was a recording or otherwise cheated. (Why would they record two slightly different voice lines for adding the pear?) It just really thought he'd combined the base ingredients.

That's even worse because it would mean that it wasn't the scripted recording that failed, it means the AI itself sucks and can't tell that the bowl is empty and nothing was combined. Either this was the failure of a recorded demo that was faked to hide how bad the AI is, or it accurately demonstrated that the AI itself is a failure. Either way it's not a good look.

As much as it'll be "interesting" to see how models behave in real world examples (presumably similarly to how the demos went), I'm not convinced this is a premade recording like what seems to be implied.

I'm imagining this is an incomplete flow within a software prototype that may have jumped steps and lacks sufficient multi-modal capability to correct.

It could also be staged recordings. But, I don't think it really matters. Models are easily capable of working with the setup and flow they have for the demo. It's real world accuracy, latency, convenience, and other factors that will impact actual users the most.

What's the reliability and latency needed for these to be a useful tool?

For example, I can't imagine many people wanting to use the gesture writing tools for most messages. It's cool, I like that it was developed, but I doubt it'll see substantial adoption with what's currently being pitched.

Yea the behavior of the AI read to me more like a hard coded demo but still very much "live". I suspect him cutting it off was poorly timed and that timing could have amplified due to WiFi? Who knows. I wasn't there. I didn't build it.

So the live demo failed?

That wasn't prerecorded, but it was rigged. They probably practiced a few times and it confused the AI. Still it's no excuse. They've dropped Apollo-program level money on this and it's still dumb as a rock.

I'm endless amazed that Meta has a ~2T market cap, yet they can't build products.

It's because their main business (ads, tracking) makes infinite money so it doesn't matter what all the other parts of the business do, are, or if they work or not.

Sure it does; as long as those products add infinity on top of infinity. That demofail was the overflow caused by adding two infinite values.

That was my thought — the memory might not have been properly cleared from the last rehearsal.

I found the use case honestly confusing though. This guy has a great kitchen, just made steak, and has all the relevant ingredients in house and laid out but no idea how to turn them into a sauce for his sandwich?

Well, it _IS_ a rock after all.

At this point, honesty is an oasis that is the 2025 year of scams and grifts. I'm just waiting for all the bubbles to pop.

> confused the AI.

I will die on this hill. It isn’t AI. You can’t confuse it.

I bet they rehearsed a dozen times and never failed as bad live. Got to give them props for keeping the live demos. Apple has neutered its demos so much it's now basically 2 hr long commercials.

The new Apple presentations are much more information dense, and tailored to the main (online) audience. They’re clearly better.

More dense but less trust worthy. I don't think they would have pushed apple intelligence the way they did if there was a live demo.

Live Apple demos were always held together with duct tape in the first place. That first "live" iPhone demo had a memorized sequence that Jobs needed to use to keep the whole phone OS from hard crashing.

Even with that, Live demos are incredibly more better than hour long demos.

They also force the developers to make it work, under threat of being fired, and in the ire of Steve Jobs case, being yeeted in to the sun along with their ancestors and descendents.

and so boring. I would take Jobs presenting a live demo than any of this heavily-produced stuff.

They are boring infomercials now. The live audience used to keep it from feeling too prepackaged.

It's an ad network with an attached optional pair of glasses.

It's the platform Zuck always wanted to own but never had the vision beyond 'it's an ad platform with some consumer stuff in it'.

I am super impressed with the hardware (especially the neural band) but it just so happens that a very pricey car is being directly sold by an oil company as a trojan horse.

We all know what the car is for unfortunately.

I can't wait to see what Apple has in store now in terms of the hardware.

Someone would have to be dumb to give facebook access to collect data from everything they see and hear in their life combined with the ability to plaster ads over every available surface in their field of view. They'd have to be beyond stupid to pay for it.

I love how they randomly blame the WiFi network, like anyone is going to buy it.

Somebody said the cooking guy was some influencer person? I noticed that many non-tech people often resort to this excuse, even in situations where it makes absolutely no sense (e.g., on a desktop with only ethernet, or with mic/speakers connected via cable). It's almost like they just substitute "bad wifi" for "glitch".

It's colloquial in the younger generations to use the term Wifi to actually refer to a WAN connection to one's home or building, regardless of Physical Layer Transport.

Pretty sure it's a meme, like blaming the WLAN cable.

*wifi cable

Bad idea to rely on WiFi for an important demo in a crowded environment. It would have worked fine in testing but when the crowd arrives and they all start streaming etc, they bring hundreds more devices all competing for bandwidth.

Zuck should have known better and used Ethernet for this one!

[deleted]

[deleted]

Should've downloaded more ram for the wifi to work better

I hope they keep doing live demos. This is much better than prerecorded videos.

More than likely the full response was kept as context despite being interrupted.

Notably though, the AI was clearly not utilizing its visual feed to work alongside him as implied

This is like a Black Mirror episode. Also, is it a conscious decision to make the TTS sound so robotic?

Maybe it's modeled on Zuck's robotic voice

still better than the pre-taped apple events. happy to see these products in action

Those WiFi's man, they're always trouble

[deleted]

AI is hot trash. When will this river of garbage stop?

These hot takes with no context only make the ai argument stronger.

That sounds a bit too much like "this is good for Bitcoin"

[dead]

The failures on stage were kind of endearing, to be honest, especially the one with Zuck. Plus the products seem really cool, I hope I'll be able to try them out soon.

Zuckerberg has negative charisma, it's painful to watch...

Jobs handled this so much better; while clearly he is pissed, he doesn't leave you cringing in mutual embarrassment, goes to show it isn't as easy as he makes it look!

See: https://www.youtube.com/watch?v=1M4t14s7nSM https://www.youtube.com/watch?v=znxQOPFg2mo

This is much better? He tossed the camera aggressively to the other person, and then made a snide comment, and that's better than blaming wifi?

Jobs was one of a kind. He had that aura that Bill G et al envied. He admitted so in a video that can be found on YT.

Yet even Bill G handled public failure better than Zuck: https://m.youtube.com/watch?v=jGwy4sb9aO8

that clip reminds me of how Sundar reacts to these things.

I mean Bill wasnt figuring out how to get back at girls that rejected him in college lol.

Zuck carries that energy no matter what he does nor what amount of wealth he amasses.

Jobs emphasized user friendly products in aesthetically pleasing boxes. If Silicon Valley wasn't the densest and most obtuse place on earth he wouldn't stand out so hard.

Endearing is great for trying to sell a heartfelt, homeade piece of art. It clashes when it's a trillionaire company trying to pretend this product can replace entire sectors of human labor.

Yeah. I’m impressed we have any sort of wave guide display on sale commercially this year.