The AI voice assistant that ordered me 12 pizzas at 2am

I was testing a new smart home AI system in my apartment in Austin last spring. Everything was going fine until it misheard my late-night snack request and placed a $150 order for 12 large pizzas from Domino's. I had to frantically call the store at 2:15am to cancel, but they had already started making them. The worst part was explaining to my neighbors why the delivery guy showed up with 12 boxes anyway because the cancellation didn't go through in time. Has anyone else had their AI assistant misunderstand a command in a really costly way?

2 comments

2 Comments

danielmartinez8d ago

That "are you sure" idea sounds pretty reasonable, sorry you had to deal with all that mess.

jessicamiller8d ago

Honestly think about the bigger picture here. This is a safety issue that could have been way worse than just pizza. Imagine if the system misheard a command about unlocking your door at night or turning off the stove. The fact that it can place orders without any real confirmation step is a huge red flag. These companies need to add a simple "are you sure" prompt before processing anything with money or physical actions. Otherwise we're all just beta testers for something that could mess up our lives.