Caught my first AI misstep at a Las Vegas trade show last month

I was demoing a new chatbot for a hotel chain and it gave a guest wrong checkout times based on a timezone bug. Took me 3 hours to trace it to a training data mixup. Has anyone else found weird errors in AI customer service tools that slip past testing?

1 comments

1 Comment

the_rowan6d ago

3 hours to trace it to a training data mixup" is wild, but did you ever find out WHY the timezone data got mixed in the first place? Like, was it a scrape from a forum where people were posting local times, or did someone label the dataset wrong? I'm asking because I've seen similar stuff with pricing errors, where the bot quotes a rate from a different region and nobody catches it until a customer screenshots it. That's the part that scares me, not the bug itself but how long it could've gone unnoticed if that guest hadn't pushed back.