Question about A/B testing landing pages after a conference mishap

I was at a marketing conference in Austin last month and a speaker called out my company's landing page on stage (yikes). Turns out our sign-up button was the same color as the background on mobile. We had been running A/B tests for weeks on desktop but totally ignored mobile optimization. After that, I spent around 40 hours rebuilding our whole testing setup. Now I test everything on three different devices before launch. Has anyone else dealt with a layout flaw that broke their conversion numbers?

2 comments

2 Comments

valwest3d ago

Oh man, that conference story is brutal but honestly such a wake up call for everyone. I had a similar thing happen with my own site where the checkout button was literally invisible on iOS Safari because of some weird CSS issue I never caught. I spent two weeks chasing a 30% drop in conversions and it took a friend looking over my shoulder to spot it. I ended up building a simple checklist for myself that I run through before any launch now. It includes checking the page on three real devices (not just browser tools cause those lie) and also doing a quick screen recording of myself trying to navigate it. The screen recording thing really helps because you see it like a user would instead of just staring at code.

the_sarah3d ago

Real devices catch stuff browser tools never show you.