5 Signs Your UX Decisions Are Based on Opinion, Not Data
You know the scene.
Someone senior points at a competitor's website and declares, “We need that.” A product manager is convinced users are dropping off because of the color of a button. The marketing director has a gut feeling about the homepage layout.
Everyone has an opinion. And in most companies, the loudest one wins.
But here's the problem: opinions aren't strategy. And when you're making decisions about user experience based on who shouts loudest, you're leaving money on the table.
Over the years, we've noticed five clear signs that a company is drifting into dangerous, opinion-based territory. If any of these sound familiar, it might be time to rethink how you make decisions.
Sign #1: The Loudest Voice in the Room Wins
We worked with a company once where the CEO hated the checkout flow. He thought it had too many steps. So they changed it. Simple as that. No user testing. No data analysis. Just a hunch from the top.
Six months later, they changed it back. Turns out users actually preferred the original flow. But by then, they'd lost thousands in revenue and wasted months of dev time.
When decisions are made based on seniority rather than evidence, you're designing for internal politics, not your customers. The most dangerous phrase in any UX meeting is “I feel like...” because it shuts down the conversation before anyone asks the only question that matters: “What does the data say?”
Sign #2: You're Making Big Calls Based on Tiny Samples
We get it. User research is hard. It takes time. So when a few power users say they love a new feature, it's tempting to roll it out to everyone.
But here's the problem: five people do not represent your entire customer base.
We've seen companies pivot their entire product strategy based on feedback from a handful of vocal users, only to discover later that the silent majority actually hated the change. Those five people weren't wrong, they just weren't representative.
Sign #3: You Trust Surveys More Than Behavior
People lie. Not intentionally, but they lie. Ask someone if they'd use a new feature, and they'll probably say yes. Why? Because it sounds good, or they are just being nice.
“Surveys tell you what people want you to hear. Behavior tells you the truth.”
What people say and what people do are often completely different things. We've lost count of how many times we've run usability tests where participants claimed a site was “easy to use” while watching them struggle for five minutes to complete a basic task.
Sign #4: You Have No Clue How You Compare to Competitors
Here's a quick test: can you honestly say how your checkout experience stacks up against your top three competitors? If the answer is “I think we're pretty good” or worse, silence, you have a problem.
Your users don't experience your site in a bubble. They bring expectations with them. If a competitor's checkout takes two clicks and yours takes five, your users notice - even if you don't. You can't win a race you're not measuring.
Sign #5: You Can't Explain the ROI of Your UX Work
A client once asked us: “We spent six months redesigning the dashboard. What did we get for it?” And we stumbled. We talked about “better user satisfaction.” But we couldn't point to a single business metric that had moved.
UX isn't an art project. It's a business function. If you can't connect UX work to business outcomes—conversion rates, retention, support costs—then you're operating on faith. And faith is hard to defend when budgets get tight.
What Opinion-Based UX Actually Costs You
We've seen the same patterns play out across dozens of companies. The costs add up:
- Wasted Effort. Developers building features nobody asked for or needs.
- Opportunity Cost. Months of work rolled back because it solved the wrong problem.
- Market Loss. Competitors quietly pulling ahead while you debate internal opinions.
How Tetrabase Helps You Escape the Opinion Trap
At Tetrabase, we built our entire approach around replacing guesswork with evidence. The Tetrabase Framework gives you statistically valid benchmarks that answer the questions opinion-based processes can't:
- Where do we actually stand against our competitors?
- Which UX problems are worth fixing first?
- What will move the needle on conversion and retention?
- Are we making progress year over year?