paired-comparison-analysis-tool

How to Decide What Comes First

It usually starts on a Sunday evening, at the kitchen table.

Let’s call them Mark and Sara. They sit down with a notebook to plan the year, and within ten minutes the list looks like this:

  • Replace the old windows before winter
  • Take the kids on a proper summer vacation
  • Replace the car, which has started making that noise again
  • Finally build an emergency fund
  • Renovate the bathroom

Five things. Money for maybe two.

And every single item has a good argument behind it. The windows will cut the heating bill. The kids are only young once. The car might leave them stranded on the highway. The emergency fund is the “responsible” choice. The bathroom has been embarrassing them for three years.

So they talk. Then they talk some more. Sara says the car. Mark says the vacation. Someone mentions the bathroom again. An hour later, they close the notebook with the same sentence people all over the world say in this exact moment:

“I don’t know. They’re all important.”

If you’ve ever been there, with money, with time, with goals for the year, you know how draining it is. Not because you can’t think. Because you’re trying to think about five things at once.

Why your gut can’t solve this one

Here’s the uncomfortable truth. Your brain is great at comparing two things. It’s terrible at comparing five.

Ask yourself “car or bathroom?” and you’ll probably have an answer in three seconds. Ask yourself “car, bathroom, windows, vacation, or savings?” and your mind starts jumping around. You weigh the car against the vacation, then remember the windows, then feel guilty about the savings, and by the time you circle back, you’ve forgotten why you liked the car.

In that chaos, what usually wins isn’t the most important option. It’s the loudest one. The one that broke most recently. The one your partner feels strongest about. Or the one you happened to be thinking about when you got tired of the discussion.

That’s not a decision. That’s surrender with extra steps.

The fix: stop comparing five things; compare two

There’s an old and very simple technique for exactly this situation. It’s called paired comparison analysis, and the idea fits in one sentence:

Compare every option against every other option, one pair at a time, and write down which one wins and by how much.

That’s it. Instead of one impossible question, you answer a series of easy ones. With five options, that’s only ten comparisons. You can do it in less time than it takes to drink a coffee.

For each pair, you ask two things:

  • Which one matters more to us right now?
  • How much more? 1 point if it’s slightly more important, 2 if it’s clearly more important, 3 if it isn’t even close.

The winner of each pair gets those points. At the end, you add them up, and the list sorts itself.

Let’s run it for Mark and Sara

Here are their ten comparisons. Notice how each one is a small, calm question you could answer out loud without a fight.

The pair Winner Points
Windows vs. Vacation Windows 2
Windows vs. Car Car 1
Windows vs. Emergency fund Emergency fund 2
Windows vs. Bathroom Windows 3
Vacation vs. Car Car 2
Vacation vs. Emergency fund Emergency fund 3
Vacation vs. Bathroom Vacation 1
Car vs. Emergency fund Emergency fund 1
Car vs. Bathroom Car 2
Emergency fund vs. Bathroom Emergency fund 3

Now add up the points for each option:

Rank Option Total
1 Emergency fund 9
2 Car 5
3 Windows 5
4 Vacation 1
5 Bathroom 0

Funny thing. The emergency fund was the option nobody argued for at the table. Nobody gets excited about a savings account. But when it had to stand next to each alternative, one at a time, it won every single round.

That happens a lot. The quiet, sensible option rarely wins a loud discussion, but it often wins a fair one.

Don’t just read the numbers; question them

I spent years in software testing, and one habit never left me: when a system gives you an answer, you check whether the answer makes sense. The same applies here. Two things in this result deserve a second look.

The tie. The car and the windows both scored 5. So which goes first? Look back at the pair where they met directly: the car won. When two options tie, their head-to-head result is a fair tiebreaker. Car second, windows third.

The zero. The bathroom scored nothing. That doesn’t mean the bathroom doesn’t matter, or that Sara was wrong to want it. It means that, this year, every other option on the list beat it. A zero is information about timing, not a judgment about your wishes. Next year, with the car and the savings sorted, the bathroom may well come out on top.

And if the final ranking feels completely wrong in your stomach? Good, pay attention to that too. Usually it means one of your comparisons was answered from habit rather than honesty. Go back and look at the pairs. You’ll often find the exact spot where you told yourself a small story.

Where else this works

Once you’ve done it once, you start seeing uses for it everywhere:

  • Choosing between apartments, or deciding what matters most in one (commute, price, quiet street, schools)
  • Picking two goals for the year out of the seven you wrote down on January 1st
  • Deciding which job offer, course, or side project deserves your evenings
  • Settling a family debate where everyone has a point

The rule of thumb: if you have between three and eight options, all of them feel valid, and there’s no hard data that settles it for you, paired comparison is the right tool.

Try it on your own list

You can do all of this with a pencil. But I got tired of drawing grids and adding columns by hand, so I built a small free tool that does the bookkeeping for you.

It’s called Priority Grid. You type in your options; it builds every pair automatically, you click the winner and choose 1, 2, or 3, and it gives you the ranked list at the end. You can save the result as a PDF or CSV, which is handy if you want to show your partner or your team how you got there.

One more thing, because people always ask: everything stays in your own browser. Nothing is uploaded, nothing is stored on a server, nobody sees your list but you.

Got a list that’s been sitting on your mind? Give it ten minutes.

Open Priority Grid (free)

No sign-up. Works on your phone. Your data never leaves your device.

A small note for Scrum people

If you work as a Product Owner or Scrum Master, you’ve probably noticed this story is your job in disguise. Replace “windows, car, vacation” with five features that stakeholders all swear are urgent, and you’ve got the backlog conversation you had last Tuesday.

The technique works exactly the same way at work. It won’t replace real data like value, cost, and risk, but it’s a great way to get a room full of opinions into a ranked list without anyone raising their voice. And if you want to go further with backlog prioritization and refinement, that’s what my AI-Powered Backlog Refiner course is about.

For everyone else: go make your list. And maybe let the emergency fund have a fair chance this time.