Absolute scoring beats a ranked leaderboard
A ranking always produces a winner, because sorting always terminates. An absolute standard is willing to report that nobody in a market is doing well, which is exactly when the opportunity is largest.
Almost every competitive benchmark you have been shown was a ranking. Your company against five others, sorted, with somebody at the top.
Rankings feel rigorous because they produce a clean answer. They are also structurally incapable of telling you the most valuable thing a competitive audit can find.
The problem with sorting
A ranking is a sorting operation, and sorting always terminates with something in first place. That is true whether the field is excellent, mediocre or uniformly terrible.
Which means a ranked leaderboard cannot distinguish between these two situations:
- One company is genuinely excellent at this and the rest are behind.
- Every company in the market is equally mediocre at this and one of them is marginally less mediocre.
Both render as a leaderboard with a winner at the top. The second situation is the more commercially interesting of the two by a wide margin, and the ranking format erases it.
What an absolute scale does instead
An absolute scale scores each company against published requirements. A tier is earned by meeting that tier’s bar, not by outperforming the neighbours.
The consequence people find uncomfortable at first: the grid can come out flat. Every company on the same score, in the same column, with nobody winning.
That is not a failure of the method. That is the finding.
We had exactly this happen. Across a full cohort, every single company scored at par on the Conversion lens. Not one of them offered a buyer any way to get a specific answer, a quote, a configuration or a qualified scope, without waiting on a human being to get back to them.
A ranked leaderboard would have picked whichever company had the marginally better contact form and declared them the conversion leader. The client would have looked at the column, seen somebody else in first place, and concluded they had a small gap to close.
The absolute scale said something completely different: nobody in this market has solved this, the whole column is flat, and the first company to move gets an advantage nobody currently holds.
That is the difference between a benchmark and a strategy input.
Flatness is information, and it is directional
A flat column tells you two useful things at once.
Nobody has done it, so it is available. Whatever this is, it is not table stakes in your category. Being the first to offer it is differentiating rather than catching up.
Nobody has done it, so ask why. Sometimes there is a good reason. Some categories genuinely cannot quote without a site visit, and a self-serve quoting tool would be a lie. The flatness is still worth knowing, because the honest version of the opportunity might be a qualified scope rather than a price.
The audit’s job is to surface the flatness. Whether to act on it is a judgement that needs someone who knows the business, which is why the finding is presented with its context rather than as an instruction.
What a curve does to your incentives
There is a second, subtler problem with relative scoring, and it shows up over time.
If your score is relative to your cohort, your score improves when your competitors get worse. Nothing you did changed. The number moved anyway.
That produces a report where a genuinely improving company can look flat, and a stagnant company can look like it is gaining, depending entirely on what happened in businesses it does not control. Try explaining that movement to a board.
Absolute scoring decouples your number from theirs. If you improved, your score moves. If you did not, it does not. When a competitor improves, their number moves and yours does not, which is exactly what should happen.
That property is what makes a score comparable across quarters and across companies in a portfolio. A curve is not comparable to anything, including itself last quarter.
Where absolute scoring is harder
It is worth being straight about the costs, because they are real.
Somebody has to write the bar. Defining what tier 4 requires, in language specific enough to be checkable and general enough to apply across a category, is genuinely difficult work. A curve requires no such thing, which is a large part of why curves are popular.
The bar has to be defensible in public. If you publish it, and you should, then every requirement is open to argument. That is healthy and it is also more work.
Nobody scores well by accident. On a curve, half the field is above average by construction. On an absolute scale, a whole market can sit at par, and delivering that message requires a client relationship that can survive it.
That last one is the actual barrier. Absolute scoring is not technically hard. It is commercially awkward, because it removes the option of telling everybody they are doing well relative to somebody.
The tier that matters most is par
The most useful tier in our rubric is tier 3, and it is deliberately not a failing grade.
Tier 3 is what a competently run business in the category actually does. Clear service pages with described scope. A working contact path with a stated next step. A named audience. Regular publication. It is not a compliment and it is not a criticism. It is the floor of professional competence.
Most companies, in most categories, on most lenses, land there. That is not us being harsh. That is what the distribution looks like when you measure against a fixed bar instead of against each other.
Which means the interesting question stops being “who is winning” and becomes “where is the whole category stuck, and can we move first.”
Reading a flat grid
If you are looking at an absolute competitive grid, here is the order to read it in.
First, look for flat columns. A lens where everybody scores the same is the largest available opportunity in the market, and it is invisible on any ranked view.
Second, look for your own outliers. Not where you are behind on average, but where you are two tiers below your own median. That is usually a neglected area rather than a strategic choice.
Third, look at the top scorers per lens, individually. Not the overall leader. The specific company that earned tier 5 on Inbound is telling you what tier 5 looks like in your category, which is more useful than knowing who has the best average.
Last, ignore the overall ranking entirely. It is an average of five different things and it answers no question you actually have.
The full rubric is published, including every tier requirement, so you can check what a given score claims before you act on it.
Related
Method
Our client was winning every category. That was a bug.
The first live competitive audit had our client leading every lens. It looked like a great result. It was uneven research, and the fix dropped them to second. We shipped the honest number and built a gate so it cannot happen again.
Method
Does not rank is not the same finding as does not exist
Ranking data can tell you a competitor is invisible for a term. Only a direct sweep of their own site can tell you they do not offer the service. Confusing the two sends you after entirely the wrong opportunity.
Method
Why there is no pricing page
Every engagement is quoted after a conversation, and there are no prices anywhere inside the product either. That is a deliberate constraint with a reason, not a sales tactic to make you call.