Validating

The Work That Did Not Get Automated Is Deciding What Is Good

AI generates infinite drafts. Choosing which ones are any good is still human work. Here is why judgment became the scarce skill in digital work.

Every tool now produces more output than anyone can read. The bottleneck moved to the person who says which of it is worth anything.

What kind of work did AI actually replace?

The producing part. Not the choosing part.

A well-known investor wrote this week that the most annoying thing about his own AI setup is that it just ends up generating more and more things for him to review. He was complaining, but he was also describing the shape of the new economy in one line. The output is free. The reviewing is not.

Another list doing the rounds this week named twenty-six areas worth building in. Number three was, in plain words, build the judgment layer, because everyone generates infinite drafts now and the bottleneck moved to reviewing and choosing.

That is the whole thing. Making went to zero. Deciding did not.

Why is judgment suddenly worth paying for?

Because it cannot be faked at the point where it matters.

A model can produce a critique. It can produce a thousand critiques, in any tone you like, in nine seconds. What it cannot produce is a person who genuinely would or would not spend their own money, their own afternoon, or their own attention on the thing in front of them.

Companies building products have figured this out the slow, expensive way. They can generate feedback endlessly and none of it settles the only question they care about, which is whether an actual human being with an actual life would choose this. So they pay for the human.

That is the job. Not being clever about it. Being real about it, on the record, in a way someone can act on.

What does judgment work look like day to day?

Short, contained, and specific. You look at something a stranger built. You form a view. You say what you would do, what you would not do, and why, in language that a person can use. Then you move on to the next one.

It does not require a portfolio, a following, or a degree in anything. It requires paying attention and not padding your answer. Ten minutes of clear reaction is worth more than an hour of hedging.

The strange part, and the part people underestimate before they start, is that it gets easier and better with volume. After forty of these, you start recognising the shapes. This one is solving a problem the founder has, not one their customer has. This one is priced for a buyer who does not exist. That recognition is a real skill, and nobody teaches it anywhere.

What separates a good validator from an agreeable one?

Willingness to be the one person who says the uncomfortable thing.

Being agreeable is the default setting for almost everyone. It is socially cheaper, it feels kinder, and it takes less thought. It is also worthless to the person receiving it, and everyone involved can feel that.

A good validator does three things an agreeable one does not. They separate what they personally like from what they would actually pay for, which are frequently different. They say the specific reason rather than the general impression, because the pricing page confused me at the second tier is usable and it felt a bit unclear is not. And they are willing to say no clearly when no is the honest answer.

None of that requires being harsh. Harsh is its own kind of laziness. The target is honest and specific, delivered without drama.

Does this fit into a real working life?

That is most of the appeal. The wider shift here is not really about AI. It is about work becoming smaller and more portable. One well-known operator wrote this week that in ten years, having a solo business will feel as normal as having a corporate job. Whether or not the timeline holds, the direction is obvious to anyone who has watched the last five years.

Judgment work fits that direction unusually well. It has no schedule to protect, no team to coordinate with, and no ramp-up. It sits next to a job, a degree, freelance work, or caring responsibilities, because a task either gets done in a sitting or it does not.

The honest caveat: this is not a salary replacement on day one, and anyone telling you otherwise is selling something. It is an income stream that scales with how good and how consistent your judgment turns out to be, which is a slower and more real thing.

Where does this skill go next?

Further than the platform you learn it on. Reading whether a market wants something is the same muscle whether you are reacting to a stranger's product, deciding which side project to spend your own weekend on, or sitting in a meeting where everyone is politely agreeing with an idea nobody would buy.

It transfers because it is fundamentally about separating what people say from what people do. That distinction is the most valuable and least taught thing in commercial life. Once you can see it, you see it constantly, and it stops being possible to unsee.

The people who spend a year forming and defending views on hundreds of ideas end up with something specific and portable. They know what real demand looks like, because they have been the demand, repeatedly, and paid attention while doing it.

Key takeaways

  • AI collapsed the cost of producing things and raised the value of choosing between them.
  • Judgment work pays because a genuine human reaction cannot be generated, only given.
  • Specific beats harsh, and both beat agreeable. Confusing at tier two is usable. A bit unclear is not.
  • The work fits around a life, which is most of why it works as flexible digital income.
  • It is an income stream that grows with your accuracy, not a salary replacement on day one.
  • The underlying skill, separating what people say from what they do, transfers everywhere.

FAQ

Do I need a background in tech or business to be a good validator?

No. In most cases a background is a liability, because it makes you evaluate the craft instead of the appeal. The useful question is whether you, as yourself, would use it and pay for it.

Is this the same as filling in surveys?

No. A survey collects a tick from an anonymous respondent. Validation asks for a considered reaction to something real, with reasons attached, which is why it is worth paying for and surveys mostly are not.

Will AI eventually do this too?

It can already produce feedback. It cannot be a customer. The value of a human reaction is precisely that the human had something to lose by giving it, even if only their time.

How do I know if I am any good at it?

Look at whether your reactions are specific enough to act on, and whether you are willing to say no when no is true. If every response you give is broadly positive, you are being polite, not useful.

Does the skill matter outside of validating products?

Yes. Telling stated interest apart from real intent is the same skill whether you are judging someone else's product, your own idea, or a proposal in a meeting where everyone is already nodding.

The output is free now. The person who can tell you which of it is any good is not.