Nobody lists it on a CV, and it is one of the few kinds of judgment that gets sharper with volume.
Most people think of giving feedback as a favour. You look at someone's idea, you say something useful, you move on.
That framing badly undersells what is happening. If you evaluate a lot of ideas, something specific develops in your head, and it turns out to be one of the more portable things you can own.
What is the actual skill?
It is telling the difference between what people say and what people would do.
That gap sounds obvious until you have to work inside it. Almost everyone, including you, reports interest they do not feel and describes intentions they will not act on. Not out of dishonesty. It is simply much easier to imagine wanting something than to want it.
The skill is catching that gap. Including in yourself, which is the harder half.
How does judging many ideas make you better at it?
Because failure has a small number of shapes, and you only start seeing them after the pattern repeats.
The first ten ideas you assess all feel unique. Somewhere around the fortieth, categories appear. This one is a solution looking for a problem. This one solves something real that nobody would change their routine for. This one is fine but the person who has the problem is not the person who holds the budget.
Founders inside their own idea almost never see the shape, because they have exactly one example. You have dozens. That is the entire advantage, and it is built purely by volume.
What makes someone a good validator rather than just an agreeable one?
Three things, and none of them is being harsh.
The first is specificity. I would not use this is an opinion. I would not use this because I already do it in a spreadsheet on Fridays and it takes eight minutes is data.
The second is honesty about your own behaviour rather than your taste. The useful question is never whether you like the idea. It is whether you would actually do the thing, and what would have to be true for that to happen.
The third is separating the idea from the person. Good validators can find an idea weak and the founder impressive, and say both.
Being unpleasant is not a substitute for any of this. Harsh and useless is still useless.
How does this fit into the wider world of flexible digital work?
Most flexible online work has one of two problems. Either it is repetitive enough that it will eventually be automated, or it is a race to the bottom on price.
Judgment work is unusual because the thing being bought is that you are a real person with real constraints and real spending habits. A synthetic respondent can produce a plausible opinion instantly and at almost no cost. What it cannot produce is a person who genuinely would or would not part with money.
That is a strange kind of job security. The value is not in the effort. It is in the fact that you are not simulated.
Where else does this judgment transfer?
Further than most people expect.
Evaluating whether a market exists is a close cousin to evaluating a hire, a supplier, a contract, or a claim someone makes in a meeting. The underlying move is the same: notice the difference between the story and the evidence, and ask what would have to be true.
It is worth being precise about one adjacent area, because the internet is loose about it. Judging whether people want a product is not the same skill as judging whether a company is a good investment. The first is about demand. The second involves valuation, dilution, timing, competitive dynamics and your own risk tolerance, and it is where a lot of confident people lose money.
Platforms for equity crowdfunding and private-market access have made early-stage investing much easier to reach in the last decade, and easier to reach is not the same as easier to do well. Most early-stage companies fail, returns are illiquid for years, and the fact that you correctly spotted real demand for a product tells you very little about whether the equity is priced sensibly. If you find yourself drawn that way, treat it as a separate discipline to learn on purpose, and treat anyone who tells you it is a natural next step with the same scepticism you would apply to any pitch.
Validating is a platform for testing product demand. It is not an investment platform and does not offer equity access. This section is context for where a judgment skill can go, not a description of what we sell.
Key takeaways
- Judging ideas is a trainable skill built by volume, not a personality trait.
- The core move is separating what people say from what they would actually do, including yourself.
- Founders have one example. Someone who assesses many ideas has a reference set, and that is the whole edge.
- Good feedback is specific and behavioural, not harsh. Harsh and vague is worthless.
- This kind of work resists automation precisely because its value comes from being a real person with real constraints.
- Judging product demand and judging an investment are related but genuinely different skills. Do not confuse the two.
FAQ
Do I need a business background to judge ideas well?
No, and it can get in the way. What matters is being honest about your own behaviour and specific about your reasoning. Industry knowledge helps only when the idea is aimed at your industry.
Is being critical the same as being useful?
No. The useful part is the reason attached to your reaction. A negative verdict with no reasoning tells a founder nothing they can act on.
How long does it take to get good at this?
Pattern recognition tends to arrive somewhere in the first few dozen ideas. Before that, everything looks unique. After it, categories start appearing on their own.
Can AI do this instead?
It can generate an opinion. It cannot be a person who would or would not spend money, and that is the entire thing being measured.
Where else is this skill worth something?
Hiring, procurement, negotiation, and any situation where someone is telling you a story and you need to work out what the evidence actually supports.