PJ-03 · Product Judgment
Trade-offs and opportunity cost
A choice is only real when the displaced option, resource, risk, and future flexibility are visible.
This lesson builds on PF-04 Right-sized framing, PF-06 Opportunity worth solving, PJ-02 Define good.
a ranking where nothing was given up
A PM runs a prioritization session. Every candidate gets a score. The top three go on the roadmap. Everyone leaves satisfied.
Eight weeks later, two of the three have slipped, the third shipped thin, and the enterprise account manager is asking why nothing happened. The PM looks back at the session notes and finds scores, ranks, and a roadmap. Nowhere is there a sentence saying what was given up.
Here is the specific move that failed. Asked to choose between fixing large- workspace response times and building enterprise summaries, the PM said: "we'll do performance first, then summaries." That sentence feels like a decision. It is not. It is a sequence, and it hides the actual trade-off, which is that summaries are being delayed by however long performance takes — an amount nobody estimated, against a bar nobody set.
The failure is hard to see because a prioritized list looks exactly like a set of decisions. Ranking is not choosing. A choice exists only when something specific stops being possible, and someone can name what it was. A list where everything survives in some form has decided nothing; it has only re-ordered the disappointment.
Follow the top path and notice that nothing is ever given up — which is exactly why the cost surfaces two months later, in someone else's inbox:
flowchart LR L["Scores and ranks"] --> R["Roadmap<br/>everything survives"] R --> S["'Performance first,<br/>then summaries'"] S --> H["Displacement hidden<br/>inside a sequence"] H --> W["Eight weeks on:<br/>two slipped, one thin"] S -.->|"what makes<br/>it a choice"| N["Delayed by N weeks<br/>Cost X, borne by Y<br/>Accepted because Z"]
Ask after any prioritization: what is now not happening, who was expecting it, and when will we tell them? If nobody can answer with a name and a date, the session produced a ranking, not a decision.
name what stops happening, and who pays
A real trade-off is visible on five faces. Most teams show one — usually cost — and call it analysis.
| Face | The question | What hides when it is missing |
|---|---|---|
| Displaced option | What specifically stops happening, and who was expecting it | The chosen option looks free |
| Resource | Which scarce capacity is consumed, and is it substitutable | "We'll find the time" replaces a real constraint |
| Risk | What gets worse, or more likely, if this is wrong | Downside lands on a population nobody named |
| Future flexibility | Which options close, and when they reopen | You discover in month three that you locked something in month one |
| Reversal cost | What it costs to undo this in four weeks | Reversible and one-way choices get treated identically |
Opportunity cost is measured against the best displaced alternative
Not against doing nothing. This is the most common error in product prioritization, and it is invisible from inside.
When a team says "the performance work is worth it because slow workspaces cost us paid seats," they are comparing the work to inaction. The real comparison is against the best thing those same engineers would otherwise have built. If that alternative was worth more, the performance work is a loss even though it is positive on its own.
This is why PJ-02 comes first. Two directions cannot be compared. Two thresholds can. If you cannot state what each option buys, in what amount, for which population, you cannot say which one you are giving up.
Capacity is not fungible
Teams reason as if engineering time is a pool of hours. It is not. The two engineers who can do a dependency migration may be the same two who can do the storage-layer work behind large-workspace performance. Moving "40% of capacity" between two projects can mean moving 100% of the only people who can do either.
Before you write a trade-off, name the specific scarce resource: not hours, but the people, the review bandwidth, the design attention, or the single decision-maker whose time everything queues behind.
Sequencing is a trade-off, not an escape from one
"First A, then B" displaces B by the duration of A. That delay has a cost, and the cost is usually paid by a population that was not in the room. Sequencing is often the right answer. It is never a way to avoid stating what was given up.
Write it as: B is delayed by approximately N weeks. The cost of that delay is X, borne by Y. We accept it because Z.
Here is that sentence applied to the two Noted signals, next to the version most teams actually say:
Weak — "We'll do performance first, then summaries."
Both options survive, so nothing was chosen. No resource is named, no delay has a length, and the person who loses is not in the sentence. It cannot be argued with, because it does not claim anything.
Strong — "The storage-layer engineers go to large-workspace P95 this cycle. Summaries are delayed by roughly one cycle. The cost lands on the account manager holding the three enterprise requests, who is told this week with a date. We accept it because the P95 rise was observed directly and the summaries claim has never been tested."
The difference is that the strong version can be refused. The account manager can read it, recognise the description of their own loss, and argue that the delay is worth more than the P95 recovery. That argument is the decision.
One caution about the strong version: "the storage-layer engineers" is an
exercise input. The case does not say who can do the response-time work. When
you write yours, name the real people or write <unknown>. Do not borrow a team
from an example.
Boundary
Not every choice deserves a trade-off record.
For a cheap, reversible, low-consequence choice, the record costs more than the decision. A team that documents every trade-off will document them badly, and will slow down exactly where speed was free. The dividing line is consequence multiplied by reversal cost — which is the subject of PJ-04.
The second limit is more dangerous. A trade-off record written after the decision is not analysis; it is a defence. Once a choice is made, every face of it can be described in a way that makes the choice look correct. If you find yourself writing a trade-off record to explain a commitment already announced, label it as a rationale, not as a decision record, and do not let it enter the evidence base as if it were one.
Practice on the Noted decision case
Read the Noted case if you have not already.
Take Signal 3: P95 response time rose 34% for large workspaces, and put it directly against Signal 2: three enterprise customers asked for automated meeting summaries.
Take it as the exercise premise that both need the same engineering team this cycle. The case does not say so, but it is the condition under which a trade-off exists at all. Both have advocates. The case gives you:
- Large workspaces are more than 500 documents, about 4% of workspaces, holding a disproportionate share of paid seats. No support tickets mention speed. The signal came from monitoring.
- The three summary requests came through one account manager within one month. Their combined contract value is roughly 20% of current revenue. The underlying claim about lost decisions and owners has never been tested. Meeting type is not captured in event data.
Two axes separate these two options: how well the mechanism is actually observed, and how far the consequence reaches. One reading looks like this:
quadrantChart title Two Noted signals, one engineering team x-axis Mechanism untested --> Mechanism observed y-axis Consequence contained --> Consequence reaches paid revenue quadrant-1 Strong case to act now quadrant-2 Pressure without evidence quadrant-3 Park it quadrant-4 Small stakes, cheap certainty Large-workspace P95: [0.78, 0.6] Enterprise summaries: [0.2, 0.72]
The placement is the argument, not a fact from the case. Summaries sit high only if you treat 20% of revenue as exposed, and nothing in the case says those contracts are at risk — move that point down and the chart reverses. P95 sits right because monitoring observed it, but no support ticket mentions speed, so you could argue it right and low instead. Neither point can be placed at all until both options are thresholds rather than directions.
Your task. Choose one. Then make the choice real.
- State each option as a threshold, using your PJ-02 work. What does each one buy, in what amount, for which population, by when? If you cannot write both, say which one you cannot write and what that tells you.
- Name the scarce resource specifically. Not "engineering capacity" — which people, and what else are they the only ones who can do.
- Choose. One option, stated as a choice.
- Write the displaced option in the words of the person who loses it. For summaries, that is the account manager. For performance, that is whoever is watching paid-seat retention. Write it so they would agree it is fair.
- State what the delay costs, with a rough magnitude and who bears it. If your answer is "we do it next cycle," say what next cycle then loses.
- Name which future options close and when they reopen.
- State the reversal cost: what it costs to switch back in four weeks.
- Name the one thing that, if you learned it next week, would flip your choice.
Expect to be pushed on: whether "do both, just staged" is hiding in your plan; whether you weighed the 4% of workspaces by count or by paid seats, and whether you said which; and whether the 20% revenue figure entered as evidence of value or as pressure, given that nothing in the case says those contracts are at risk.
Committed to a position? Check it against what a strong answer holds
- Both options are written as thresholds — or the answer admits that the summaries option cannot be written as one yet, because its underlying claim is untested, and says what that admission does to the comparison. Either is strong. Pretending both are thresholds is not.
- The scarce resource is people or a named bottleneck, not hours. If the case
does not say who can do the work, the answer writes
<unknown>rather than inventing a team, and says what that gap does to the plan's credibility. - One option is chosen. The other is displaced with a length of delay, a cost, and a named bearer — written so the account manager, or the person watching paid-seat retention, would accept the description of their own loss.
- Future flexibility and reversal cost are answered as separate questions: which options close, when they reopen, and what switching back in four weeks costs in work already done.
- The flip condition is a single learnable fact with a source — something the support lead's recordings, monitoring, or the account manager could deliver next week — not "if priorities change".
- The most common weak move is "performance first, then summaries." It is weak because it is a sequence, not a choice: nothing is given up on paper, so the cost surfaces two months later, in someone else's inbox, with no record of who accepted it.
Transfer the move to your product
Take a real choice your team is making this quarter, where two things compete for the same constrained resource.
Answer five questions:
- What specifically stops happening, and who was expecting it?
- Which scarce, non-substitutable resource is consumed?
- What gets worse or more likely if you are wrong, and for whom?
- Which future options close, and when do they reopen?
- What would it cost to reverse this in four weeks?
Write <unknown> where you cannot answer. Question two is the one most teams
cannot answer honestly, and it is usually the one that decides whether the plan
was ever achievable.
Keep one reusable artifact
Trade-off record
Write it for the next person who must make or review the decision. Include the choice, evidence, uncertainty, alternatives, owner, and revision trigger. Link it into your cumulative Product Decision Case.
Produce artifacts/PJ-03-trade-off-record.md using the template below.
Write it for the person who loses. The displaced option should be described well enough that its advocate would accept the description, even while disagreeing with the conclusion. That is the difference between a record and a defence.
This extends your Product Decision Case. PJ-02 said what good looks like for one thing. This artifact is the first time two definitions of good compete, and one of them loses.
artifacts/PJ-03-trade-off-record.md# Trade-off record · <chosen option> over <displaced option> - **Date:** <YYYY-MM-DD> - **Product:** <product> - **Decided before or after commitment:** <before | after — if after, this is a rationale> - **Owner of the consequence:** <person or role> - **Specialist authority:** <who holds expertise this choice depends on> ## The options, as thresholds | Option | What it buys | Amount | Population | By when | |---|---|---|---|---| | <option A> | <change> | <threshold> | <behaviour-and-context boundary> | <horizon> | | <option B> | <change> | <threshold> | <behaviour-and-context boundary> | <horizon> | <If you could not write one of these rows, say which and why. An option you cannot state as a threshold is one you cannot honestly compare.> ## The scarce resource - **What is actually constrained:** <the specific people, review bandwidth, design attention, or decision-maker — not "engineering capacity"> - **Substitutable?** <can anyone else do this work, and at what cost in time or quality> - **What else this resource is the only source of:** <the hidden queue behind it> ## The choice <One sentence. The option being taken.> ## Displaced option **Stated by the person who loses it:** <Write the displaced option's case in the words of its advocate. If they would not recognise it as their argument, rewrite it.> - **Who was expecting it:** <name or role> - **When they will be told:** <date> - **Delay, if this is a sequence:** <approximately N weeks> - **Cost of that delay:** <magnitude> — borne by <who> - **Why that cost is accepted:** <one or two sentences> ## Risk | If this choice is wrong | What gets worse | Who bears it | How early it becomes visible | |---|---|---|---| | <failure mode> | <consequence> | <population> | <date or event> | ## Future flexibility | Option that closes | When it closes | When it reopens | What reopening costs | |---|---|---|---| | <option> | <date or event> | <date or event, or "not on this horizon"> | <cost> | ## Reversal cost - **Cost to switch back in four weeks:** <what is lost — work, momentum, trust, or contract position> - **Reversibility:** <reversible | costly to reverse | one-way> ## What would flip this <One thing you could learn in the next two weeks that would change the choice. Name the observation, not the topic. If nothing would flip it, this was not a trade-off — it was a foregone conclusion, and you should say so.> ## Gaps <Everything marked `<unknown>` above, listed as open questions with who could close them.>
Before you call it done
Six things a reviewer must be able to find. If one is missing, the artifact is not finished — it is a draft with a hole in it.
Before saving, check all six exposures are present. Name any that are missing rather than filling them in yourself:
| Exposure | Present when |
|---|---|
| Choice | One option is taken, and something specific stops being possible |
| Evidence | Both options are stated as thresholds with populations, or the missing one is named |
| Uncertainty | Risk names a failure mode, a bearer, and when it becomes visible |
| Alternatives | The displaced option is written in its advocate's words, with the delay cost and its payer |
| Owner | Consequence owner and specialist authority are distinguished, and the person told about the displacement is named with a date |
| Revision trigger | One observation that would flip the choice, not a topic to monitor |
Can the reasoning survive these tests?
Answer before you open the explanation. The tutor asks these one at a time and does not show the options’ verdicts until you commit.
01Forced to choose between large-workspace performance and enterprise summaries, a PM says: "Performance first, then summaries." Why is this not yet a decision?
- ABecause the engineering estimate for performance work has not been produced
- BBecause summaries have a larger revenue base and should therefore go first
- CBecause sequencing decisions require sign-off from the account manager
- DBecause it names an order without naming what the delay to summaries costs, or who bears it
Reveal the answer
D. Sequencing displaces the second option by the duration of the first, and that delay has a cost and a payer. Option A is the tempting one: an estimate would sharpen the sequence, but you could have a perfect estimate and still have recorded no trade-off.
02A PM justifies the performance work: "Slow workspaces put paid seats at risk, so this is clearly worth doing." What is the reasoning error?
- AThe 34% figure came from monitoring rather than from customers
- BThe work is being compared to doing nothing, not to the best alternative use of the same engineers
- CP95 response time is not a user-facing metric
- D4% of workspaces is too small a population to justify a cycle of work
Reveal the answer
B. An option can be positive against inaction and still be a loss against what those same engineers would otherwise have built. Option D is the answer a PM gives after learning to check population size — but a small population holding a disproportionate share of paid seats may well be worth it. The error is the missing comparison, not the size.
03An engineering lead says the team can shift "about 40% of capacity" from the migration to performance work. What should the PM check first?
- AWhether 40% is enough to complete the performance work this cycle
- BWhether the remaining 60% still meets the migration deadline
- CWhether the same specific engineers are the only ones who can do both, making the capacity non-substitutable
- DWhether 40% has been agreed with the founder before it is committed
Reveal the answer
C. Capacity expressed as a percentage hides whether the resource is a pool of hours or two specific people. If they are the same two, moving 40% may mean moving all of the only people who can do either. Options A and B both reason correctly inside a false premise — they treat the percentage as real before checking whether it is.
04A PM writes a full five-face trade-off record for a decision about which of two empty-state copy variants to ship. Both are reversible within a day. What is the problem?
- AThe record costs more than the decision, and the habit slows the team where speed was free
- BCopy changes should be owned by design, so the record is written by the wrong person
- CNothing — consistent documentation is what makes trade-offs comparable over time
- DThe record should have used a single face, reversal cost, rather than all five
Reveal the answer
A. The boundary of the model is consequence multiplied by reversal cost. Option C is the trained answer — consistency sounds like discipline, but a team that documents every trade-off documents them badly and pays the process cost exactly where it earns nothing.
05After the decision to fund performance work is announced, the PM writes a trade-off record explaining why summaries lost. How should this document be treated?
- AAs a decision record, since it contains all five faces of the trade-off
- BAs evidence that the decision was sound, since it survived being written down
- CAs invalid, because trade-off records written after a decision have no use
- DAs a rationale, labelled as such, and kept out of the evidence base as if it were a decision record
Reveal the answer
D. Once a choice is announced, every face of it can be described so that the choice looks correct. The document may still be useful for communicating the decision. Option C over-corrects — the failure is not writing it, it is letting a defence enter the record as if it were analysis.