All lessons
Lesson 12

Markets, information, incentives & causal evidenceModule 03 · Business models, economics & strategy

IGNITE EXTENDED / LESSON 12

Markets, information, incentives & causal evidence

What explains a market outcome beyond the observed price?

A market-mechanism sketch and a causal-test note.

S21 · S221 / 32
1
12 / OpeningMarkets, information, incentives & causal evidence

The decision and the learning goals

  • Explain a simple market-clearing intuition
  • Identify hidden information or incentives that obstruct trade
  • Distinguish an observed preference from a causal explanation
90-minute workshopOpening 5 minConcepts and original examples 35 minPractice 25 minDebrief 15 minReview 10 min
S21 · S222 / 32
2
12 / TheoryMarkets, information, incentives & causal evidence

Surplus exists before the price divides it

A buyer’s reservation value is the most the exchange is worth to that buyer under the stated conditions. The seller’s relevant cost includes the value of the next best use of the resource. If the buyer values the unit more highly, exchange can create surplus.

The transaction price determines how the parties divide that surplus. A price that one party rejects can prevent a mutually beneficial trade. The classroom market exercise also shows why information, timing and rules influence whether potential surplus becomes an actual exchange.

S21 · S223 / 32
3
12 / TheoryMarkets, information, incentives & causal evidence

Information and incentives affect what people reveal

A participant may know their own willingness to pay or cost while remaining uncertain about the other side. Revealing the true reservation value can affect bargaining, so statements about value reflect incentives as well as private information.

A market mechanism determines how offers become trades and what participants can learn from observed behavior. A failure to trade does not necessarily mean that no beneficial exchange existed. Search costs, uncertainty about quality or a strategic attempt to obtain a better price may explain it.

S21 · S224 / 32
4
12 / TheoryMarkets, information, incentives & causal evidence

Reservation values and opportunity costs

  • A buyer’s reservation value describes what an exchange is worth to that buyer.
  • A seller gives up an alternative use of the resource.
  • An exchange can create surplus when the buyer values the resource more than the seller’s relevant cost.
  • Prices divide that surplus; they do not explain every constraint on exchange.
S21 · S225 / 32
5
12 / TheoryMarkets, information, incentives & causal evidence

A simple market

A simple marketSupplyDemandQuantity (illustrative)Price

Illustrative supply and demand: quantities become attractive to sellers and buyers at different prices.

S21 · S226 / 32
6
12 / TheoryMarkets, information, incentives & causal evidence

Why a mutually useful exchange may fail

ProblemExampleQuestion
Missing informationA buyer cannot assess reliability.What evidence can be credibly shared?
Agency incentivesA decision maker benefits from a costly choice.Who gains and who bears the cost?
Strategic behaviorA party hides information to influence the price.What can others infer from behavior?
S21 · S227 / 32
7
12 / TheoryMarkets, information, incentives & causal evidence

A signal and a statement

A statement can be easy to make regardless of quality. A signal is informative when taking the action has different consequences for different underlying types.

Statement

An interested party says a product is reliable.

Signal

An action or commitment may provide additional information, but its meaning depends on incentives and the cost of imitating it.

Worked application

Illustrative application: “our service is reliable” is a claim any seller can make. A meaningful service commitment might expose an unreliable provider to higher expected cost. Whether it informs the buyer depends on the terms, enforceability and incentives, not the mere presence of a guarantee label.

Ask why a low-quality provider would find the action harder or less attractive. Otherwise the supposed signal may carry little information.

S21 · S228 / 32
8
12 / Source insightMarkets, information, incentives & causal evidence

Supply, demand and the equilibrium price

The standard diagram: a downward-sloping demand curve and an upward-sloping supply curve cross at equilibrium price P* and quantity Q*.

The crossing assumes buyers and sellers know enough to find each other and trade at that price. The rest of the lesson asks what happens when information, incentives or rules stop the market from reaching it.

Source insight · S21 · PDF page 39 / 32
9
12 / Source insightMarkets, information, incentives & causal evidence

The market game: a two-sided auction with private values

The setup: producers, consumers and traders in several separate markets. A producer's widget is worth its production cost if unsold. A consumer earns a private reservation value for one widget only. Players who end in debt must pay.

Each participant knows only their own number. Every gain from trade exists on paper before play starts; whether it is realized depends on how much people reveal through bids and asks.

Source insight · S21 · PDF page 410 / 32
10
12 / Source insightMarkets, information, incentives & causal evidence

The market game rules: bids, asks and clearing

Eight rules: bids from $0 to $10 in $0.10 steps; the system shows the highest bid and lowest ask; server queue order can override a higher bid; trades happen by taking a standing bid or ask; all bids and asks clear after each trade; a clock runs; balances cannot fall below −$20.

The rules are the market mechanism. Clearing all offers after each trade and showing only the best bid and ask limit what players learn. Changing those rules would change which trades happen, even with identical values and costs.

Source insight · S21 · PDF page 511 / 32
11
12 / Source insightMarkets, information, incentives & causal evidence

What was going on? Supply and demand from the game

Step-like supply (rising from about 0.6 to 1.9) and demand (falling from about 2.0 to 0.9) across units 1–6, crossing between units 3 and 4 at about 1.3–1.4.

Built from players' private costs and values, the curves predict roughly three to four trades near the crossing price. Compare that with what actually traded: missed trades and outlier prices show the effect of hidden information and strategic play.

Source insight · S21 · PDF page 812 / 32
12
12 / Source insightMarkets, information, incentives & causal evidence

What makes it difficult to trade? Five obstacles

Five obstacles: lack of information (above the surface); no incentive to reveal private information or to trust others (below the surface); strategic behavior, indirect signaling and posturing (subliminal); value perceptions and expectations; agency problems (who decides, and with what incentives).

Use it as a diagnostic checklist when a deal that should create value does not close. Agency problems matter for B2B sales: the person using the product is often not the person paying for it.

Source insight · S21 · PDF page 913 / 32
13
12 / TheoryMarkets, information, incentives & causal evidence

Correlation allows several causal explanations

Suppose customers who receive a sales call purchase more often. The call may cause purchases, or salespeople may select customers already likely to buy. A third factor, such as urgency, may influence both the call and the purchase.

A causal question asks what would happen to the same relevant population under a different action. Random assignment can make treatment and comparison groups similar on average before the action. The interpretation still depends on implementation, sample size and the outcome being measured.

S21 · S2214 / 32
14
12 / TheoryMarkets, information, incentives & causal evidence

An A/B result needs a mechanism and a decision context

A statistically or practically noticeable difference does not explain why it occurred. A change in a message could attract a different type of customer, alter expectations or shift purchases in time. The immediate metric may omit a later consequence.

Choose an outcome connected to the business decision and check relevant downstream effects. Repeat purchasing, service burden and refunds can matter when a treatment increases initial conversion. The economics source encourages using experiments to understand behavior rather than treating a single winning variant as the end of analysis.

S21 · S2215 / 32
15
12 / TheoryMarkets, information, incentives & causal evidence

Observed behavior needs an explanation

  • People may respond to price, information, timing or constraints.
  • The same action can have several causes.
  • A correlation can be useful for prediction without identifying a causal mechanism.
S21 · S2216 / 32
16
12 / TheoryMarkets, information, incentives & causal evidence

Correlation and a causal question

An observed association does not identify which change produced the outcome. The business decision usually requires a causal explanation.

Observed relationship

Customers receiving a tutorial retain better.

Causal question

Did the tutorial improve retention, or were more motivated customers more likely to take it?

Worked application

Illustrative application: trained salespeople close more deals. Training may help, but experienced or motivated people may be more likely to take it. Before budgeting for training, investigate a comparison that separates its effect from pre-existing differences and changes in customer mix.

Design the test around the intervention the organization can choose, the outcome that matters and plausible alternative explanations.

S21 · S2217 / 32
17
12 / TheoryMarkets, information, incentives & causal evidence

Design a test that teaches why

Start with a causal explanation and choose an intervention that can challenge it. A result is easier to interpret when the comparison is planned in advance.

01

Hypothesis

State the mechanism: customers abandon signup because the permission request appears before they understand the benefit. Specify the target population and the behavior the explanation concerns.

02

Comparison

Compare the current sequence with a revised sequence while keeping other material differences controlled. Use a suitable assignment process so that a pre-existing difference between groups is less likely to explain the result.

03

Observation

Measure completion and the consequences that matter, such as later activation, support requests and errors. A higher click rate can coexist with poorer downstream customer outcomes.

04

Interpretation

Check whether the result is consistent with the proposed mechanism and whether other explanations remain. Record the sample, conditions and uncertainty before generalizing beyond the test.

A measured difference supports a narrower conclusion than “the new version is better everywhere.” Scope and implementation affect what the experiment can establish.

S21 · S2218 / 32
18
12 / TheoryMarkets, information, incentives & causal evidence

A/B testing is not the end of interpretation

  • Random assignment can help identify an effect under the test conditions.
  • It does not automatically explain the mechanism or transfer to every customer.
  • Measure the relevant task and intermediate behavior when the “why” matters.
S21 · S2219 / 32
19
12 / Deep diveMarkets, information, incentives & causal evidence

Attributed versus incremental: what Relay actually adds

The counterfactual changes the number you can defend in a sales conversation.

The $96,000 headline is gross: it treats every Relay fill as new revenue. The course uses the incremental ~$66,000 for value claims, pricing and EVC. A buyer will ask what the phone tree would have filled anyway, and whether moving a patient up simply empties a later slot. Each adjustment lowers the claim but makes it believable. All figures are illustrative.

Even the most conservative row leaves value far above the $4,070 annual price, so the honest number still sells. It also sets the target the causal test must confirm.

Measure (per clinic)CalculationVisits/weekValue/year
Attributed fills (headline)42 × 40%16.8≈ $96,000
Phone tree baseline42 × 12.5%5.25≈ $30,000
Incremental fills42 × (40% − 12.5%)11.55≈ $66,000
Incremental, if 15% of Relay fills only move a patient up and leave the original slot empty11.55 − (16.8 × 15%)≈ 9.0≈ $52,000
S21 · S2220 / 32
20
12 / Source insightMarkets, information, incentives & causal evidence

Lack of information: what was missing, and what signaled it?

A discussion slide with two questions: what information was missing, and were there any indirect signals?

Two diagnostic questions to ask after any failed exchange. Indirect signals such as the timing of a bid or a refusal to move on price carry information only when faking them would be costly.

Source insight · S21 · PDF page 1021 / 32
21
12 / Source insightMarkets, information, incentives & causal evidence

A/B testing is essential, but also find out why

Text: design tests that capture behavior and record enough dimensions to trace causation; A/B testing is essential, but invest in learning why people prefer A to B.

An A/B result tells you which variant won under the test's conditions. Without the mechanism you cannot predict whether it will hold for another segment, season or channel, which is usually the decision you face.

Source insight · S21 · PDF page 1322 / 32
22
12 / Reading debriefMarkets, information, incentives & causal evidence

The Market Game / summary

Selected reading: PDF pages 1, 2

The handout specifies a simplified market in which people trade identical widgets while holding different private costs and reservation values. Its rules make incentives and information visible for analysis.

  • Roles carry different values

    A producer begins with one widget and a production cost; a consumer has a reservation value; a trader can buy and resell.

  • Bids and asks reveal choices

    A transaction occurs when an offer is accepted or compatible prices meet. After a trade, participants must submit fresh bids and asks.

  • Information is incomplete

    Participants do not know all others’ costs, values or exact numbers. Their offers and observed transactions provide information during play.

  • Constraints define the experiment

    Production is fixed at the initial endowment and a participant must own a widget before selling it. These rules shape the possible outcomes.

Reading debrief · S22 · PDF pages 1, 223 / 32
23
12 / Reading debriefMarkets, information, incentives & causal evidence

The Market Game / discussion

Selected reading: PDF pages 1, 2

Critical points

An instruction and a result

The handout defines the game. Claims about price convergence, efficiency or actual participant behavior require observations from a run.

Opportunity cost

A reseller’s earlier purchase price is relevant to accounting but a resale choice also depends on the current alternative use or value of the widget.

A simplified market

Identical goods and fixed production remove important real-world complications. State which mechanism the exercise isolates before transferring its conclusion.

Reading debrief · S22 · PDF pages 1, 224 / 32
24
12 / ApplicationMarkets, information, incentives & causal evidence

The market game: price discovery with hidden information

The archived exercise gives participants different values, costs and trading roles. Visible bids and asks coexist with private information. The resulting trades can be examined through supply, demand, incentives and beliefs.

Which constraints explain a missed trade?

S21 · S2225 / 32
25
12 / Current practiceMarkets, information, incentives & causal evidence

Current practice: signals and evidence when content is cheap to fake

Fake reviews are now directly regulated in the US

The FTC's rule on consumer reviews and testimonials took effect on 21 October 2024. It bars buying, selling or disseminating reviews that misrepresent the reviewer's existence or experience, paying for reviews that express a particular sentiment, and suppressing negative reviews. Civil penalties were up to $51,744 per violation when the rule took effect and are adjusted annually for inflation. A testimonial-based signal must therefore be genuine as well as persuasive. Application depends on current law and facts.

AI agents can contaminate online survey evidence

A 2025 PNAS study by Sean Westwood (Dartmouth) built an AI agent that completed online surveys with a consistent persona. It evaded 99.8% of standard detection checks at about five cents per response, and could be steered to confirm a hypothesis. Customer-discovery surveys run on open online panels need verified samples, behavioral data or in-person checks before they count as evidence.

Sources: Morgan Lewis: FTC issues final rule on consumer reviews and testimonials · Dartmouth: Sean Westwood wins PNAS prize for AI polling study · 404 Media: A researcher made an AI that completely breaks the online surveys scientists rely on

S21 · S2226 / 32
26
12 / PracticeMarkets, information, incentives & causal evidence

Analyze a small exchange table

Fictional market: buyers value a unit at $9, $7 and $4; sellers’ costs are $2, $5 and $8. Each can trade one unit. Assume no transaction cost and full information for the first pass.

Your task

Identify mutually beneficial matches. Then add a reliability uncertainty and explain what additional information would matter.

S21 · S2227 / 32
27
12 / DebriefMarkets, information, incentives & causal evidence

Worked answer and reasoning

  • Two units can create gains: the $9 buyer with the $2 seller, and the $7 buyer with the $5 seller.
  • The remaining $4 value is below the remaining $8 cost, so that trade destroys value under these assumptions.
  • Reliability uncertainty can change willingness to pay; investigate it rather than attributing every failed trade to price.
S21 · S2228 / 32
28
12 / Venture stepMarkets, information, incentives & causal evidence

Venture step: Prove Relay causes the fills

Relay · venture step 12

Relay's pitch says it refills about 40% of a clinic's ~42 weekly empty slots, worth ~$96,000 a year gross. A skeptical multi-location buyer asks: how many of those slots would have been filled anyway? The front desk phone tree already fills 10–15%. The three pilot clinics were chosen because their managers were enthusiastic. Fill rates are seasonal. Front desk staff also have their own incentives: some worry that Relay replaces them; others may log phone fills as Relay fills, or the reverse.

Your task

Write a one-page causal-test note. Include the counterfactual, the unit of randomization, the primary metric (net incremental visits), the guardrail metrics, how front desk incentives will be aligned, and the result that would make you change the sales pitch.

Relay · illustrative venture29 / 32
29
12 / Venture stepMarkets, information, incentives & causal evidence

Venture step: worked reasoning

  • Counterfactual: the same cancellations handled by the usual phone tree. Randomize each cancellation (or each clinic-day) to Relay or the phone tree, so that manager enthusiasm, season and patient mix are balanced across arms.
  • Primary metric: net incremental visits. A Relay fill that moves a patient up from a later booking only helps if that later slot is also refilled. Count completed visits, not texts accepted. Guardrails: no-show rate on refilled slots, patient opt-outs, staff time.
  • Illustrative arithmetic: at 40% vs a 12.5% baseline, incremental fills = 42 × (0.40 − 0.125) = 11.55 visits/week × $110 ≈ $1,270/week ≈ $66,000/year. That is lower than the $96,000 headline, which counts every Relay fill as new, but still about 16× the $4,070 annual price.
  • Sample: 10 clinics × 8 weeks × 42 cancellations ≈ 3,360 cases, about 1,680 per arm. The standard error of the difference is about 1.4 percentage points, so a 27-point gap is unmistakable. Cluster the analysis by clinic and report the range across clinics, not only the pooled average. The 10 clinics include the 3 Wizard-of-Oz pilot clinics from Lesson 5, and the Relay arm is judged on the same pre-set rule: fill rate of 30% or more, keep building; 15–30%, revise; under 15%, reconsider.
  • Incentives: tell staff the test measures the tool, not them. Log fill source automatically from the EHR. Reward the clinic's total filled visits rather than Relay attributions. Pitch change: if incremental visits fall below about 6/week (≈ $34k/year), lead with time saved instead of revenue.
Relay · illustrative venture30 / 32
30
12 / DebriefMarkets, information, incentives & causal evidence

Reasoning traps

Counting attributed fills instead of incremental visits

A fill-rate dashboard credits Relay with every slot it fills, including slots the phone tree would have filled and patients moved up from a later booking. The decision needs the difference from the counterfactual: completed visits that would not have happened otherwise.

Judging impact by who adopted

Pilot and early-adopter clinics differ from the rest: more motivated managers, deeper demand, better data. Before-and-after or adopter-versus-non-adopter comparisons mix Relay's effect with those differences. Randomize at the cancellation or clinic-day level instead.

Ignoring the incentives of whoever records the outcome

When front desk staff decide which channel fills a slot and also log the result, their incentives shape the data. Capture fill source automatically and reward total filled visits so the measurement does not depend on someone's job worry.

S21 · S2231 / 32
31
12 / ReviewMarkets, information, incentives & causal evidence

What you can now explain

A Relay causal-test note: cancellation-level randomization against the phone tree, net incremental visits as the primary metric (≈ $66k/yr illustrative vs the $96k headline), guardrails, and an incentive plan for front desk staff.

  • Trade creates surplus when value exceeds cost; hidden information, weak incentives to reveal it, and agency problems explain why available surplus often goes unrealized.
  • A credible signal is an action a low-quality party would find too costly to copy; a statement anyone can make carries little information.
  • A causal claim needs a stated counterfactual and a comparison in which treatment does not depend on who chose it; the A/B result then needs a mechanism before you generalize it.

Next lesson: Game theory: commitments, trust & coordination

S21 · S2232 / 32
32