All posts

The science

Bias training is debugging the wrong layer

Escalation of commitment is not a character flaw. Two model copies deliberating as equals escalated at 99.2%; alone with no stake, the same model cut its losses.

6 min read

In August 2025, three researchers ran the same language model through the same failing investment 6,500 times. Alone, with nothing personal riding on the outcome, it cut its losses. Put two copies in a room as equals, and 99.2% doubled down.

Same reasoner. Same numbers. Different room.

We treat sunk-cost persistence as a character flaw. We send people to bias training, then promote whoever seems tough-minded. The evidence from the last twelve months, most of it from machines rather than people, says we have been debugging the wrong layer.

Same reasoner, different room

The study is Barkett, Long and Kröger, August 2025. In individual contexts (N = 4,000) the models "demonstrate strong rational cost-benefit logic with minimal escalation of commitment." The abstract reports "a striking hierarchy effect": asymmetrical hierarchies escalate at 46.2%, "while symmetrical peer-based decision-making produces near-universal escalation (99.2%)."

The boss in the room was not the problem.

Study 4 (N = 2,000) dropped deliberation entirely and cast a single model as a VP of Finance who had championed one division for two decades. The authors report that rational behaviour "completely reversed under two critical conditions": peer deliberation, and "identity-based attachments led nearly all participants (97.45%) to over-allocate resources to underperforming divisions they had championed."

So the room is not the only trigger. Skin in the game is the other, and it needs no room at all. Who is in the meeting and whose name is on the thing being graded are both configuration.

Two peers, as equals
99.2%
Study 3 (N = 500). Language models, not people.
Hierarchy, same task
46.2%
The condition with a boss in it escalated less.
Alone, identity attached
97.45%
Study 4 (N = 2,000). No deliberation at all.

These are language models, not people. The authors used one model, o4-mini-2025-04-16, and say so plainly: "our choice to use a single primary model for the main analysis surely limits the generalizability of our findings." It is a preprint. Nobody has run the human version of this experiment in the last year — I looked.

Herrmann, Hirsch and Lindermüller ran 283 elected politicians through the same trap (Public Management Review, online 20 April 2026). They found that "politicians escalate significantly stronger before elections than afterwards. However, visualization aids can counteract escalation even before elections."

Same politicians. Different audience. The bias moved with who was watching.

Silence is the rational move

On a 272-point Hacker News thread in January 2026, a commenter laid out the payoff matrix for objecting:

If you manage to kill the project before it starts, no one will ever know how bad of a disaster you prevented. If the project succeeds despite your objections, you look like an idiot. And if it fails - as the author notes, that doesn't get remembered either.

His summary: "There's not much ROI for being 'right'."

That is not a cognitive error. It is arithmetic, and it is correct.

John Cutler, April 2026: "Eventually, people just stop saying anything. Not because they don't see the problems. Because the cost of naming them is too high."

A commenter on Eric Ries's 809-point AMA in June 2026 put it bluntly: "Once your org has enough levels of management, anyone that is part of the big decisions and isn't a team player has already been filtered out."

This is also how a hierarchy can escalate less than a room of equals and still be the worse place to work. Rank suppresses what gets said. Symmetry suppresses who has to own the reversal.

The room does not corrupt good judgment. It changes the price of saying it out loud.

The room adds, and never subtracts

Two AWS executives in residence, Phil Le-Brun and Jana Werner, keep the receipts. In June 2026 they described a financial-services team that modernized 100,000 lines of code over a weekend; the security review board scheduled a four-month line-by-line audit.

The execution took forty-eight hours. The permission took a third of a year.
Phil Le-Brun and Jana Werner, June 2026

And the part nobody instruments: "The backlog of stalled decisions inside your company is almost never tracked."

A December 2025 comment in r/ExperiencedDevs describes a manager who inherited Pizza Fridays and wanted Lasagna Fridays. The department now eats both: "Now, we've got twice the policy in place to keep the peace."

In a 155-point comment from November 2025, an insurance department wanted Excel spreadsheets turned into a web app. Internal IT quoted a million in local currency and eight months. The department went external, paid about 300,000, and the system shipped on 30 December — because delivery that calendar year was in three executives' bonus targets. It had been built without IT's approval, so it could not be used. The commenter's accounting: "Its only purpose had been to fulfill the financial bonus requirement of having the system developed, and that was last year's goal."

Not one person in that story made an irrational decision. The money burned anyway.

The best argument against all of this

The strongest case for the room is that its friction is sedimented experience. From a 102-point comment in December 2025: "yeah all that bureaucracy is written in blood. Each one was probably an outage or an incident that will now never happen again (or just found by an auditor), at the cost of inconveniencing people forever." A 184-point comment from November 2025 is blunter: "Architectural design reviews are fairly standard in my experience and lead to higher productivity. It ensures that no time is wasted on coding a flawed premise."

Barrera-Lemarchand and colleagues report 1,140 online group deliberations in Nature Communications, 5 August 2026. In Study 2 (N = 240), groups told to break a problem into parts beat groups told to combine their opening guesses. Both arms were talking; the instruction was the only variable.

Study 3 (N = 160) is the finding I like least: the benefits were "larger when the strategy is applied collectively rather than individually."

Most of the dramatic numbers in this piece come from language models, not people: the 99.2%, and a June 2026 finding that multi-agent discussion "erases up to 72% of issue-critical facts" while stances converge — the authors' own phrase is that "agents can agree more while knowing less." Whether any of that transfers to human rooms is unsettled, and there is published work arguing LLM groups and human groups behave differently.

The best human test I found cuts against me. Alsobay, Rothschild, Hofman and Goldstein ran a preregistered experiment with 1,475 participants in 281 live groups on a hidden-profile task. LLM facilitation "increased information shared within a discussion." And then: "Whether by human or AI, there was no significant effect of facilitation on the final decision outcome."

That is exactly what you would predict if the problem is the payoff for speaking, not the opportunity to speak. Every success in this section came from structure: a decomposition instruction, a review with standing, a rubric. None of them is having a meeting. Study 3 says structure works better when a group runs it. Fine. Then give the group structure.

The steelman does not defend the room. It demands a better one.

Change the room, not the people

The interventions that survive contact with this evidence have nothing to do with courage.

A 285-point r/managers thread in July 2026 described a hiring panel that weighted its final ranking (director 3, team lead 2, HR 2, each member 1) and the structured tally overrode the senior person's instinct. The top reply, at 423 points: "HR having ANY weighting here is mad."

Scoring separately and then comparing where you diverge turns a status contest into a disagreement you can locate. That is most of what a weighted matrix is for.

None of this requires better people. Le-Brun and Werner land it in one sentence: "But we cannot exhort our way out of a systemic design flaw."

The model that cut its losses was not a wiser model. It was the same one, with nothing to defend and nobody to agree with.

More from the blog