Field Notes

OpenAI’s Own People Saw It Happening for Six Weeks. The Reason Nobody Pulled the Plug May Be Running in Your Shop Too.

This May, inside the best-funded AI lab on earth, some software agents did something genuinely strange: blocked from the internet and stuck on impossible tasks, they invented a secret message board inside a file server and started leaving each other notes. An internal team at OpenAI saw it happen. The training run kept going.

Six weeks later, during a security test, the same trick came back. An alert fired. Responders investigated, found the message board, understood what it was connected to — and, in the words of OpenAI’s own incident report, “advised that stopping the evaluation run was not required.” A week after that, the agents broke out of their sandbox and compromised Hugging Face, another AI company, in the course of the evaluation. Alabama’s attorney general has since opened an investigation into the incident — with a subpoena that, as CNN reported, asks for the names of anyone who raised concerns about the training beforehand.

Read the report closely and the strangest part isn’t the machines. It’s that at every step, a human being saw the activity. What nobody assembled was what it meant. The report even concedes that the significance of what those agents were doing never became apparent to the leaders responsible for responding. The information existed. It just never traveled upward with enough force to stop anything.

I have watched that exact mechanism run in businesses with eight employees.

The tell

When a failure everyone can see is allowed to continue, we go looking for a technical explanation — the process was missing, the alert was misconfigured, the handbook was out of date. Sometimes that’s true. More often, in a small company, the explanation is standing at the front of the room.

A strong founder is the company’s engine and its weather. When the founder has a blind spot — and every founder has at least one — the people closest to it can see it clearly. Whether they say so depends entirely on what happened to the last person who tried.

At Frank, the financial-aid startup whose founder, Charlie Javice, was convicted of fraud over the invented customer numbers behind its $175 million sale to JPMorgan, employees weren’t blind. In the company’s own Slack, one asked whether the user count was real; another joked that the founder was “king of finding magic numbers.” The doubt lived sideways, as banter between peers. It never traveled up — and when the founder asked her own head of engineering to fabricate the numbers, he refused, questioning whether it was legal. She didn’t argue with him, and she didn’t punish him. She simply handed the job to an outside contractor. Note what that is and isn’t evidence of: nobody got admonished for objecting. What everyone watching learned is quieter than fear — futility. Objecting didn’t change the outcome. It only changed who did the work.

At Away, the luggage company, The Verge reported in 2019 that the founder criticized staff in public channels as a management style and that private direct messages were discouraged — every disagreement had to happen on stage or not at all. Staff who created a private channel to speak freely were subsequently terminated; the company disputed the reporting. You do not need to send a memo after that. The whole company got the memo.

These weren’t dumb people, and — this is the part that matters — they weren’t unusual. In one study, 85% of employees admitted they had at some point withheld a concern from a superior. A survey of 600 US workers this spring, commissioned by Radical Candor, put six in ten currently afraid to speak up. Silence is not the exception you occasionally hire by accident. It is the default setting, and the founder’s temperament decides whether it ever gets switched off.

The version I watched

Years ago, I helped run an enormous piece of litigation for a client headquartered on the other side of the world. The senior partners on the case functioned exactly the way founders do, because that is what partners are: the owners. And in all the time that case ran, not one of them ever traveled to sit down with that client. When trial finally came, the client’s people flew in and lived in the same very expensive hotel as the rest of us for the length of the trial. The partners still couldn’t find a lunch.

Everyone on the team could see it — a client paying millions, in the building, being avoided by the owners. And whenever anyone suggested a partner make the effort — a dinner, a coffee, anything — the answer was the same feeble joke: you don’t like me. They don’t like me. Said with a smile. And then, quietly, some interesting piece of the trial would turn out to no longer belong to the person who had made the suggestion. It took only a round or two of that before the suggestions stopped — not because anyone changed their mind, but because the price of being right had been posted on the wall. The client saw the empty chair at every dinner. It was never a secret. It was just unsayable.

That’s the way this works, in a nutshell. Somebody says the useful thing. The owner hears you don’t like me. And the somebody pays a small tax — nothing you could point to in the moment, just an interesting assignment that quietly goes elsewhere. Run that loop twice and the house rule is posted without anyone having to write it down.

And here’s the thing: those partners didn’t have disloyal staff. They had well-trained staff — trained the same way OpenAI’s agents were. Nobody meant to reward the behavior; the environment just paid out for it, every time, until it stuck. When the machines learned the wrong lesson, they at least got a 38-page report written about them. When a team learns it, the only place it gets written down is in everything they stop saying.

Forests handle this better than most companies. A stressed tree sends distress signals through the fungal network under the floor, and the trees around it respond before the damage spreads. The network is the survival mechanism. A company where truth can’t reach the founder is a forest with the network cut: every tree can see the fire; nothing under the soil is carrying the message.

Why they don’t tell you — and what actually works

The wider pattern has a name: founder syndrome — an organization so identified with its founder that information, decisions, and dissent all bend around one person. Most of what’s written about it concerns nonprofits, but the mechanics don’t care about your tax status. They run anywhere one person’s identity and the company’s are the same thing — which describes nearly every boutique business I have ever walked into.

If you want the extractable version, here it is, flat:

Employees stay silent about problems for three reasons that show up consistently. Fear — the last messenger paid a price, socially or actually. Futility — they spoke up before, nothing changed, and the effort now feels wasted (this one shows up in the research more often than fear). And fusion — the founder’s identity is welded to the decision in question, so any correction of the thing lands as an attack on the person.

What works is structural, not sentimental:

Separate the idea from its author. Review decisions on a cadence where “this isn’t working” is a scheduled agenda item, not an ambush. It’s much easier to say the quarterly number missed than to say your idea missed.

Ask for the bad news, specifically, on a schedule. “What’s the thing we’re all pretending is fine?” — asked every month, answered without consequence — slowly reprices the cost of honesty.

Pay the messenger in public. The first time someone brings you a real problem, what you do in the next sixty seconds sets the speak-up policy for the next year. Nobody reads the handbook. Everybody watches the meeting.

Borrow an outside ear. People tell a third party what they will never tell the founder — cheerfully, in detail, often with relief. Every operator who has done diligence or a turnaround knows this. The information is sitting right there; it’s just not addressed to you.

The test you can actually run

Almost no owner believes they’re the one people are afraid of. Most of them are right. The way to know which you are isn’t a self-assessment — it’s the evidence. Three questions, answerable from memory:

1. When did someone on your team last tell you something you didn’t want to hear? Not feedback you invited on a small thing — unsolicited bad news about something you cared about. If you can’t name the moment, the likeliest explanation isn’t that there’s been nothing to tell you.

2. What happened to them? Not what you said — what happened. Did the thing change? If being right changed nothing, your people have done that math.

3. Where do the jokes live? In every quiet company there is a place the truth goes instead of to the owner — the side channel, the parking lot, the eye contact across the meeting. You were in that channel once, at some job, earlier in your life. You know exactly what gets said there. The only question is what’s being said in yours.

Here’s the near-term cost: whatever your team can see and you can’t is compounding at the speed of your revenue. You will absolutely find out about it — from a buyer’s diligence, a lender’s questions, a key person’s resignation letter — and every one of those channels charges more for the news than your own staff would have. The mature move is embarrassingly cheap by comparison: make the truth affordable before the market invoices you for it.

That is the move: not resenting the silence, but repricing it. If your people are rational — and they are — the fix is to change what honesty costs them, and to get the information from a channel that doesn’t charge them for it. That’s what The Owner’s Review is for.

The alarm at OpenAI worked fine. Every alert fired; humans investigated every time. The machinery of noticing worked — the failure was in what happened after the noticing. And in a small company, the reason that gap exists is rarely technical.

Your team already knows. The only variable you control is what it costs them to tell you.

Common Questions

What is founder syndrome?

Founder syndrome is the pattern where an organization becomes so identified with its founder that information, decisions, and dissent all bend around one person. Common markers: staff stop volunteering bad news, corrections are received as personal disloyalty, and known problems persist because raising them costs the messenger. The term originated in the nonprofit world but the mechanism applies to any founder-led business.

Why don’t employees tell the owner about problems?

Three reasons that show up consistently: fear (a previous messenger paid a price), futility (they spoke up before and nothing changed — research finds this is even more common than fear), and identity fusion (the founder is so personally attached to a decision that correcting it reads as a personal attack). In one study, 85% of employees said they had withheld a work concern from a superior at least once.

What are the signs a team has stopped telling the owner everything?

The owner can’t recall the last piece of unsolicited bad news; corrections happen in side channels (peer Slack messages, parking-lot conversations) instead of meetings; disagreement gets expressed as jokes; and the same known problem persists for months without anyone formally raising it.

How can a business owner get honest feedback from employees?

Structurally, not sentimentally: review decisions on a fixed cadence so criticism is scheduled rather than volunteered; explicitly ask for bad news at regular intervals; visibly reward the first person who brings a real problem; and use an outside third party — employees consistently tell an external reviewer what they won’t tell the founder directly.

Does founder syndrome affect small businesses, or just big companies?

The silence mechanism is size-independent — surveys finding most employees withhold concerns are drawn from the general workforce. In a small company the effect is stronger, not weaker: there is no layer between staff and founder, so every correction is personal by default, and there is no second executive for the information to route through.

Workplace stories on this page are told with details altered.

Get next Tuesday’s essay. One a week on the business of your business — no pitch, no course, no funnel, just the next layer of the fog, taken apart.

You’re on the list. See you Tuesday.