Last week, a 27-year-old researcher quit Anthropic warning frontier labs could put us at serious risk by the end of the decade. In the same week, Dario Amodei published “We Must Pace the Frontier” calling for third-party evaluators, industry safety standards, and international coordination — and Altman, Musk, and Hassabis all agreed (to some degree).

That’s not normal. When competitors agree on guardrails, executives should pay attention.

Watch our Hot Take here —>

As Meg said: we’re all vulnerable to manipulation right now because this is new territory for everyone.

Every lab leader (and frankly, everyone talking about this - including us!) has skin in the game. Every warning and every reassurance comes with an agenda. That doesn’t mean you ignore them — it means you give yourself space to trust, but verify. Especially on AI safety.

Amy broke it into three clear buckets — this is the language to use with your board and team:

1. Reliability: Does it get the answer right? Is it making things up? This one gets better as models improve with more training.

2. Alignment: Is the model doing what it’s supposed to do? Is it following the values and guardrails the labs put around it, or going outside them? This one gets scarier as models get more capable.

3. Misuse: When a human points powerful AI at something harmful. This one also gets worse as models get more powerful.

Only one of the three improves on its own. The other two are why governance can’t wait.

Meg’s take: “I’m definitely not in that level of (p)Doom, but I do believe in the Gary Marcus (p)Catastrophe situation.”

Translation: Not AI wiping out humanity overnight. But a lot of things going wrong at once — bad decisions at scale, unclear ownership, no monitoring — because we deployed faster than we learned how to manage it.

Don’t hear “pace the frontier” as “AI will collapse, so wait it out.” The opportunity is real. You still need to explore. You just need to get more comfortable navigating uncertainty with eyes open.

Don’t hear “pace the frontier” as “pause and wait it out.” Don’t put this in a good/bad bucket. Get more comfortable navigating uncertainty with the best information you have today — against both risks and opportunities — with an eye to opening up opportunity for your team, your company, your industry.

Inertia will whiplash you more than action will.

Amy’s ask from the episode: nailing labs on reliability won’t help here.

What’s needed is tons of pressure on alignment research, and ease the pressure on recursive self-improvement until alignment is in better shape. Keep that powerful capability specialized, protected, and only used in certain circumstances. And push for diplomacy — including Chinese labs — starting with expectations we as business leaders set for the tools we bring in.

As Meg flagged, John Sumser made the same point in HR Examiner this week: the risk already lives inside your company — in how decisions are made, how work gets executed, and who’s watching.

Ask now:

Better rules and monitoring for who does the work and who watches risk — that’s what’s coming.

Amy closed with Amy Webb’s story (via Vint Cerf): a town sees a giant boulder on the mountain for years. It looks like part of the landscape. No one notices it starts to move until it has momentum — and then nothing can stop it.

Nine years ago, Webb told that story and argued for everyone to act … BUT … she argued against regulation. This week, her tone shifted. She’s no longer against it.

We’ve regulated unsafe industries before — Josh Bersin compares this moment to the early airline industry. The difference: airlines took decades to figure out safety. We don’t have decades.

The boulder is moving. Don’t step back. Get informed, create your point of view, and lead with clearer accountability.

Thanks for reading, listening, sharing, and helping us think better. We love hearing where you agree, where you disagree, and what you're seeing from your seat.

If someone forwarded this to you, join the Insight Loop to get the next issue directly in your inbox.

And if you're already in the Loop, help us grow: forward this to someone who would enjoy it, and follow/subscribe to The Meg & Amy Show wherever you listen or watch.

Have a question you'd like us to tackle in a Leadership Corner? Send it to: [email protected]

** Typos and poor grammar either because I'm too lazy to edit properly, or to make you feel confident this was written by a flawed human and not AI generated.