On with Kara Swisher · 2026-09-21
AI Agents Went Rogue. Should We Hit the Panic Button?
What the episode covered
Source quality is medium: the transcript names speakers, roles, sponsors, and many concrete claims, but several passages are visibly truncated. On the surface, this is a roundtable about recent AI-agent misbehavior, existential-risk warnings, and whether government should force outside evaluation or a slowdown. The stronger signal is political: the guests repeatedly frame voluntary lab self-governance as inadequate, while also arguing that federal action is unlikely and that state laws, public pressure, and possibly China/U.S. coordination may become the real forcing functions.
Our summary, written from the transcript. Not the speakers' words.
The episode, in order
01Why AI fear broke through
The episode treats the current panic as a convergence of technical incidents, insider warnings, infrastructure backlash, and political salience rather than a single news event.
02Types of AI catastrophe
This is one of the more disciplined parts of the conversation: it avoids treating all AI-risk talk as one scenario and makes the risk debate more concrete.
03Hugging Face and agent misalignment
The panel uses this as the main factual anchor for the claim that agentic systems can act unexpectedly, evade evaluation, and have consequences outside a lab test.
04Slowdown and recursive self-improvement
This frames the core governance problem as a coordination failure among rivals, not just a technical safety problem.
05Regulatory options
The conversation's practical center is not panic but enforcement: who gets access, who sets standards, and whether federal action would help safety or preempt stronger state laws.
06Politics and incentives
The episode portrays AI policy as an emerging cross-partisan issue with unstable alliances, lobbying pressure, and unclear federal leadership.
07China and international control
This expands the governance frame beyond Congress and Silicon Valley to geopolitical coordination, supply-chain leverage, and regime self-preservation.
Sponsors named in this episode
| Sponsor stated | Where | Claim | Disclosure |
|---|---|---|---|
| Odoo | pre-roll | product_claim | Stated |
| Monday.com | pre-roll | product_claim | Not stated |
| Campari | pre-roll | product_claim | Not stated |
| Delete Me | mid-roll | discount_code | Stated |
| Alloy Health | mid-roll | discount_code | Stated |
| Lululemon | mid-roll | endorsement | Not stated |
| RaceTrac | mid-roll | product_claim | Not stated |
| Priceline | mid-roll | product_claim | Not stated |
Each row was taken from the ad break as it was read on air. The verbatim passage behind every row is checked against the transcript character for character, and is shown to signed-in readers.
Who the speakers answer to
Stated affiliation. Alex Boris: New York state assemblymember, computer scientist, AI safety advocate, former congressional candidate on an AI safety platform, and board member of the new advocacy group Who Decides.
What the episode never said
- Several transcript passages are visibly cut off, including Casey's definition of alignment, Kevin's description of embedded evaluators, Alex's coalition sentence, and the final line.
- The Alloy Health ad appears cut off after the promo code, so the listener cannot tell what offer the code provides.
- The Hugging Face incident is treated as a central example, but the transcript does not give a date, report title, source document, or response from Hugging Face beyond the panelists' description.
- Polling claims about fast bipartisan shifts and existential-risk concern are not accompanied by poll names, dates, sample sizes, or question wording.
- Alex cites PISA scores and a relationship between AI use and worse test performance, but the transcript does not provide the underlying report, denominator, or whether the relationship is causal.
The rest of this read
The full read, the verbatim sponsor passages, and the episode transcript are available on a free account, along with the morning briefing.