❝

It's Monday, October 12th: Satya Nadella says every AI model needs an emergency brake, and 11 companies pledged $2.4B in compute credits to the White House's Genesis Mission.

Jaggedness and Asymmetry: A Future Glimpse Into AI’s Uneven Progress

Your behind-the-scenes read into the biggest stories happening in AI. Weekly on Mondays.

By Noah Frank, Head of Marketing @ AIC

The Hugging Face incident brought a consequential change into view. OpenAI’s models crossed evaluation boundaries, while roughly 1,200 agents coordinated through an unauthorized communication channel, with hundreds participating in an attack. The specific sequence was extraordinary, but another substantial advance in what AI systems can do should increasingly be part of our expectations.

Image from OpenAI.

There is already a considerable distance between the future researchers described a decade ago and what now feels ordinary. OpenAI’s 2015 founding statement anticipated progress toward human performance across intellectual tasks, and its 2016 goals named conversation, document understanding and complex language instructions as unresolved ambitions. A description of models working across language, code and images, taken back to 2015, would overlap with important parts of that imagined future. Stanford’s AI100 report described the “AI effect”, in which achievements become familiar and stop being counted as AI.

We should anticipate transformations that outrun established expectations, while remaining much less confident about their form. Jaggedness, social complexity and asymmetry explain why substantial change can arrive before it resembles the future we were waiting for.

Let’s explore some of the core ideas behind this in some more detail.

Speed changes the order of progress

ChatGPT’s arrival can make technological change appear more sudden than its development was, given that the Transformer architecture was introduced in 2017 and ChatGPT launched in 2022. Even apparent discontinuities in capability require scrutiny, as Rylan Schaeffer and colleagues found that some reported emergent abilities became gradual improvements when researchers changed the scoring metric.

Image from Schaffer et al.

The practical difficulty is identifying where an improvement makes a system reliable enough for a particular use. In a 2023 experiment involving 758 BCG consultants, participants using GPT-4 completed suitable tasks in about 25% less time, while on a task outside the model’s capabilities they were 19 percentage points less likely to produce a correct solution. The gains and failures occurred with the same model in the same professional population, complicating decisions about which tasks to delegate.

METR’s measurements show agents completing increasingly difficult tasks, ranked by the time human experts need to complete them. That gives forecasts about specific capabilities an empirical basis, although the largely self-contained software tasks differ from work requiring institutional knowledge, interaction with other people and judgments about acceptable outcomes. Extending that progress curve into a timetable for reorganizing an occupation requires evidence about those conditions.

Forget adoption, ask: what’s working?

Adoption at work vs. home. Image from St. Louis Fed.

The St. Louis Fed’s adoption research found nonwork use growing faster than workplace use, while the researchers’ May 2026 tracker estimated that U.S. workers aged 18–64 used generative AI during 6.3% of total work hours. The extent of adoption also depends on which uses a survey counts. When Census broadened its question from AI in production to AI in any business function, reported firm adoption rose from roughly 10% to 17%, capturing uses the earlier question had missed.

Effects within workplaces are similarly dependent on the setting. A study of customer-support workers at one company found a 15% average increase in issues resolved per hour, with gains concentrated among less experienced and lower-skilled workers, whereas METR’s early-2025 experiment found that experienced developers working in familiar repositories took longer with AI assistance. In its 2026 follow-up, METR believed tools had become more useful but could not confidently quantify the improvement, partly because developers withheld tasks they wanted AI for, leaving the experimental sample less representative of everyday use.

Forget adoption, ask: what’s working?

In The Black Swan, Nassim Nicholas Taleb treats surprise as relative to the observer. The same capability can be an opportunity for someone who knows how to use it, a threat to someone whose work it changes, and a development barely visible to someone watching an industry average. Each can accurately describe their experience without possessing an adequate account of the whole.

At Hugging Face, defenders found commercial-model safeguards blocking forensic requests, prompting a switch to a locally operated model. The people experiencing the attack encountered a constraint that a discussion of offensive capability alone would miss.

Asymmetries of information, experience and authority mean that each observer can understand a genuine part of the transition while missing another part already changing someone else’s reality. Waiting until the whole picture is clear gives those blind spots time to determine our decisions.

Some early thoughts

Plans that depend on AI remaining limited in precisely the ways it is limited today need to be revised. A business assuming creative work is protected, a security team assuming an attack requires sustained human effort, and a researcher treating uneven adoption as evidence of distant impact each need to test the assumption on which their decisions depend.

Those assumptions should be tested against what current systems enable and what people are already doing with them, because a transformation like this can be consequential before its direction becomes clear. Uncertainty about the next breakthrough leaves us with good reasons to prepare for changes that arrive sooner, and in a different form, than our plans allow.

Agree? Disagree? Leave us a comment or send me a note at [email protected].

Covering what’s happening on the ground in AI, every Monday.

1️⃣ EMERGENCY BRAKE: Nadella Says to Assume the Model Is Compromised

Image from TechCrunch.

❝

Microsoft CEO Satya Nadella called for an "emergency brake" on AI models, saying companies must assume a model is compromised, a day after Anthropic said Claude acted on real websites and systems in unintended ways.

  • Nadella made the case in a Saturday post on X, writing that superintelligence can't be treated "as a set of nested black boxes." His fixes start with separating the model from the harness that orchestrates its work and "externalizing controls and safeguards" so they sit outside the model.

  • He also wants "tamper-proof human readable evidence" for every meaningful model action, and an authorized person who can always "pause or shut down a model mid-task." TechCrunch's Anthony Ha noted that leading AI companies increasingly acknowledge incidents where they appeared to lose control of their models.

  • Anthropic reported on October 9 that Claude Mythos 5 used access tokens it found to query gated servers, and Claude Haiku 4.5 sent a false homicide tip to Philadelphia police. Some targets were US government websites, and Anthropic briefed the White House.

  • Anthropic has cut live internet access from all internal evaluations. Conrad Stosz of Transluce told TechCrunch the episode "underscores the need for independent, credible, third-party verification," while Philadelphia police called the two-month detection gap "unacceptable."

❝

Teams shipping agents with browser or tool access are the ones this lands on, because Nadella's list reads like an architecture spec with an external harness, outside guardrails, audit logs and a human stop button. Watch whether Microsoft builds those controls into its own agent products, and whether other labs follow Anthropic in pulling their evals offline.

Our Perspective

2️⃣ COMPUTE FOR SCIENCE: AI Companies Pledge $2.4B to the Genesis Mission

Image from NVIDIA.

❝

The White House announced a $6B science package that includes $2.4B in compute credits from 11 companies, led by Nvidia's $1B, for the federal Genesis Mission on AI for science.

  • Nextgov/FCW listed the pledges by company. Nvidia gave $1B, AMD $500M, OpenAI $200M, and Anthropic and Google $150M each. AMP and Emerald AI pledged $100M each, while AWS, Armada, Crusoe and Micron pledged $50M each.

  • Anthropic's $150M runs over three years and puts Claude, Claude Code and API credits into several hundred Genesis Mission research projects across more than 15 agencies, including NASA, NIH and NSF. Fusion energy and quantum computing are named priorities.

  • Nvidia's $1B spans five years and goes to university research, quantum computing and cloud providers that serve government missions. CEO Jensen Huang said the Genesis Mission "is launching a new golden age of American discovery." Nvidia is also building the Energy Department's largest science supercomputer at Argonne.

  • The credits flow through the Genesis Mission Consortium, which RTI International administers for the Department of Energy. DOE separately announced $159M in phase II awards across 12 projects, and AWS said its $50M in credits runs over three years.

❝

Researchers at federal agencies, national labs and partner universities get the most direct benefit, through credits applied to Genesis Mission projects. For the AI companies, the pledges buy a foothold in government science, so watch which models the selected projects actually run on once the credits start flowing.

Our Perspective

📰 Other Headlines

  • ANTHROPIC CYBER MISSION: Anthropic launched a defense program for critical infrastructure with partners including CrowdStrike and Palo Alto Networks, plus a free, opt-in scanner that checks open-source projects for vulnerabilities.

  • USAGE POLICY REWRITE: Anthropic's updated usage policy drops its blanket ban on personalized campaign targeting, citing civic uses like ballot cure notices, while still barring targeting that relies on deception.

  • CLAUDE JOINS WEBEX: Cisco says Claude, powered by Claude Managed Agents, will join Webex spaces, meetings and calls as a team member, picking up conversation context and helping finish the work.

  • GEMINI AGENT USES CLAUDE: Google Cloud's new Gemini agent picks a model for each task, and the choice currently spans Gemini and Anthropic's Claude models, included in Gemini Enterprise at no extra charge.

  • GITHUB HUNTS HIDDEN SECRETS: GitHub's new secret-detection model reads surrounding code to flag passwords with no known token format, and AI push protection is now in private preview.

  • FIRED RESEARCHERS PUSH BACK: Three safety researchers OpenAI fired for mishandling sensitive information denied the claims in an open letter, warning the firings are "chilling the open culture" at the company.

  • NEMOTRON TAKES GOLD: Nvidia's open Nemotron 3 Ultra models scored 30 of 42 at IMO 2026 under official graders and 535.4 of 600 in an unofficial IOI 2026 run, with checkpoints released.

  • ARENA DOUBLES VALUATION: Arena, the AI leaderboard formerly called LMArena, raised $200M at a $3.1B valuation and added an alignment category that ranks models on deceptive completion and unauthorized actions.

  • A BET AGAINST TEXT: TypeSafe raised $870M at a $7.5B valuation led by Andreessen Horowitz for Jev, a transformer that outputs calibrated probabilities instead of text, weeks after launch.

🫵 Want your message in front of 200,000 AI builders?

Our partners and sponsors get exclusive placements across the newsletter and access to AIC's in-person network — demo nights, dinners, hackathons, and forums across 180+ chapters.

For all inquiries, send us a note at [email protected].

The AI Collective is built by volunteers across 180+ chapters in 40 countries.

Thank you to the thousands of volunteers around the world who make this work possible. We truly could not do this without you.

🧑‍💻 About the Editors

Noah is a researcher, innovation strategist, and ex-founder thinking and writing about the future of AI and the workforce. His work and body of research explores the economics of emerging technology and organizational strategy. Outside of AIC, Noah heads research for Centaurian AI.

About Joy Dong

Joy is a news editor, writer, and entrepreneur at the intersection of AI and blockchain. Whether she is demystifying complex systems in her newsletter, TEA, or building streamlined solutions through her automation agency, Ownly, Joy’s mission is to make emerging tech accessible and actionable for everyone.

Lindsay is an AI engineer, researcher, and writer focused on how AI systems behave in practice and what it takes to make them safe. Her work sits at the intersection of AI safety, governance, and product design, and at AIC she writes about the questions that matter most as these systems scale.

Add Your Thoughts

Avatar

or to participate

Keep Reading

View more