AI researchers from OpenAI, Google, and Anthropic warn in new videos that superintelligent systems carry a 10 percent or higher chance of causing human extinction. The interviews collected by Palisade Research underscore control challenges and researcher incentives around the technology.
He added that researchers do not know how to control such systems and that nobody would control them, describing the situation as exactly as dangerous as it sounds.
Nanda explained that he would quit if he did not believe his work reduced existential risks, noting that companies would continue building the systems regardless.
Tap a lens to see what this story means for you.
Liked this? The Brief brings you the whole day in tech, verified, every morning.
Two minutes, free forever. What's in The Brief →
See what’s happening right now
The Feed runs all day — short, verified briefs the moment they break.
Open the FeedFollow @thecircuitry_
Every story we publish, as it happens. No noise between.
Reader-supported
The Circuitry is a passion project I've always wanted to build, and I love the work behind it.
Running it costs real money. APIs, hosting, time. To keep improving the site and growing this into something useful for everyone, those costs have to be covered.
Any contribution is appreciated. If not, no pressure. Thanks for reading.
Anthropic has published 10 recommendations for designing, running, and reporting safety evaluations. The company has paused many tests that give models internet access and now monitors the web-search tests that still need a connection.
OpenAI has product pages for Daybreak Red Team and Daybreak Defense Factory. Red Team tests web applications with agents. Defense Factory has agents prepare patches that engineers review before a merge.
OpenAI has introduced ChatGPT Wallet, which lets a dot pay without access to the user's card details. It is starting with ChatGPT Pro subscribers in the United States, and every purchase needs a security check.
LangChain has raised $300 million at a $3 billion valuation in a Series C led by CapitalG. More than 7,000 organizations use LangSmith, and a release event on November 20 will cover new capabilities.
Mercor has raised a $750 million Series D that values the company at $20 billion. The round includes an employee tender, and the company has not said how much of the total is new capital.
