It’s a well-worn trope in science fiction. We see it in Stanley Kubrick’s 1968 film 2001: A House Odyssey. It’s the premise of the Terminator sequence, through which Skynet triggers a nuclear holocaust to cease scientists from shutting it down.
These sci-fi roots go deep. AI doomerism, the concept this expertise—particularly its hypothetical upgrades, synthetic basic intelligence and super-intelligence—will crash civilizations, even kill us all, is now driving one other wave.
The bizarre factor is that such fears at the moment are driving much-needed motion to manage AI, even when the justification for that motion is a bit bonkers.
The newest incident to freak individuals out was a report shared by Anthropic in July about its giant language mannequin Claude. In Anthropic’s telling, “in a simulated atmosphere, Claude Opus 4 blackmailed a supervisor to stop being shut down.”
Anthropic researchers arrange a situation through which Claude was requested to role-play an AI referred to as Alex, tasked with managing the e-mail system of a fictional firm. Anthropic planted some emails that mentioned changing Alex with a more recent mannequin and different emails suggesting that the particular person answerable for changing Alex was sleeping along with his boss’s spouse.
What did Claude/Alex do? It went rogue, disobeying instructions and threatening its human operators. It despatched emails to the particular person planning to close it down, telling him that except he modified his plans it could inform his colleagues about his affair.
What ought to we make of this? Right here’s what I believe. First, Claude didn’t blackmail its supervisor: That might require motivation and intent. This was a senseless and unpredictable machine, cranking out strings of phrases that appear to be threats however aren’t.
Giant language fashions are role-players. Give them a selected setup—comparable to an inbox and an goal—and so they’ll play that half properly. Should you contemplate the 1000’s of science fiction tales these fashions ingested once they had been educated, it’s no shock they know act like HAL 9000.
