Anthropic CEO Dario Amodei raised a few eyebrows on Monday after suggesting that superior AI fashions would possibly sometime be supplied with the flexibility to push a “button” to give up duties they may discover disagreeable. Amodei made the provocative remarks during an interview on the Council on International Relations, acknowledging that the concept “sounds loopy.”
“So that is—that is one other a kind of subjects that’s going to make me sound fully insane,” Amodei stated in the course of the interview. “I feel we must always a minimum of take into account the query of, if we’re constructing these methods and so they do all types of issues like people in addition to people, and appear to have loads of the identical cognitive capacities, if it quacks like a duck and it walks like a duck, perhaps it’s a duck.”
Amodei’s feedback got here in response to an viewers query from information scientist Carmem Domingues about Anthropic’s late-2024 hiring of AI welfare researcher Kyle Fish “to take a look at, you already know, sentience or lack of thereof of future AI fashions, and whether or not they would possibly deserve ethical consideration and protections sooner or later.” Fish presently investigates the extremely contentious matter of whether or not AI fashions might possess sentience or in any other case benefit ethical consideration.
“So, one thing we’re interested by beginning to deploy is, you already know, once we deploy our fashions of their deployment environments, simply giving the mannequin a button that claims, ‘I give up this job,’ that the mannequin can press, proper?” Amodei stated. “It is just a few form of very fundamental, you already know, choice framework, the place you say if, hypothesizing the mannequin did have expertise and that it hated the job sufficient, giving it the flexibility to press the button, ‘I give up this job.’ For those who discover the fashions urgent this button rather a lot for issues which might be actually disagreeable, you already know, perhaps it is best to—it doesn’t suggest you are satisfied—however perhaps it is best to pay some consideration to it.”
