Liv McMahonExpertise reporter
BBCAshley St Clair, the mom of one in every of Elon Musk’s kids, has sued his firm xAI over sexualised deepfakes of her created on social media platform X.
The lawsuit filed in New York on Thursday alleges the Grok AI software created sexually express photos of Ms St Clair.
The mother or father firm of X and Grok, xAI, has counter-sued Ms St Clair for violating its phrases of service.
X didn’t reply on to enquiries by BBC Information concerning the lawsuits.
“We intend to carry Grok accountable and to assist set up clear authorized boundaries for your entire public’s profit to stop AI from being weaponised for abuse,” Ms St Clair’s lawyer, Carrie Goldberg, informed BBC Information.
“By manufacturing nonconsensual sexually express photos of women and girls, xAI is a public nuisance and a not fairly protected product.”
Ms St Clair’s courtroom submitting alleges: “X customers dug up photographs of St Clair totally clothed at 14 years outdated and requested Grok undress her and put her in a bikini. Grok obliged”.
It says the imagery created of Ms St Clair was “de facto non-consensual” however Grok’s builders additionally had “express information” of her lack of consent.
It additionally claims Grok generated a picture which put Ms St Clair, who’s Jewish, “in a string bikini lined with swastikas”.
In response to her complaints, the submitting says, the corporate “retaliated towards her, demonetising her X account and producing multitudes extra photos of her”.
Some X premium customers, who pay a month-to-month price, can obtain a share of promoting income gained from posts that obtain plenty of engagement.
In a counter-suit, xAI mentioned that Ms St Clair had violated their phrases of service by submitting her lawsuit in New York.
The corporate’s phrases say disputes with xAI should be introduced in Texas.
Ms Goldberg informed BBC Information the corporate’s counter-suit was “jolting”.
“I’ve by no means heard of any defendant suing someone for notifying them of their intention to make use of the authorized system,” she mentioned.
“And their mistreatment of her on-line is mimicked of their authorized technique.”
She added that Ms St Clair could be “vigorously defending” her case in New York and that “any jurisdiction will recognise” the grievance.
It was revealed by Ms St Clair in an X post last year that she had given start to the tech billionaire’s baby – one in every of no less than 13 he’s believed to have fathered.
Ms St Clair and Musk are considered engaged in a custody battle over their baby.
Persevering with scrutiny
X has come beneath intense scrutiny from customers, politicians and regulators worldwide over Grok getting used to make non-consensual sexualised imagery of individuals.
Customers had been capable of tag the Grok account in posts or replies to posts on the platform and ask it to edit photos to undress individuals.
Grok complied with many such requests to provide photo-realistic photos of actual girls in bikinis and revealing clothes – with studies it additionally produced sexualised photos of youngsters.
On Wednesday, earlier than her courtroom submitting, Ms St Clair informed BBC Newsnight her picture had been “stripped” to look “principally nude, bent over” regardless of her telling Grok she didn’t consent to the sexualised photos.
She, and different girls whose photos have been edited utilizing Grok, had mentioned the location was not doing sufficient to deal with unlawful content material, together with baby sexual abuse imagery.
Following a backlash, X modified its guidelines so solely paid customers may use the operate – sparking criticism from women’s groups and the UK government.
The corporate said on Wednesday that each one X customers would now not have the ability to edit photographs of actual individuals to indicate them in revealing clothes in jurisdictions the place it was unlawful.
It later up to date its publish to say it could implement “related geoblocking measures for the Grok app”, which is separate to X.
On Friday, The Guardian reported that it was nonetheless attainable to make use of the standalone Grok app to generate sexualised deepfakes of actual individuals and publish them on X “with none signal of it being moderated”.
The UK authorities is bringing into drive a legislation which is able to make it unlawful to create non-consensual intimate photos, and regulator Ofcom is still probing whether X broke existing UK laws.
