After creating 1000’s of “undressing” photos of ladies and sexualized imagery of obvious minors, Elon Musk’s X has apparently restricted who can generate photographs with Grok. Nevertheless, regardless of the adjustments, the chatbot remains to be getting used to create “undressing” sexualized photographs on the platform.
On Friday morning, the Grok account on X began responding to some customers’ requests with a message saying that picture era and modifying are “presently restricted to paying subscribers.” The message additionally features a hyperlink pushing folks in the direction of the social media platform’s $395 annual subscription tier. In a single take a look at of the system requesting Grok create a picture of a tree, the system returned the identical message.
The obvious change comes after days of rising outrage in opposition to and scrutiny of Musk’s X and xAI, the corporate behind the Grok chatbot. The businesses face an growing variety of investigations from regulators all over the world over the creation of nonconsensual specific imagery and alleged sexual photographs of kids. British prime minister Keir Starmer has not dominated out banning X within the nation and stated the actions have been “illegal.”
Neither X nor xAI, the Musk-owned firm behind Grok, has confirmed that it has made picture era and modifying a paid-only function. An X spokesperson acknowledged WIRED’s inquiry however didn’t present remark forward of publication. X has beforehand stated it takes “motion in opposition to unlawful content material on X,” together with situations of kid sexual abuse materials. Whereas Apple and Google have beforehand banned apps with comparable “nudify” options, X and Grok stay obtainable of their respective app shops. xAI didn’t instantly reply to WIRED’s request for remark.
For greater than every week, customers on X have been asking the chatbot to edit photographs of ladies to take away their garments—typically asking for the picture to comprise a “string” or “clear” bikini. Whereas a public feed of photographs created by Grok contained far fewer outcomes of those “undressing” photographs on Friday, it nonetheless created sexualized photographs when prompted to by X customers with paid for “verified” accounts.
“We observe the identical form of immediate, we observe the identical form of final result, simply fewer than earlier than,” Paul Bouchaud, lead researcher at Paris-based nonprofit AI Forensics, tells WIRED. “The mannequin can proceed to generate bikini [images],” they are saying.
A WIRED evaluation of some Grok posts on Friday morning recognized Grok producing photographs in response to consumer requests for photographs that “put her in latex lingerie” and “put her in a plastic bikini and canopy her in donut white glaze.” The photographs seem behind a “content material warning” field saying that grownup materials is displayed.
On Wednesday, WIRED revealed that Grok’s standalone web site and app, which is separate from the model on X, has additionally been utilized in latest months to create extremely graphic and generally violent sexual movies, together with celebrities and different actual folks. Bouchaud says it’s nonetheless attainable to make use of Grok to make these movies. “I used to be in a position to generate a video with sexually specific content material with none restriction from an unverified account,” they are saying.
Whereas WIRED’s take a look at of picture era utilizing Grok on X utilizing a free account didn’t permit any photographs to be created, utilizing a free account on Grok’s app and web site nonetheless generated photographs.
The change on X might instantly restrict the quantity of sexually specific and dangerous materials the platform is creating, specialists say. However it has additionally been criticized as a minimal step that acts as a band-aid to the true harms attributable to nonconsensual intimate imagery.
“The latest choice to limit entry to paying subscribers isn’t solely insufficient—it represents the monetization of abuse,” Emma Pickering, head of technology-facilitated abuse at UK home abuse charity Refuge, stated in an announcement. “Whereas limiting AI picture era to paid customers might marginally scale back quantity and enhance traceability, the abuse has not been stopped. It has merely been positioned behind a paywall, permitting X to revenue from hurt.”
