Elon Musk's AI chatbot Grok is preventing most users from generating or editing any images after a global backlash that erupted after it started spewing sexualised deepfakes of people.
The chatbot, which is accessed through Musk's social media platform X, has in the past few weeks been granting a wave of what researchers say are malicious user requests to modify images, including putting women in bikinis or in sexually explicit positions.
Researchers have warned that in a few cases, some images appeared to depict children. Governments around the world have condemned the platform and opened investigations into the platform.
On Friday, Grok was responding to image altering requests with the message: “Image generation and editing are currently limited to paying subscribers. You can subscribe to unlock these features.”
While subscriber numbers for Grok aren't publicly available, there was a noticeable decline in the number of explicit deepfakes that Grok is now generating compared with days earlier.
India has ordered Musk’s X to make immediate technical and procedural changes to its AI chatbot Grok after users and lawmakers flagged the generation of “obscene” content, including AI-altered images of women created using the tool.
India’s IT ministry issued the order directing Musk’s X to take corrective action on Grok, including restricting the generation of content involving “nudity, sexualization, sexually explicit, or otherwise unlawful” material.
Sources told PTI that X has provided a long, detailed reply, stating that it respects Indian laws and stipulated guidelines, and that India is a big market for the platform. In its response, X also outlined the strict content takedown policies it abides by when it comes to misleading posts and those related to non-consensual sexualised images.
Sources said, although the reply was long and detailed, it "missed" key information including takedown details and specific action that has been taken on the Grok AI obscene content issue, and to prevent it in future.
The IT Ministry has now sought more details from X, including action taken and steps to prevent it in future. It wants specific information on takedowns and has asked X to immediately respond to all these additional queries.
The European Union has slammed Grok for “illegal” and “appalling” behaviour, while officials in France, India, Malaysia and a Brazilian lawmaker have called for investigations.
On Thursday, Britain's Prime Minister Keir Starmer threatened unspecified action against X.
“This is disgraceful. It's disgusting. And it's not to be tolerated,” Starmer said on Greatest Hits radio. “X has got to get a grip of this.”
He said media regulator Ofcom “has our full support to take action" and that "all options" are on the table.
“It's disgusting. X need to get their act together and get this material down. We will take action on this because it's simply not tolerable.”
Ofcom and Britain's privacy regulator both said this week they've contacted X and Musk's artificial intelligence company xAI for information on measures they've taken to comply with British regulations.
Grok is free to use for X users, who can ask it questions on the social media platform. They can either tag it in posts they've directly created or in replies to posts from other users.
Grok launched in 2023. Last summer the company added an image generator feature, Grok Imagine, that included a so-called “spicy mode” that can generate adult content.
The problem is amplified both because Musk pitches his chatbot as an edgier alternative to rivals with more safeguards, and because Grok's images are publicly visible, and can therefore be easily spread.





