The government on Friday issued a stern notice to Elon Musk-led social media platform X, directing it to immediately remove all vulgar, obscene and unlawful content, particularly content generated through the AI app Grok, or face action under the law.

The Ministry of Electronics and Information Technology(Meity) has issued the notice to the Chief Compliance Officer for India operations of X for failure to observe statutory due diligence obligations under the Information Technology Act, 2000, and the IT Rules, 2021.

"...X is hereby directed to...remove or disable access, without delay, to all content already generated or disseminated in violation of applicable laws, in strict compliance with the timelines prescribed under the IT Rules, 2021, without vitiating the evidence in any manner," the order dated 2 January said.

Meity has also directed X to take action against offending content, users and accounts, and to submit a detailed action taken report within 72 hours from the date of issuance of the order.

According to the ministry, it has received inputs from time to time, including through public discourse and representations from various parliamentary stakeholders, that certain categories of content circulating on X may not be in compliance with applicable laws relating to decency and obscenity.

Earlier in the day, Rajya Sabha member Priyanka Chaturvedi wrote to Union minister Ashwini Vaishnaw, seeking urgent intervention over increasing incidents of the AI app Grok being misused to create vulgar photos of women and post them on social media.

The order said the "Grok AI" service, developed by X, is being misused by users to create fake accounts to host, generate, publish or share obscene images or videos of women in a derogatory or vulgar manner to indecently denigrate them.

"Importantly, this is not limited to the creation of fake accounts but also targets women who host or publish their images or videos, through prompts, image manipulation and synthetic outputs.

"Such conduct reflects a serious failure of platform-level safeguards and enforcement mechanisms, and amounts to gross misuse of artificial intelligence technologies in violation of applicable laws," the order said.

The ministry has sought an action taken report towards immediate compliance for the prevention of hosting, generation, publication, transmission, sharing or uploading of obscene, nude, indecent and sexually explicit content through the misuse of Musk’s startup xAI and its AI platform Grok.

"It is reiterated that non-compliance with the...requirements shall be viewed seriously and may result in strict legal consequences against your platform, its responsible officers and the users on the platform who violate the law, without any further notice, under the IT Act, the IT Rules, the BNSS, the BNS and other applicable laws," the order said.

Meity has further asked X to immediately undertake a comprehensive technical, procedural and governance-level review of Grok, including its prompt-processing, output generation, image handling and safety guardrails, to ensure that the application does not generate, promote or facilitate content which "contains nudity, sexualisation, sexually explicit or otherwise unlawful content in any form".

On 29 December, Meity had asked social media firms to immediately review their compliance frameworks and act against obscene and unlawful content on their platforms, warning that failure to do so could invite prosecution under the law of the land.

After issuing the advisory, the ministry observed that social media platforms have not been strictly acting against obscene, vulgar, inappropriate and unlawful content.