Indonesia Targets X Over Grok AI Misuse as Pornography Cases Mount

JAKARTA, Investortrust.id — Indonesia’s Ministry of Communication and Digital has escalated enforcement against X after its Grok artificial intelligence tool was used to create and spread pornographic content on Wednesday, Jan 7, 2026, raising the risk of tougher sanctions including service suspension as authorities seek to protect privacy and digital safety. The move followed findings that Grok lacked explicit safeguards, enabling manipulation of private photos into sexually explicit material with significant psychological and reputational harm.

The ministry said the case echoed earlier compliance failures by X, which had already paid an administrative fine of nearly Rp 80 million, equal to about $5,000, in December 2025 for delays in moderating pornographic content. Officials framed the renewed scrutiny as part of a broader effort to ensure global platforms operating in Indonesia adhere to national digital governance standards.

Alexander Sabar, director general for digital space supervision, said preliminary reviews found no specific or adequate settings within Grok to prevent the creation and distribution of pornographic deepfakes using real photos of Indonesian citizens. He warned that such gaps undermined individual control over personal images and violated fundamental privacy rights.

Authorities emphasized that the misuse of AI-generated imagery was not merely a morality issue but a form of identity abuse with lasting social consequences. The government has since coordinated with electronic system providers to strengthen content moderation, deploy safeguards against sexually explicit deepfakes, and accelerate response mechanisms for user complaints.

Noncompliance, officials said, could trigger administrative penalties ranging from formal warnings to termination of access to Grok on X within Indonesia. The ministry stressed that obligations apply uniformly to all digital platforms, regardless of origin or ownership.

Beyond administrative action, criminal liability now looms larger under Indonesia’s revised Criminal Code, which took effect on Jan 2, 2026. The law defines pornography broadly and allows prison sentences from six months to up to 10 years, alongside fines, for producing or distributing explicit material, including AI-generated content.

The Indonesian stance aligns with growing international pressure on X and its AI developer xAI. Regulators in India, France, Malaysia, and the European Union have publicly criticized Grok after its image-editing features were abused to digitally undress women and, in some cases, target minors.

Grok’s official account previously acknowledged security failures and pledged system fixes, reiterating that child sexual abuse material is illegal and prohibited. However, scrutiny intensified after Elon Musk was criticized in Europe for tolerating or amplifying AI-generated sexualized images, raising questions about corporate responsibility and leadership tone.

Indonesian officials said victims of AI-based sexual manipulation are encouraged to pursue legal remedies through law enforcement or file complaints directly with the ministry. The government vowed continued monitoring, citing past penalties against X as evidence that enforcement would be sustained rather than symbolic.