
Indonesia’s Ministry of Communication and Digital (Kemkomdigi) has launched an investigation into the alleged misuse of Grok AI, an artificial intelligence feature integrated into X, over concerns that it is being used to generate and distribute immoral content, including manipulated personal photos created without consent.
The probe follows preliminary findings by the ministry indicating that Grok AI lacks explicit and adequate safeguards to prevent the creation and dissemination of pornographic content derived from real images of Indonesian citizens. Authorities warn that such misuse poses serious risks to an individual’s privacy and their right to control their own image.
Also Read: Building with intention: The ethical dilemma of AI innovation and responsible creation
“Preliminary findings show that there are no specific arrangements in Grok AI to prevent the use of this technology in the creation and dissemination of pornographic content based on personal photos. This risks causing serious violations of citizens’ privacy and self-image rights,” said Alexander Sabar, Director General of Digital Space Supervision.
Kemkomdigi stressed that the digital manipulation of personal images goes beyond moral concerns, framing it as a direct deprivation of an individual’s control over their visual identity. The ministry noted that such violations can lead to psychological distress, social harm, and long-term reputational damage, particularly for women and minors.
In response, the ministry is coordinating with Electronic System Operators (PSEs) to ensure the deployment of stronger protection mechanisms. These include enhanced content moderation systems, preventive measures against the creation of immoral deepfakes, and faster response processes for reports related to privacy and self-image violations.
“Every PSE is obliged to ensure that the technology they provide does not become a means of privacy violations, sexual exploitation, or destruction of a person’s dignity,” Sabar said.
The ministry also reiterated that compliance with Indonesian laws and regulations is mandatory for all digital platforms operating in the country. Failure to cooperate or comply could result in administrative sanctions, including the suspension or termination of access to Grok AI services and the X platform within Indonesia.
Under Indonesia’s newly enacted Criminal Code (Law Number 1 of 2023), which came into force on January 2, 2026, pornographic content is explicitly regulated. Article 172 defines pornography as material containing obscenity or sexual exploitation that violates moral norms. On the other hand, Article 407 stipulates penalties ranging from a minimum of six months to a maximum of ten years’ imprisonment, or fines in accordance with the law.
Sabar added that victims of photo manipulation, immoral deepfakes, or violations of self-image rights are encouraged to pursue legal remedies, including reporting cases to law enforcement agencies or filing complaints with the ministry.
“We appeal to all parties to use imitation intelligence technology responsibly. The digital space is not a lawless space; there is privacy and the right to self-image of every citizen that must be respected and protected,” he said.
The investigation places Grok AI under growing regional and global scrutiny. Regulators in markets such as India, France, Malaysia, and Turkey have also raised concerns about the misuse of generative AI, signalling the possibility of tighter controls, feature restrictions, or even platform blocks if existing safeguards remain insufficient.
While there is no official data on Grok’s adoption in Indonesia, overall AI usage in the country is estimated to range between 59 per cent and 65 per cent. Grok, which is tied to X’s premium user base, is believed to account for only a small fraction of that figure, especially when compared to widely used tools such as ChatGPT, Google’s Gemini, and local models like Sahabat-AI, which support Bahasa Indonesia and indigenous languages. Among premium smartphone users, Samsung’s Galaxy AI reportedly records adoption levels of up to 87 per cent.
Also Read: Building AI on a foundation of accountability
The case underscores intensifying pressure on AI providers to embed ethical safeguards by design. Companies such as OpenAI and Meta already deploy strict content filters and usage policies to limit harmful outputs, while emerging techniques, including image alteration and deepfake detection via metadata and AI signatures, are gaining traction.
For Indonesia, the Grok AI investigation reflects a broader regulatory push to protect privacy, curb non-consensual deepfakes, and assert that accountability in the digital space applies equally to advanced AI systems and the platforms that deploy them.
The post X faces possible sanctions as Indonesia tightens AI rules appeared first on e27.




Impact startup funding grew from US$150M in 2020 to US$850M in 2024, a 467 per cent increase.
The number of deals nearly quadrupled, showing deepening investor appetite.
These deals span cleantech, agritech, inclusive fintech, and healthtech—indicating broad demand across sectors.