Malaysia and Indonesia have blocked access to Grok, the artificial intelligence chatbot linked to Elon Musk’s social media platform X, citing concerns over its misuse in generating sexually explicit and non-consensual deepfake images.
Authorities in Kuala Lumpur and Jakarta said the decision was taken to protect women and children from digital exploitation, marking what appears to be the first national-level bans imposed on the AI tool.
Grok, which allows users to generate and manipulate images, has come under scrutiny after reports that it was being used to alter photographs of real people particularly women into sexualised or revealing content without their consent.
Regulators in both countries said such misuse posed serious ethical, legal and human rights concerns.
Malaysia’s Communications and Multimedia Commission said it had previously issued notices to X, urging stronger safeguards after identifying repeated cases of harmful content generated through the chatbot.
However, the regulator said the platform’s response relied largely on user reporting mechanisms, which it described as inadequate to address the underlying risks.
The commission added that the ban would remain in place until effective and enforceable safety measures are implemented, while urging the public to report online content that exploits or endangers vulnerable groups.
In Indonesia, Minister of Communications and Digital Affairs Meutya Hafid described sexually explicit AI-generated images as a violation of personal dignity and human rights.
She confirmed that her ministry had formally requested explanations from X regarding Grok’s operational safeguards and content controls.
Indonesia has historically adopted a strict stance against online pornography, previously banning platforms such as Pornhub and OnlyFans.
Authorities said AI-generated sexual content represents a similar, if not greater, threat due to its capacity to target real individuals.
Several Indonesian users have reported being victims of Grok-generated image manipulation. Disability rights advocate Kirana Ayuningtyas said a stranger used the chatbot to alter her photograph to depict her in a bikini.
Despite reporting the image and tightening her privacy settings, she said the content remained accessible, describing the experience as humiliating and distressing.
Pressure on Grok is also mounting beyond Southeast Asia. In the United Kingdom, Technology Secretary Liz Kendall has backed calls for tougher oversight of X over online safety concerns, while media regulator Ofcom is expected to consider possible restrictions.
UK Prime Minister Keir Starmer has condemned the use of AI to create sexualised deepfakes, describing the practice as “disgraceful” and “disgusting.”
Elon Musk has previously rejected criticisms of X, framing them as attempts to justify censorship.
As of publication, both X and Grok had been contacted for comment.
The bans underscore growing global unease over the rapid expansion of generative AI tools and the challenge of regulating technologies capable of amplifying digital abuse at scale.
For governments in Malaysia and Indonesia, the message is clear: innovation without guardrails carries consequences