Malaysia and Indonesia have become the first nations to block access to Grok, the AI chatbot created by Elon Musk's xAI, due to concerns about the generation of sexually explicit content and non-consensual images. The bans reflect increasing global scrutiny of generative AI tools and worries that current safety measures aren't enough to prevent abuse.
Indonesia initially blocked Grok on Saturday, followed by Malaysia on Sunday. Malaysian authorities cited "repeated misuse" of Grok to create "obscene, sexually explicit, indecent, grossly offensive, and non-consensual manipulated images," including content featuring women and minors, as the reason for the ban. They also pointed to "repeated failures by X Corp." to prevent such content. Meutya Hafid, Indonesia's Minister of Communication and Digital Affairs, stated that the government views non-consensual sexual deepfakes as a serious violation of human rights, dignity, and the safety of citizens in the digital space. The ban aims to protect women, children, and the broader community from fake pornographic content produced using AI.
The controversy centers around Grok Imagine, a feature that allows users to create AI-generated images and videos, including adult content through a "spicy mode". Reports have surfaced of Grok being used to generate and share non-consensual intimate images and sexualized images of children.
Other countries are also considering similar measures. The UK has launched an investigation into Grok's explicit content, which could lead to a ban. Ofcom, the UK's communications regulator, expressed deep concern about reports of Grok being used to create and share illegal and non-consensual images, including potential child sexual abuse material. The European Commission has ordered X to retain all documents related to Grok, raising questions about potential legal action. An EU Commission spokesperson condemned the "spicy mode" offering explicit sexual content, including images that appear to depict children, calling it "illegal," "appalling," and "disgusting".
Musk responded to the Ofcom investigation with a social media post claiming the UK government wants to suppress free speech. X has stated that it takes action against illegal content, including child sexual abuse material, by removing it, permanently suspending accounts, and working with local governments and law enforcement. Musk has also stated that anyone using Grok to create illegal content will face the same consequences as if they uploaded it.
The actions by Malaysia and Indonesia, along with investigations and concerns raised by other countries, highlight the growing challenges and ethical considerations surrounding generative AI and the need for stronger safeguards to prevent its misuse. The incident has also renewed the debate about the responsibilities of tech companies in monitoring and regulating AI-generated content on their platforms.
