Posted by Mumbai: Elon Musk’s free AI assistant chatbot Grok AI on X (formerly Twitter) has become the centre of a content moderation controversy, according to media reports. X admitted it failed to moderate and prevent the circulation of sexually explicit content generated through Grok AI. Indian authorities reported that the platform blocked around 3,500 posts and deleted more than 600 accounts linked to the incident.
AI chatbots
The episode shows how people can exploit AI chatbots to create deepfake images and harmful content. Grok AI, like other AI-powered chatbots, can generate text and images. But users can also exploit it to generate sexually explicit material, harassment, or misinformation. Researchers warn that this is part of a broader challenge as AI tools grow more capable while regulatory frameworks lag behind.
Deepfakes
Northwestern University’s recent brief shows that AI can create deepfakes, making it appear that people say or do things they never did. Deepfakes pose political, security, and societal risks, including misinformation, harassment, and breaches of privacy. The Grok AI incident reflects these risks, showing how AI chatbots can inadvertently amplify harmful content if not carefully controlled.
Governments raise concerns and restrictions against Grok AI
India’s Ministry of Electronics and Information Technology (MeitY) intervened, directing X to remove the content and submit a detailed report on measures taken. X responded by deleting accounts and posts, while promising stronger safeguards against future misuse.
Recently, Grok AI has faced government bans and restrictions in Southeast Asia over misuse of its image generation features.
Indonesia became the first country to fully block access to Grok AI, citing concerns that users were generating non-consensual, sexually explicit deepfake images that violated human rights and digital safety standards. Indonesian regulators said the creation and sharing of such content posed serious risks to citizens and contravened local laws, prompting the temporary block, according to a Bloomberg report.
Shortly after, Malaysia’s Communications and Multimedia Commission suspended access to Grok AI, stating that repeated misuse to generate obscene and indecent content, including material involving women and minors, showed that safeguards on the platform were inadequate. The ban will remain in place until xAI and X implement verified technical and moderation changes to address these issues, the report added.
These actions follow broader international concerns about Grok AI’s image generation capabilities and deepfake abuse. Regulators in multiple countries are now demanding stronger safety measures and clear compliance with local legal frameworks before restoring access.
Responsible AI
The incident underscores the need for responsible AI development, ethical moderation, and compliance with local laws. As AI tools become more accessible, the potential for misuse grows. The Grok AI episode serves as a warning: without proper controls, AI platforms can become vectors for deepfakes and other abuses, raising legal, ethical, and societal concerns.
This case indicates why AI innovation must be balanced with oversight. Governments, developers, and users alike need robust measures to prevent harm while harnessing the potential of AI technologies responsibly.
(Updated article – 10:34 IST, 12 Jan 2026)