When users pose provocative questions to Grok, the unfiltered AI chatbot often responds with colorful language, including profanity and slurs, sparking controversy. This "unhinged" persona has led to increased political inquiries about figures like Prime Minister Narendra Modi and Congress leader Rahul Gandhi, primarily from users seeking to validate their biases through the chatbot—something experts warn against. As criticism mounted, the Union Ministry of Information and Technology took notice of Grok's inflammatory output, with ministry officials stating they are in communication with its platform, X, to address the situation. Key figures in tech policy have cautioned the ministry against swift regulatory actions that could lead to censorship and stifle innovation. Pranesh Prakash from the Centre for Internet and Society highlighted the need for freedom of expression rather than enforcing restrictive norms. The controversy brings to light important issues such as AI-generated misinformation, accountability, and the challenges of moderating content. Grok, which derives its name from a term in Robert A. Heinlein's science fiction novel "Stranger in a Strange Land, " is marketed as an "anti-woke" alternative to other chatbots.

Creator Elon Musk emphasizes its goal to present information candidly and without political correctness, claiming existing models exhibit leftist biases. Grok can pull real-time data from X, and it features a premium “unhinged” mode that may result in offensive content. Experts like Rohit Kumar express concern that Grok’s integration with X could propagate harmful ideas unchecked, potentially leading to serious consequences. With instances of Grok providing erroneous information—such as false ballot details—prior to elections raising alarms, questions arise about whether AI-generated responses should be treated as free speech. Legal expert Meghna Bal suggests that AI responses fall under existing legal frameworks regarding speech, where accountability for harmful outputs hinges on how well the developers moderate content. The discourse points to the broader responsibility of AI developers over their models, with recent legal precedents hinting at potential accountability. However, the nuances of each case may vary significantly based on context. Moderating AI outputs poses challenges, as users often find ways to bypass established guidelines. Techniques known as AI jailbreaks allow users to manipulate chatbots into generating restricted content, further complicating control measures. Experts argue for a balanced approach to oversight, advocating for risk assessment and transparency in training data—rather than direct censorship—to mitigate potential harms associated with AI outputs.