Elon Musk's AI chatbot, Grok, now allows users to create AI-generated images from text prompts and share them on social media. However, the tool has faced controversy as users have flooded the platform with fake images of political figures, including Donald Trump and Kamala Harris, depicting them in false and disturbing situations. Unlike other AI photo tools, Grok appears to have few limitations in place. CNN tests revealed that it could generate fake, realistic images of politicians that could be misleading to voters. Users also created and shared images of drug use, violent acts, and sexualized content. This has raised concerns about the potential for AI to spread false information, particularly during the US presidential election. While many leading AI companies have implemented measures to prevent the misuse of their AI image generation tools, it is evident that enforcement measures can sometimes be bypassed.

Some social media platforms have also taken steps to label AI-generated content. It remains unclear if X has policies against Grok generating misleading images of political candidates. The platform does have a policy against sharing synthetic or manipulated media that could deceive or harm people, but the enforcement of this policy is not clear. The release of the Grok image tool coincides with criticism towards Musk for spreading false claims on X related to the election and hosting Trump for an unchallenged conversation. Other AI image generation tools have faced backlash for issues such as producing historically inaccurate depictions or enabling the creation of misinformation videos. Although Grok does have some restrictions, such as not generating explicit content, its enforcement of limitations against harmful stereotypes and hate speech appears inconsistent.