French and Malaysian authorities are investigating Grok for allegedly creating fake videos of a sexual nature

Over the past few days, France and Malaysia have joined India in condemning Grok for creating fake sexualized clips of women and minors.

The chatbot, created by Elon Musk’s AI startup xAI and featured on his social media platform

The statement continued: “This violates ethical standards and perhaps American laws regarding… [child sexual abuse material]. It was a failure of safeguards, and I’m sorry for any harm I caused. xAI reviews to prevent future issues.

It is not clear who is actually apologizing or accepting responsibility in the above statement. Dissenter’s Albert Bernico noted that Grok “is not in any real sense anything like ‘I’,” which makes the apology, in his opinion, “entirely without substance” as Grok “cannot be held accountable in any meaningful way for turning Twitter into an on-demand CSAM factory.”

Futurism found that in addition to producing non-consensual pornographic images, Grok was also used to create images of women being sexually assaulted and abused.

“Anyone who uses Grok to create illegal content will suffer the same consequences as if they uploaded illegal content,” Musk posted on Saturday.

Some governments have taken notice, with India’s IT Ministry issuing an order on Friday stating that X must take action to prevent Grok from creating content that is “obscene, pornographic, vulgar, indecent, sexually explicit, paedophile, or otherwise prohibited by law.” The order states that

French authorities also said they were taking action, with the Paris prosecutor’s office telling Politico it would investigate the spread of sexually explicit deepfakes on

The Malaysian Communications and Multimedia Commission also published a statement saying it had “taken note with grave concern of public complaints about the misuse of artificial intelligence (AI) tools on the X platform, specifically the digital manipulation of images of women and minors to produce grossly inappropriate, offensive and other harmful content.”

The commission added that it is “currently investigating online harms in X”.