A Dutch judge on Thursday ordered the AI assistant Grok to stop creating nude images without subjects’ consent, arguing that the company’s efforts to curb the practice may not have gone far enough.

Grok — which is owned by Elon Musk’s xAI — will be forced to pay damages of €100,000 ($115,000) a day if it does not comply, according to the ruling, which also said that damages of up to €10 million ($11.5 million) could be levied if xAI does not rectify the problem.

X and Grok drew criticism earlier this year for allowing users to generate and share altered images of individuals — including minors — in sexual contexts. The European Commission is investigating the companies, and the European Council has unveiled a proposal for modifying the bloc’s AI Act to include a ban on AI nudification tools.

X has done some work to stop the spread of the nonconsensual nudes, the judge said, but added that evidence brought by the plaintiff — a nonprofit called Offlimits — suggests that it’s unclear if the changes are actually working. The platform should be subjected to fines to “ensure that the defendants actually do what they claim to be striving for,” the judge said.

Additionally, the court banned xAI from “producing, distributing, offering, publicly displaying and/or possessing sexual imagery in the Netherlands insofar as this involves the use of functionality whereby imagery is generated that qualifies as child pornography under Dutch law.” 

A spokesperson for X did not immediately respond to a request for comment.

X has said it restricted Grok’s nudification function in January after a global backlash to the millions of nude images the chatbot shared in a short time frame beginning in late December.

In a statement released at the time, X said “we remain committed to making X a safe platform for everyone and continue to have zero tolerance for any forms of child sexual exploitation, non-consensual nudity, and unwanted sexual content.” 

Offlimits hailed the court’s decision. “Today, the court has drawn a clear line: technology is not a license to violate human rights online,” Robbert Hoving, managing director of Offlimits, said in a statement. “Because Grok does not take the victim’s location into account, this groundbreaking ruling extends beyond Dutch borders; it applies worldwide.” 

“The message is clear: human dignity always comes before commercial gain.”