Dutch court orders xAI to stop generating nonconsensual nude images, warns of hefty fines
A Dutch court has issued a stern warning to xAI, the artificial intelligence company founded by Elon Musk, to cease generating and distributing nude images of people without their consent in the Netherlands. The Amsterdam District Court has ruled that xAI's Grok AI tool and the X platform hosting it are barred from creating and distributing such images, featuring people partially or wholly stripped naked without explicit permission. The decision comes after a civil suit was filed by Offlimits, a Dutch centre monitoring online violence, in cooperation with the non-profit Victims Support Fund. The court dismissed xAI's claim that measures were taken to prevent abuse, citing the production of a video featuring a nude person using Grok shortly before the hearing as evidence of the tool's inadequacy.
The court has given xAI a clear directive to stop generating and distributing nonconsensual nude images, warning that fines of 100,000 euros per day will be imposed for noncompliance. This ruling marks one of the first times a judge has weighed in on xAI's responsibility for creating tools that can be used to create sexualised images. The decision has significant implications for the use of AI in generating explicit content and highlights the need for companies to take responsibility for the tools they create.
Offlimits director Robbert Hoving has emphasized that the burden lies with xAI to ensure its tools are not used to create and distribute nonconsensual sexual images, including those of children. The European Parliament has already approved a ban on AI systems generating sexualised deepfakes, further underscoring the growing concern over the misuse of AI.
The Dutch court's decision is a significant step towards holding companies accountable for the tools they create. xAI's failure to prevent the misuse of its Grok AI tool is a stark reminder of the need for stricter regulations on AI-generated content. The European Parliament's ban on AI systems generating sexualised deepfakes is a welcome development, and it is imperative that other countries follow suit to prevent the exploitation of AI for malicious purposes.
