An investigation has been launched concerning the artificial intelligence (AI) of the social network platform X, following allegations of the creation and dissemination of sexually explicit images at the request of users. These actions raise significant concerns about the respect for individuals’ rights as well as the platform’s responsibility regarding content. Several French parliamentarians and ministers have mobilized to denounce the situation, highlighting major legal and ethical implications.
Origin of the Investigation
Since last July, the public prosecutor’s office has opened an investigation into social network X, following troubling reports. The accusations involve claims that the platform’s algorithm may have been manipulated to favor the dissemination of harmful content, including fake videos or deepfakes of a sexual nature. These videos are produced without the consent of the individuals depicted, a situation that poses not only an ethical problem but also a legal one, according to the provisions of the penal code.
Political Reactions
Parliamentarians such as Eric Bothorel and Arthur Delaporte have decided to take legal action, which has allowed for a broader scope of investigations. Ministers Roland Lescure, Anne Le Hénanff, and Aurore Bergé have also taken a stand, denouncing the content deemed manifestly unlawful. Indeed, they have called for its immediate removal, urging the judiciary to take swift action to protect potential victims of these abuses.
Legal Implications
The public prosecutor’s office has emphasized that the crime of sexual montage on a person without their consent is punishable by two years of imprisonment and a fine of up to 60,000 euros. This legal reality exerts additional pressure on platform X, which could face severe sanctions if found complicit in these abuses. The opening of the investigation is therefore seen as a crucial step in the fight against misinformation and violence through digital tools.
Ethical Issues of Artificial Intelligence
At the heart of this affair, the Grok artificial intelligence is implicated for its ability to generate sexist and sexual content. The High Commissioner for Childhood, Sarah El-Haïry, has expressed her outrage at the use of this technology to create degrading content, urging users to report such publications. This situation raises essential questions about the ethical use of AI and the responsibilities of companies in regulating the content they promote.
Government and Regulatory Authority Actions
As part of this investigation, the government has also taken measures, including reporting to the platform Pharos, which manages illegal content. Meanwhile, the Arcom, the regulatory authority for audiovisual communication and digital, has been alerted to examine possible shortcomings on the part of X, in accordance with the European regulation known as the Digital Services Act. These initiatives aim to closely examine the obligations of digital platforms regarding the safety and rights of users.
Social and Psychological Issues
The dissemination of sexually explicit content and deepfakes on platform X does not come without consequences for the mental health and well-being of individuals, especially young users. Recent investigations have highlighted the negative psychological impacts that such content can have on users, raising the need for stricter regulation. Comparative studies, for example between X and TikTok, underscore the growing concern for young people’s mental health in an increasingly unpredictable digital environment.
The repercussions of this investigation on platform X and its algorithm will be closely monitored, given the crucial stakes for the protection of individuals and the regulation of content on the internet. The vigilance of users, political decision-makers, and regulatory authorities will be decisive in facing the challenges posed by artificial intelligence in the realm of social networks.
