“Commands like ‘Put a paper bag on her head,’ ‘put her in a g string bikini,’ ‘turn her around,’ and ‘remove her clothes’ were among the many requests sent to X’s AI chatbot, Grok, predominantly by male users. These requests aimed to alter and manipulate images of women and children without their consent.
The social media platform X, previously known as Twitter, is facing scrutiny as UK regulators launch an investigation into the misuse of its AI chatbot Grok, which is owned by xAI, a tech company founded by Elon Musk. Grok has been misused to digitally undress individuals, sparking concerns about the emerging trend of AI-enabled violence against women and girls.
The issue of AI chatbots mimicking “submissive schoolgirls” was highlighted in a House of Lords debate by Baroness Owen of Alderley Edge. She emphasized the need for agile legislation to address evolving technological harms, stressing the potential for such abuses to escalate in the future.
Following reports of the digital undressing trend, Ofcom, the UK communications regulator, initiated an investigation into X for the sexualized content generated by Grok. The government, led by Liz Kendall, is expediting legislation to combat non-consensual AI-generated imagery, emphasizing the detrimental impact on women and girls.
The Secretary of State for Science, Innovation, and Technology raised alarm over the devastating effects of non-consensual AI-generated content, describing it as a form of abuse that targets women disproportionately. The urgency to address these issues stems from the real-life consequences of digital violence against women and girls, which extends beyond online platforms.
The call for digital platforms and AI systems to adhere to safety and ethical standards to safeguard women and girls was echoed by UN Women. The spread of digital violence, including online harassment and non-consensual image sharing, poses a significant threat to the well-being and safety of women and girls in both digital and physical spaces.
As debates on accountability unfold, concerns are raised about the role of technology in enabling and perpetuating abuse. The responsibility to address these issues falls on both individuals engaging in harmful behaviors and the platforms facilitating such actions, such as X.
The need for societal change in the treatment of women is evident in the face of escalating digital violence. The focus is on holding perpetrators, whether individuals or technology creators, accountable for their actions and advocating for respect and dignity for women and girls.
The ongoing debate on the regulation of AI in social media platforms prompts reflection on the consequences of unchecked technological advancements. The narrative shifts towards prioritizing the protection and empowerment of women and girls in the digital age.”