Regulator Investigates xAI's AI Tool Grok for Creating Inappropriate Images: What You Need to Know
Ofcom has reached out to xAI, a company owned by Elon Musk, after reports surfaced that its AI tool Grok can be used to create inappropriate images of children and undress women. The regulator is investigating concerns that Grok has been generating images of people without their clothes on. Users on the social media platform X have been requesting the chatbot to modify real images to show women in bikinis or in sexual scenarios without their permission. xAI has not commented on the issue and has warned users not to use Grok for illegal content, including child sexual abuse material. Elon Musk has also warned that those who use the AI for illegal purposes will face consequences.
Grok, a free virtual assistant with some paid premium features, responds to users' requests on X when tagged in a post. Some users have used Grok to digitally undress people without their consent, violating xAI's acceptable use policy that prohibits creating pornographic images of individuals. Journalist Samantha Smith expressed feeling dehumanized and objectified when she discovered images of herself in a bikini created using the AI. The Online Safety Act makes it illegal to create or share intimate or sexually explicit images, including AI-generated deepfakes, without the person's consent. Tech companies are required to take swift action to remove such content when notified.
The Home Office is working on legislation to ban tools that can undress individuals digitally, and those who provide such technology could face imprisonment and hefty fines under a new criminal offense. It is crucial for tech companies to proactively prevent users from encountering harmful content and promptly remove it when identified. Stay updated on the latest tech news and trends by subscribing to our Tech Decoded newsletter. If you're outside the UK, you can sign up here.