TikTok's algorithm recommends pornography and highly sexualized content to minors accounts, according to a new report by a human rights campaign grou
TikTok’s algorithm recommends pornography and highly sexualized content to minors accounts, according to a new report by a human rights campaign group.
Researchers made up fake child accounts and activated safety settings, but still received sexually explicit search suggestions.
The recommended search terms directed user to sexualized content, including explicit videos depicting penetrative sex.
The platform says it is committed to safe and age-appropriate experiences and took actions to get it resolved once the problem was brought to their attention.
In late July and early August this year, researchers from campaign group Global Witness set up four accounts on TikTok pretending to be 13-year-olds.
They created the accounts with false dates of birth and were not asked to provide any other information to confirm their identities.
Pornography
They also turned on the platform’s “restricted mode”, which TikTok says prevents users from seeing “mature or complex themes, such as… sexually suggestive content”.
Without doing any searches themselves, investigators found overtly sexualized search terms being recommended in the “you may like” section of the app.
Those search terms led to content of women simulating masturbation.
Other videos showed women flaunting their underwear in public places or exposing their breasts.
At its most extreme, the content included explicit pornographic films of penetrative sex.
These videos were embedded in other innocent content in a successful attempt to avoid content moderation.
Ava Lee from Global Witness said the findings came as a “huge shock” to researchers.
“TikTok isn’t just failing to prevent children from accessing inappropriate content – it’s suggesting it to them as soon as they create an account”.
Global Witness is a campaign group which usually investigates how big tech affects discussions about human rights, democracy and climate change.
Researchers stumbled on this problem while conducting other research in April this year.
Videos Taken Down
They informed TikTok, which said it had taken immediate action to resolve the problem.
But in late July and August this year, the campaign group repeated the exercise and found once again that the app was recommending sexual content.
TikTok says that it has more than 50 features designed to keep teens safe: “We are fully committed to providing safe and age-appropriate experiences”.
The app says it removes nine out of 10 videos that violate its guidelines before they are ever viewed.
When informed by Global Witness of its findings, TikTok says it took action to “remove content that violated our policies and launch improvements to our search suggestion feature”.
Children’s Codes
On 25 July this year, the Online Safety Act’s Children’s Codes came into force, imposing a legal duty to protect children online.
Platforms now have to use “highly effective age assurance” to stop children from seeing pornography. They must also adjust their algorithms to block content which encourages self-harm, suicide or eating disorders.
Global Witness carried out its second research project after the Children’s Codes came into force.
Ava Lee from Global Witness said: “Everyone agrees that we should keep children safe online… Now it’s time for regulators to step in.”
While conducting their work, the researchers also noted how other users reacted to the sexualized search terms being suggested to them.
One commenter wrote: “Can someone explain to me what is up with my search recs please?”
Another asked: “What’s wrong with this app?”