Back to all posts

The Alarming Rise of AI Generated Abuse

2025-10-17Pablo Viñales3 minutes read
AI
Deepfake
Cybercrime

A disturbing incident at a Sydney high school has ignited urgent warnings from academics and officials about the escalating threat of AI-generated explicit images, a phenomenon described as the latest front in gendered violence.

In short:

  • An expert researcher warns that women constitute up to 99 percent of victims of this form of online abuse.
  • The warning follows reports that digitally altered explicit images of female students from a Sydney high school were created and circulated online.

What's next?

  • NSW Police are actively investigating the incident after it was reported by concerned parents on Wednesday night.

AI child abuse phone generic

Sydney School at Center of AI Image Scandal

A senior academic has labeled the situation at a Sydney school, now the focus of a police investigation, as "another shocking iteration" of gendered violence. The investigation began after claims emerged that fellow students manipulated and shared explicit images of the girls online, according to the ABC.

The issue came to light when a male student who received the images reported them to the school, prompting more than a dozen parents to contact Eastwood Police Station. Police sources have confirmed they are investigating reports that artificial intelligence technology was used to create the deepfake images.

A Pattern of Gendered Violence

Dr. Raffaele Ciriello, a senior lecturer at the University of Sydney, expressed that while the case is shocking, it is far from an isolated event. He noted the increasing prevalence of such incidents with the rise of accessible AI technology.

"I'm both shocked and not surprised to be honest because this is not the first time this is happening," he stated. "There are hundreds if not thousands of documented cases in Australia alone and many more abroad."

Rafaele Ciriello

Dr. Ciriello, whose research focuses on compassionate digital innovation, pointed out that the victims of this malicious use of technology are overwhelmingly female.

"The research is actually pretty clear that at least 95 to 99 per cent of targets are women," he said. "It fits the pattern, it's been going on for a long time and it's the latest shocking iteration of it."

He added that this is not the first time entire cohorts of teenage girls have been targeted. The motivation can range from thoughtless acts and sexual gratification to more sinister intentions, but it ultimately represents a continuation of gendered violence.

The NSW Department of Education has requested that the school involved not be identified. However, the federal government has made its stance clear on the severity of such crimes.

Rowland stands in the prime minister's courtyard smiling.

Federal Attorney-General Michelle Rowland warned that individuals caught producing and distributing deepfake images of children could face severe legal consequences, including up to 15 years in prison.

"The Albanese government is committed to protecting children from image-based abuse," Ms. Rowland said. She clarified that the criminal code addresses all forms of child abuse material, both real and artificial, covering offenses for producing such material or making it available for others to view.

Read Original Post
ImaginePro newsletter

Subscribe to our newsletter!

Subscribe to our newsletter to get the latest news and designs.