The Alarming Rise of Deepfake Abuse in Australian Schools

The Alarming Rise of Deepfake Abuse in Our Schools

A troubling new reality is unfolding in Australian schools. Reports of deepfake image-based abuse have not only doubled in the last 18 months but are now occurring at a rate of at least one incident per week. This shocking data, released by Australia's eSafety Commissioner, paints a grim picture of a rapidly growing digital threat to our youth.

The issue was recently thrust into the spotlight following a police investigation into a high school in Sydney where female students were targeted with digitally altered explicit images. Commissioner Julie Inman Grant confirmed that her office is actively working with NSW Police and the Department of Education on the case.

"This is real cause for concern. This is really putting potential online harms on steroids," Ms. Inman Grant warned.

She believes this is just the beginning, especially with the rise of powerful AI tools like OpenAI's Sora, which can generate hyper-realistic videos from a few images in seconds, making this form of abuse easier than ever to perpetrate.

A Growing Global Pandemic

This isn't just an Australian problem; it's a global one. Colm Gannon, the CEO of the International Centre for Missing and Exploited Children, has pointed out that the issue is escalating dramatically worldwide.

In the United States, social media platforms have reported a staggering 1,325% increase in AI-generated abusive material and deepfakes targeting children. The surge is so significant that governments are being forced to act, with new legislation being passed in the US and proposed in Australian states like NSW.

The Fight Back Against Digital Violence

Australia is taking a leading role in tackling this crisis. The eSafety Commissioner is not only providing resources like an incident management tool for schools but is also taking direct action against the companies that create these harmful tools. Ms. Inman Grant noted action is being taken against services offering "nudifying" apps, some of which are used by over 100,000 people in Australia.

Working with international partners like Ofcom in the UK, the eSafety office has achieved a remarkable 98% success rate in getting harmful deepfake images removed from online platforms.

The Devastating Human Cost

Behind the statistics are real students facing fear and trauma. NSW Women's Safety Commissioner, Dr. Hannah Tonkin, has spoken with high school girls who are terrified of becoming the next target.

"Many are seeing it happen to their friends and they're really scared it's going to happen to them," Dr. Tonkin said.

She rightly calls the technology behind so-called 'nudify' apps "disgusting technology" designed to degrade and dehumanize women and girls, who are overwhelmingly the victims. In response, the NSW Department of Education is collaborating with the eSafety Commissioner to develop better digital literacy education for students, hoping to arm them with the tools and knowledge to navigate the internet and AI safely and responsibly.