Riana Pfefferkorn: Student Misuse of AI-Powered “Undress” Apps

Quick Overview

Riana Pfefferkorn's research identifies that student misuse of AI-powered "undress" or "nudify" apps to create non-consensual synthetic imagery (AICSAM/deep fake nudes) is facilitated by easily accessible, purpose-built open-source models, leading to significant psychological harm for victims and exposing gaps in current school preparedness, mandatory reporting laws, and juvenile justice responses.

Key Points: The primary source for AICSAM generation involves open-source AI models, often running locally, which are easier to abuse than mainstream hosted models, as their safety guardrails can be removed or were trained on problematic data like Stable Diffusion 1.5. Purpose-built "nudify" or "undress" apps, underpinning many school incidents, require no technical skill, allowing underage users to create deep fake nudes from a single image, with research finding these apps do not consistently ban image uploads of minors. Schools are currently unprepared for these incidents, often only addressing online risks reactively, and frequently botch responses by focusing on disciplining the perpetrator rather than supporting victims, which destroys community trust. Motivations for students creating deep fake nudes range from sheer curiosity and pranks to malicious bullying or use as a form of intimate partner violence, though victims consistently experience extreme psychological harm, including anxiety and fear of lifelong reputational risk. Legislative responses are evolving; dozens of states recently criminalized AICSAM, but few laws address scenarios where the offender is a minor, leading to skepticism among experts regarding appropriate consequences like criminal prosecution versus counseling. The federal Take It Down Act criminalizes non-consensual publishing of real or deep fake nudes and mandates platforms remove reported imagery within 48 hours, although this law primarily leaves juvenile prosecution to state jurisdiction. Schools must prepare by taking anonymous tips seriously, establishing crisis management plans addressing evidence preservation versus victim support (image deletion), and educating students broadly on consent, dignity, and privacy.