Training Human Super-Recognizers’ Detection and Discrimination of AI-Generated Faces

Quick Overview

Training human super-recognizers to detect AI-generated faces using StyleGAN3 faces reveals that even after training, the super-recognizers still performed worse than random guessing (a score around zero) on the discrimination task, suggesting that while the hyperrealism effect is real and causes bias toward rating AI faces as more real, the trained detectors failed to reliably spot subtle flaws, though the newer StyleGAN4 generation showed significant improvement over StyleGAN3.

Key Points: The study trained human super-recognizers (SRs) to distinguish between real and StyleGAN3-generated faces, finding that even trained SRs performed at chance level (score near zero) on the discrimination task. The AI hyperrealism effect is real, causing participants to rate synthetic faces as more trustworthy than real faces, even before formal training. The control group (typical people) showed a strong bias, rating the synthetic faces as more real than the actual human faces. The training procedure successfully eliminated the bias for both the SRs and control groups, causing them to rate the hyperrealistic AI faces as less trustworthy than real ones. The newer StyleGAN4 faces showed noticeably worse performance (a small drop) compared to older studies using StyleGAN2, suggesting rapid evolution in AI artifact generation. The training procedure, which focused on an arbitrary digital artifact (the subtle flaws in the images), was effective in helping participants overcome the initial perceptual bias.

Context: This video discusses the findings of a research study focused on human perception and the increasing difficulty in distinguishing between real human faces and highly realistic faces generated by Artificial Intelligence, specifically models like StyleGAN3 and the newer StyleGAN4. The experiment involved training human 'super-recognizers' (SRs) to detect subtle flaws in AI-generated images to see if specialized training could overcome the inherent psychological bias humans exhibit towards hyperrealistic synthetic media.