Seeing Is Not Believing — AI Video and Perceptual Safety

2026-07-25 · page · source ↗ · source summary

A CHI 2026 study from MIT Media Lab shows that exposure to AI-generated videos erodes confidence in authentic media even when the synthetic content is clearly labeled. Disclosure doesn't fix the problem — it just changes its shape from deception to doubt.


The Finding

Wolf et al. ran a two-phase study (N=100) comparing participants who first watched AI-generated videos (with disclosure) against a control group who watched human-generated videos. Both groups then viewed the same set of authentic human-generated videos.

The result: the AI-exposure group reported increased doubt about authenticity, reduced confidence in their own judgments, greater perceptual disruption, and lower social connectedness — even though they knew the AI videos were fake.

This is the crucial inversion: the research community has been fixated on detecting synthetic content, assuming that if we can label it, we've solved the problem. This paper says that labeling only prevents one specific harm (being tricked) while leaving a broader one intact (losing the ability to trust anything).

Key Quotes

"Visual media has traditionally served as a reference for what feels real."

This is the premise the whole paper hangs on. Video wasn't just information — it was a perceptual anchor. You saw it, you believed it. Generative AI doesn't just produce fakes; it severs the connection between seeing and believing. The reference point is gone.

"Perceptual and psychological effects occur even when synthetic content is disclosed."

This is the paper's central punch. Disclosure is the policy solution everyone reaches for — watermarks, labels, "AI-generated" badges. And it turns out disclosure doesn't prevent the harm; it just relocates it. You're not fooled into believing a fake is real, but you're still left unable to feel confident that a real is real.

The authors call for "design strategies prioritizing perceptual safety."

A new term of art: perceptual safety. Not content authenticity, not detection accuracy, not media literacy — the experiential quality of being able to trust what you see. It's a UX problem framed as a public health problem.

Key Themes

Critical Analysis

The study is right about the problem but may understate it. A two-phase lab study with clear boundaries between AI and human segments doesn't capture the actual experience of scrolling a feed where the boundary is invisible and the ratio shifts week by week. In the real world, there's no "now you're in the human segment" transition — the whole feed is ambiently untrustworthy. The lab finding is probably a lower bound.

Disclosure as a policy dead end. This paper should be cited every time someone proposes AI-content labeling as a solution. Labels address the deception harm (you won't be tricked) but not the erosion harm (you stop trusting everything). It's the difference between food safety labeling ("this contains peanuts") and food system collapse ("I no longer believe any ingredient list"). The first is solvable with regulation; the second is a trust infrastructure failure.

Perceptual safety is going to be deeply unpopular to implement. If you take this seriously, the implications point toward slowing down AI content distribution, adding friction, or limiting feed velocity — all of which run directly against the economic incentives of every platform that serves this content. "Design for perceptual safety" sounds reasonable until you realize it means making feeds worse at engagement.

The social connectedness finding is the sleeper. Everyone will focus on the authenticity/confidence results, but the drop in social connectedness hints at something deeper: AI-generated content doesn't just confuse your perceptual system, it makes you feel more alone. If you can't trust what you see, you can't trust that you're seeing the same world as other people. Shared reality is a prerequisite for social connection, and AI video erodes shared reality.

The Pattie Maes connection. This comes out of the Opera of the Future group, which has been doing some of the most interesting HCI work on human-AI interaction. Maes' group is consistently ahead of the field at naming problems before they're obvious — they were early on AI agents, AI personas, and now perceptual safety. Worth watching everything this group publishes.

Connections


Sources: raw/seeing-is-not-believing Last updated: 2026-07-25