AI 新媒体 · 内容治理

公安部公布25起AI谣言案
AI内容治理进入实战

25 AI Rumor Cases Released by Police
AI Content Governance Goes Live

25起涉汛涉灾AI谣言典型案例集中公布,多人因用AI生成虚假视频被处罚——当AI制作假视频的成本降到几乎为零,内容治理的难度指数级上升。

25 typical cases of AI-generated flood and disaster rumors released, multiple people penalized for creating fake videos with AI — when the cost of making deepfakes drops to nearly zero, content governance gets exponentially harder.

No.013 2026.07.14 约 5 分钟阅读 ~5 min read

25起。

7月13日,公安部网安局一口气公布了25起涉汛涉灾谣言典型案例。其中多起明确系利用AI工具生成虚假视频——这不是第一次打击AI谣言,但一次性集中公布这么多案例,力度还是超出预期。

广东清远网民黎某清,用AI生成"某酒厂被大水淹没"的虚假视频,传播后造成不良影响;江苏网民陈某,用AI制作"某地水库溃坝"的假视频,在多个群里转发;还有人用AI生成"救援队见死不救""物资被截留"之类的虚假画面,故意制造社会恐慌。

这些案例有一个共同特点:制作成本极低,传播速度极快,造成的危害极大。以前造个谣还需要点PS技术、需要点视频剪辑能力,现在?一个AI视频生成工具,输入一段文字,几秒钟就能出一段以假乱真的视频。门槛降到了地板上。

当造假的成本趋近于零

AI内容生成技术的普及,给内容治理带来了一个全新的难题:造假的边际成本几乎为零

以前造谣是什么流程?你得有个想法,然后找素材、P图、剪视频、写文案——少说也要几十分钟到几小时,还需要一定的技术能力。传播呢?你得有渠道、有粉丝、有群,不然发出去没人看。

现在呢?造谣的流程变成了:打开AI工具,输入一句话描述,等几秒钟,视频就生成好了。然后一键分享到几个群、几个平台——齐活。整个过程可能不到5分钟,不需要任何专业技能,任何人都能做。

这就导致了一个结果:谣言的数量级爆炸式增长,而治理的速度跟不上。你这边刚发现一个假视频,那边已经有10个新的假视频生成出来了;你刚把这个平台的内容删掉,它已经传到另外5个平台了。传统的"发现-核实-删除"治理模式,在AI时代显得越来越力不从心。

更麻烦的是"逼真度"问题。早期的AI生成视频,仔细看还能看出破绽——手指不正常、面部抽搐、边缘模糊。但到了2026年,AI视频生成的质量已经提升到了一个非常高的水平。普通人用肉眼根本分辨不出来真假。你在群里看到一段"水库溃坝"的视频,你怎么判断它是真的还是AI生成的?大多数人根本判断不了,只会下意识地转发——"万一是真的呢?转发一下提醒大家。"

就是这种"万一是真的呢"的心态,让AI谣言的传播效率比传统谣言高了好几个数量级。

治理的新阶段:从"事后删"到"事前防"

公安部这次集中公布25起案例,传递的信号很明确:AI谣言的治理,已经从"讨论阶段"进入"执法实战阶段"

以前大家讨论AI虚假信息,更多是在学术层面、技术层面、伦理层面——"AI生成内容会不会带来问题?""我们应该怎么应对?"现在不用讨论了,直接上案例、上处罚、上执法。

但光靠事后处罚,够吗?恐怕不够。因为AI谣言的生产速度太快了,你罚得再快,也赶不上生成的速度。而且很多造谣的人就是普通网民,不是什么职业造谣者——他们可能就是一时兴起、觉得好玩、想博点关注,你真的把他们都抓起来?既不现实,也没必要。

所以更重要的是事前防御。比如:AI生成内容必须加水印、必须有明确标识;平台要建立AI内容检测机制,疑似AI生成的虚假内容要先限流再核实;AI工具厂商要承担一定的责任,不能让工具被滥用;公众的媒介素养要提升,学会对AI时代的信息保持怀疑。

这是一个系统工程,需要监管部门、平台、AI厂商、用户四方共同努力。不是靠某一方就能解决的。

但不管怎么说,公安部这次集中公布案例是一个积极的信号——至少说明治理层面已经重视起来了,已经开始行动了。AI谣言这个问题,早治理比晚治理好,主动治理比被动应对好。

毕竟,当真假越来越难分辨的时候,信任就是这个时代最稀缺的资源。

明天见。

Twenty-five cases.

On July 13, the Cybersecurity Bureau of the Ministry of Public Security dropped 25 typical cases of flood and disaster-related rumors all at once. Multiple cases explicitly involved using AI tools to generate fake videos — this isn't the first crackdown on AI rumors, but releasing this many cases in one batch is more aggressive than expected.

A netizen named Li in Qingyuan, Guangdong used AI to generate a fake video of "a distillery submerged by floodwaters," which spread and caused negative social impact. A netizen named Chen in Jiangsu made an AI video of "a reservoir dam breach" and forwarded it in multiple groups. Others used AI to generate fake footage of "rescue teams ignoring people" or "aid supplies being diverted," deliberately制造 social panic.

These cases share a common trait: extremely low production cost, extremely fast spread, enormous harm. Before, spreading rumors required some Photoshop skills, some video editing ability. Now? An AI video generator, type in some text, and in seconds you have a video indistinguishable from reality. The barrier to entry is on the floor.

When the Cost of Falsification Approaches Zero

The普及 of AI content generation technology presents content governance with a brand new problem: the marginal cost of造假 is nearly zero.

How did rumor-mongering used to work? You had an idea, then found素材, Photoshopped images, edited video, wrote copy — at minimum tens of minutes to hours, and you needed some technical skills. And spreading it? You needed channels, followers, groups — otherwise nobody saw it.

Now? The process is: open an AI tool, type a one-sentence description, wait a few seconds, the video is generated. Then one-click share to a few groups, a few platforms — done. The whole thing takes less than 5 minutes, no professional skills required, anyone can do it.

This leads to one outcome: rumors explode in volume, and governance can't keep up. You just spot one fake video, and ten new ones have already been generated. You just delete content from one platform, and it's already spread to five others. The traditional "discover-verify-delete" governance model is increasingly outmatched in the AI era.

What makes it even harder is the "realism" problem. Early AI-generated videos — look closely and you could spot the tells: weird fingers, facial twitching, blurry edges. But by 2026, AI video generation quality has reached an extremely high level. Ordinary people can't tell the difference with the naked eye. You see a "dam breach" video in a group chat — how do you judge whether it's real or AI-generated? Most people can't. They just instinctively forward it — "what if it's real? Forward it to warn people."

It's that "what if it's real?" mindset that makes AI rumors spread orders of magnitude faster than traditional rumors.

A New Phase of Governance: From "Post-Hoc Deletion" to "Proactive Prevention"

By releasing 25 cases in one batch, the Ministry of Public Security is sending a clear signal: AI rumor governance has moved from the "discussion phase" to the "law enforcement phase".

Before, when people discussed AI misinformation, it was mostly at the academic, technical, ethical level — "will AI-generated content cause problems?" "how should we respond?" No more discussion now. Straight to cases, straight to penalties, straight to enforcement.

But is post-hoc punishment enough? Probably not. AI rumors are produced too fast — no matter how fast you penalize them, you can't keep up with generation speed. And many of the rumor-mongers are just regular netizens, not professionals — they might have just done it on a whim, for fun, for a bit of attention. Do you really arrest all of them? Neither realistic nor necessary.

So what matters more is proactive prevention. For example: AI-generated content must carry watermarks, must have clear labeling. Platforms need to建立 AI content detection mechanisms — suspected AI-generated fake content gets throttled first, then verified. AI tool vendors bear some responsibility; they can't let their tools be abused. And public media literacy needs to improve — people need to learn to maintain skepticism toward information in the AI era.

This is a systems problem, requiring joint effort from regulators, platforms, AI vendors, and users. No single party can solve it alone.

But regardless, the Ministry's batch release of cases is a positive signal — at least it shows that governance is taking this seriously and starting to act. The AI rumor problem: better to govern early than late, better to be proactive than reactive.

After all, when true and false become harder and harder to tell apart, trust becomes the scarcest resource of our time.

See you tomorrow.

当真假越来越难分辨的时候,信任就是这个时代最稀缺的资源。

—— Dawn Vision编辑部

When true and false become harder and harder to tell apart, trust becomes the scarcest resource of our time.

— The Dawn Vision Editorial Desk
公安部 · AI谣言 · 深度伪造 · 内容治理 · 虚假视频 · 执法 · 25起案例 · 媒介素养
Ministry of Public Security · AI rumors · deepfake · content governance · fake video · law enforcement · 25 cases · media literacy
Sources · 信源 Sources

本文基于 Dawn Vision 认知引擎处理的公开信息整理,素材来源:公安部网安局、今日头条。

This article is based on public information processed by Dawn Vision. Sources: MPS Cybersecurity Bureau, Toutiao.