Zubnet AIAprenderWiki › Watermarking
Safety

Watermarking

AI Watermark, Text Watermarking
Técnicas para embarcar sinais invisíveis em conteúdo gerado por IA que permitem detecção posterior. Watermarking de texto enviesa sutilmente a seleção de tokens durante a geração para que um detector possa estatisticamente identificar texto watermarked. Watermarking de imagem embarca padrões invisíveis nos pixels gerados. O objetivo é tornar o conteúdo IA identificável sem degradar sua qualidade.

Por que importa

Enquanto conteúdo gerado por IA se torna indistinguível de conteúdo criado por humanos, watermarking é uma das poucas abordagens técnicas que poderiam ajudar a distingui-los em escala. Importa para combater desinformação, integridade acadêmica e proveniência de conteúdo. Mas não é um problema resolvido — watermarks de texto podem ser removidos por paráfrase, e a corrida armamentista entre watermarking e remoção está em curso.

Deep Dive

The most cited approach to text watermarking (Kirchenbauer et al., 2023) works by splitting the vocabulary into "green" and "red" lists at each generation step, using a hash of the previous token as the seed. The model is then biased to prefer green-list tokens. A detector that knows the hashing scheme can check whether a text uses statistically more green-list tokens than expected by chance. The bias is small enough that humans don't notice, but large enough for statistical detection over a few hundred tokens.

The Robustness Problem

Text watermarks are fragile. Paraphrasing the text (manually or with another model), translating to another language and back, or even inserting/deleting a few words can destroy the statistical signal. This is fundamentally different from image watermarks, which can survive cropping, compression, and resizing. The research community is working on more robust schemes, but there's an inherent tension: a stronger watermark affects text quality, while a subtler watermark is easier to remove.

Adoption and Regulation

The EU AI Act mandates that AI-generated content be labeled as such, pushing watermarking from research toward deployment. Google's SynthID and Meta's watermarking research are production implementations. But voluntary adoption is uneven — if only some providers watermark, users can simply switch to one that doesn't. Effective watermarking may ultimately require regulation or industry-wide standards, similar to how content ratings work for media.

Conceitos relacionados

← Todos os termos
← Wan-AI Weights →