What is soft language model watermarking?

Definition

Soft language model watermarking adds a controlled bias to the logits of green-listed tokens before sampling. A strongly preferred factual continuation can still win even when it is not green, while uncertain choices are gently shifted toward tokens that contribute to the hidden pattern.

This approach preserves quality better than a hard ban but creates a weaker signal. Reliable detection usually needs enough tokens and a statistical test that compares the observed green-token count with the amount expected under unwatermarked sampling.

Acronyms and aliases

soft LLM watermarking acronymsoft watermarking variant

Frequently asked questions

How does soft language model watermarking preserve answer quality?

It biases preferred tokens rather than banning alternatives, so a high-probability correct continuation can still be selected.

Why does soft watermarking need statistical detection?

Individual token choices remain plausible, so the signal appears as a small aggregate preference across many generation steps.

Videos explaining soft language model watermarking