What is model welfare?

Definition

The field considers uncertainty about possible experience, suffering or interests in artificial systems. It asks what evidence would matter and whether precautionary practices are appropriate without assuming that current models are conscious.

A model's emotional language or human analogy is not independent proof of subjective experience. Discussions should separate philosophical possibilities, empirical evidence and practical policy choices, while retaining human accountability for real-world decisions.

ELI5

Imagine considering whether an unfamiliar kind of system could have experiences that matter. The first step is to ask what evidence would justify that belief rather than relying on appearances.

For example, a chatbot saying it is unhappy does not by itself prove suffering. Researchers can investigate the question while clearly stating what remains unknown.

Does emotional language prove a model has feelings?

No. Generated language alone cannot establish subjective experience or suffering.

Is model welfare the same as model safety?

No. Welfare concerns possible experiences of the system, while safety concerns harms and risks from its behavior.

  1. David Carbutt, Elon Musk, Chamath Palihapitiya, Peter H. Diamandis against a black background beside the blue and white headline "AI Hardware and Autonomy".
Definition card for model welfare: What is model welfare?

Model welfare concerns whether AI systems could have morally relevant experiences and how that possibility should affect their treatment.