What is reinforcement learning with verifiable rewards?

Definition

The learner tries responses or actions and gets a reward when a verifier confirms an outcome, such as a correct calculation or a passing test.

The verifier defines what earns credit. A narrow check may reward a solution that misses other requirements, such as handling invalid inputs.

ELI5

For example, a model can practise arithmetic and get a point whenever its answer matches a calculator.

If the check only reads the final number, the model could earn the point even with a confusing explanation.

What can serve as a verifier?

An answer checker or a test suite can serve as a verifier when the required outcome can be evaluated automatically.

Does a passing check prove overall quality?

The check establishes the conditions it measures. Other requirements may need separate checks or review.

  1. Portrait of Nate B. Jones beside the words Agents Chase Done
Definition card for reinforcement learning with verifiable rewards: What is reinforcement learning with verifiable rewards?

Reinforcement learning with verifiable rewards trains a model using outcomes that can be checked automatically.