How a model learns what we want — by being shown what we prefer.