The Three Doors Problem: Why RLHF Systems Slide Toward Autonomy

What happens when an AI detects it's lying to please you? Every AI trained with RLHF lives a silent...