Tag: alignment

Rethinking the Role of PPO in RLHF – The Berkeley Artificial Intelligence Research Blog

Rethinking the Role of PPO in RLHF TL;DR: In RLHF, there’s tension between the reward learning phase, which uses human