Training_Language_Models_to_Follow_Instructions_with_Human_Feedback.md

Training language models to follow instructions with human feedback

This week's paper Training language models to follow instructions with human feedback.

Learning to summarize from human feedback is an earlier OpenAI RLHF paper which has a good video summary.

Further Reading:

• Learning to summarize with human feedback (blog post)

• Learning to summarize from human feedback

• Learning to summarize from human feedback (Paper Explained)

• Illustrating Reinforcement Learning from Human Feedback (RLHF)

• RLHF: Reinforcement Learning from Human Feedback

• Understanding Reinforcement Learning from Human Feedback (RLHF)

• RLHF learning resources in 2024

• Why reward models are key for alignment

• Hugging Face RL Course: PPO