Skip to content

Commit 81981be

Browse files
committed
docs: polish advanced RL course chapters
1 parent ef509e6 commit 81981be

24 files changed

Lines changed: 2041 additions & 2535 deletions

docs/.vitepress/config.mjs

Lines changed: 11 additions & 11 deletions
Original file line numberDiff line numberDiff line change
@@ -1314,11 +1314,11 @@ const zhSidebar = {
13141314
link: '/chapter28_vla/embodied-intelligence/'
13151315
},
13161316
{
1317-
text: '24.4 视觉生成与 DanceGRPO',
1317+
text: '24.4 图像生成怎样用强化学习对齐',
13181318
link: '/chapter29_visual_generation/visual-generation-dancegrpo'
13191319
},
13201320
{
1321-
text: '24.5 视频 RLHF 与物理感知生成',
1321+
text: '24.5 视频为什么会前后矛盾',
13221322
link: '/chapter29_visual_generation/video-generation-modern'
13231323
}
13241324
]
@@ -1334,23 +1334,23 @@ const zhSidebar = {
13341334
collapsed: false,
13351335
items: [
13361336
{
1337-
text: '25.1 经典对齐失败模式',
1337+
text: '25.1 奖励越高,任务为什么反而做坏',
13381338
link: '/chapter30_alignment_failures/classical-failures'
13391339
},
13401340
{
1341-
text: '25.2 RLVR 假性收益',
1341+
text: '25.2 如何判断 RLVR 提升是真的',
13421342
link: '/chapter30_alignment_failures/modern-incidents'
13431343
},
13441344
{
1345-
text: '25.3 潜伏智能体与对齐伪装',
1345+
text: '25.3 模型为什么会在特定条件下切换行为',
13461346
link: '/chapter30_alignment_failures/sleeper-and-faking'
13471347
},
13481348
{
1349-
text: '25.4 防御机制',
1349+
text: '25.4 如何防止模型钻奖励漏洞',
13501350
link: '/chapter30_alignment_failures/scaling-and-defenses'
13511351
},
13521352
{
1353-
text: '25.5 强化学习评测与 Harness',
1353+
text: '25.5 如何可信地评测强化学习模型',
13541354
link: '/chapter30_alignment_failures/rl-evaluation'
13551355
}
13561356
]
@@ -1360,19 +1360,19 @@ const zhSidebar = {
13601360
collapsed: false,
13611361
items: [
13621362
{
1363-
text: '26.1 自博弈与 LLM 训练',
1363+
text: '26.1 模型怎样自己产生训练数据',
13641364
link: '/chapter32_selfplay/self-play-outlook/'
13651365
},
13661366
{
1367-
text: '26.2 RL Scaling Laws 与 Foundation Model RL',
1367+
text: '26.2 新增算力应该花在哪里',
13681368
link: '/chapter32_selfplay/rl-scaling-outlook'
13691369
},
13701370
{
1371-
text: '26.3 LLM 多智能体强化学习',
1371+
text: '26.3 多个 LLM 怎样共同学习',
13721372
link: '/chapter32_selfplay/llm-multi-agent-rl/'
13731373
},
13741374
{
1375-
text: '26.4 进化搜索与科学发现',
1375+
text: '26.4 LLM 怎样搜索新算法',
13761376
link: '/chapter32_selfplay/alphaevolve/'
13771377
}
13781378
]
982 KB
Loading
3.5 MB
Loading

docs/chapter29_visual_generation/video-generation-modern.md

Lines changed: 186 additions & 249 deletions
Large diffs are not rendered by default.

docs/chapter29_visual_generation/visual-generation-dancegrpo.md

Lines changed: 228 additions & 759 deletions
Large diffs are not rendered by default.

docs/chapter30_alignment_failures/classical-failures.md

Lines changed: 171 additions & 142 deletions
Large diffs are not rendered by default.
225 KB
Loading
44.2 KB
Loading
114 KB
Loading
55.5 KB
Loading

0 commit comments

Comments
 (0)