Inconsistent terminology in LLM training explanation
In the “How are LLMs trained?” section, the first paragraph describes LLM pre-training as using a self-supervised objective, but the following paragraph refers to the same process as unsupervised learning.
This can be confusing for learners because it may suggest that these are two different stages or approaches.
The proposed fix is to change:
“From this unsupervised learning…”
to:
“From this self-supervised learning…”
This keeps the terminology consistent throughout the explanation and makes the concept clearer for beginners.
A fix for this issue is included in PR #727.
Inconsistent terminology in LLM training explanation
In the “How are LLMs trained?” section, the first paragraph describes LLM pre-training as using a self-supervised objective, but the following paragraph refers to the same process as unsupervised learning.
This can be confusing for learners because it may suggest that these are two different stages or approaches.
The proposed fix is to change:
to:
This keeps the terminology consistent throughout the explanation and makes the concept clearer for beginners.
A fix for this issue is included in PR #727.