docs: Document the garole optimizer

YeonwooSung · Mar 21, 2024 · f715042 · f715042
1 parent 7ff70e0
commit f715042
Showing 1 changed file with 3 additions and 0 deletions.
diff --git a/LLMs/training/sft_mistral_7b_garole/README.md b/LLMs/training/sft_mistral_7b_garole/README.md
@@ -0,0 +1,3 @@
+# Garole Optimizer
+
+With [garole](https://huggingface.co/papers/2403.03507), you could pre-train the 7B LLM model on consumer type hardwares.