github/gpt4all
1
0
Fork 0
mirror of https://github.com/nomic-ai/gpt4all.git synced 2025-09-05 02:20:28 +00:00
Code Issues Packages Projects Releases Wiki Activity

make codespell happy

Browse Source
This commit is contained in:
Aaron Miller
2023-10-10 08:58:41 -07:00
committed by AT
parent 4f0cee9330
commit 3c25d81759
2 changed files with 3 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
gpt4all-training/train.py
View File

@@ -75,7 +75,7 @@ def train(accelerator, config):
else DummyOptim
)
# karpathy doesn't decay embeddding, maybe we should exclude
# karpathy doesn't decay embedding, maybe we should exclude
# https://github.com/karpathy/minGPT/commit/bbbdac74fa9b2e55574d70056163ffbae42310c1#diff-2075fa9c224b395be5bda85544dd36572b59c76c54562819eadadbf268602834R157s
optimizer = optimizer_cls(model.parameters(), lr=config["lr"], weight_decay=config["weight_decay"])