deepseekmirror/DeepSeek-Coder
1
0
Fork 0
mirror of https://github.com/deepseek-ai/DeepSeek-Coder.git synced 2025-02-23 06:09:07 -05:00
Code Issues Actions Packages Projects Releases Wiki Activity

modify the "scheduler" in "finetune/configs/ds_config_zero3.json" to be consistent with the sample shell script to finetune

Browse Source
This commit is contained in:
richardodliu 2024-03-15 12:14:16 +00:00
parent fd2db2cafe
commit 05e0ba01aa
1 changed files with 5 additions and 4 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

9
finetune/configs/ds_config_zero3.json
View File

@ -13,11 +13,12 @@
},
"scheduler": {
"type": "WarmupLR",
"type": "WarmupCosineLR",
"params": {
"warmup_min_lr": "auto",
"warmup_max_lr": "auto",
"warmup_num_steps": "auto"
"total_num_steps": "auto",
"warmup_num_steps": "auto",
"warmup_type": "linear",
"warmup_min_ratio": 0.1
}
},