deepseekmirror/DeepSeek-R1
1
0
Fork 0
mirror of https://github.com/deepseek-ai/DeepSeek-R1.git synced 2025-02-23 06:09:00 -05:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity

Update README.md: --tp invalid is launch option

Browse Source 
Hi,
As  https://github.com/sgl-project/sglang/blob/main/python/sglang/srt/server_args.py at line 497 and next, --tp is not a valid command option.

Possible values --tensor-parallel-size or --tp-size

I chose --tensor-parallel-size to remain consistent with previous command suggested by this README
This commit is contained in:
Didier Durand 2025-02-08 08:38:03 +01:00 committed by GitHub
parent 97612c28d0
commit a55ff348c9
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
README.md
View File

@ -195,7 +195,7 @@ vllm serve deepseek-ai/DeepSeek-R1-Distill-Qwen-32B --tensor-parallel-size 2 --m
You can also easily start a service using [SGLang](https://github.com/sgl-project/sglang) You can also easily start a service using [SGLang](https://github.com/sgl-project/sglang)
```bash ```bash
python3 -m sglang.launch_server --model deepseek-ai/DeepSeek-R1-Distill-Qwen-32B --trust-remote-code --tp 2 python3 -m sglang.launch_server --model deepseek-ai/DeepSeek-R1-Distill-Qwen-32B --trust-remote-code --tensor-parallel-size 2
``` ```
### Usage Recommendations ### Usage Recommendations