From a55ff348c988f3c6d3c5646297fb07a164569bb8 Mon Sep 17 00:00:00 2001 From: Didier Durand Date: Sat, 8 Feb 2025 08:38:03 +0100 Subject: [PATCH] Update README.md: --tp invalid is launch option Hi, As https://github.com/sgl-project/sglang/blob/main/python/sglang/srt/server_args.py at line 497 and next, --tp is not a valid command option. Possible values --tensor-parallel-size or --tp-size I chose --tensor-parallel-size to remain consistent with previous command suggested by this README --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index d9d4ccf..da29ee9 100644 --- a/README.md +++ b/README.md @@ -195,7 +195,7 @@ vllm serve deepseek-ai/DeepSeek-R1-Distill-Qwen-32B --tensor-parallel-size 2 --m You can also easily start a service using [SGLang](https://github.com/sgl-project/sglang) ```bash -python3 -m sglang.launch_server --model deepseek-ai/DeepSeek-R1-Distill-Qwen-32B --trust-remote-code --tp 2 +python3 -m sglang.launch_server --model deepseek-ai/DeepSeek-R1-Distill-Qwen-32B --trust-remote-code --tensor-parallel-size 2 ``` ### Usage Recommendations