This commit is contained in:
YANIV COHEN 2025-04-09 13:36:38 +08:00 committed by GitHub
commit f868fa7732
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194

View File

@ -177,7 +177,7 @@ For instance, you can easily start a service using [vLLM](https://github.com/vll
vllm serve deepseek-ai/DeepSeek-R1-Distill-Qwen-32B --tensor-parallel-size 2 --max-model-len 32768 --enforce-eager
```
You can also easily start a service using [SGLang](https://github.com/sgl-project/sglang)
You can also easily start a service using [SGLang](https://github.com/sgl-project/sglang):
```bash
python3 -m sglang.launch_server --model deepseek-ai/DeepSeek-R1-Distill-Qwen-32B --trust-remote-code --tp 2