deepseekmirror/DeepSeek-V3
1
0
Fork 0
mirror of https://github.com/deepseek-ai/DeepSeek-V3.git synced 2025-02-22 05:38:59 -05:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity

docs: Add system requirements for DeepSeek-Infer demo

Browse Source
This commit is contained in:
enoch kan 2025-01-25 22:21:51 +00:00
parent ee4c4ea32b
commit 53b055bc1e
1 changed files with 11 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

12
README.md
View File

@ -253,6 +253,16 @@ python fp8_cast_bf16.py --input-fp8-hf-path /path/to/fp8_weights --output-bf16-h
### 6.1 Inference with DeepSeek-Infer Demo (example only)
#### System Requirements
OS: Linux (Mac, Windows are currently not supported)
- Python 3.10
- PyTorch 2.4.1
- Transformers 4.46.3
- Safetensors 0.4.5
- Triton 3.0.0
#### Model Weights & Demo Code Preparation
First, clone our DeepSeek-V3 GitHub repository:
@ -261,7 +271,7 @@ First, clone our DeepSeek-V3 GitHub repository:
git clone https://github.com/deepseek-ai/DeepSeek-V3.git
```
Navigate to the `inference` folder and install dependencies listed in `requirements.txt`.
Navigate to the `inference` folder and install dependencies listed in `requirements.txt`. Easiest way is to use a package manager like `conda` or `uv` to create a new virtual environment and install the dependencies.
```shell
cd DeepSeek-V3/inference