deepseekmirror/DeepSeek-MoE
1
0
Fork 0
mirror of https://github.com/deepseek-ai/DeepSeek-MoE.git synced 2025-05-17 15:59:09 -04:00
Code Issues Actions Packages Projects Releases Wiki Activity

Merge d8002428b9 into 66edeee5a4

Browse Source
This commit is contained in:
Javid Lakha 2025-02-28 16:44:18 -05:00 committed by GitHub
commit a07c78c4c5
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 1 deletions

2
README.md
View File

@ -129,7 +129,7 @@ You can directly employ [Huggingface's Transformers](https://github.com/huggingf
import torch
from transformers import AutoTokenizer, AutoModelForCausalLM, GenerationConfig
model_name = "deepseek-ai/deepseek-ai/deepseek-moe-16b-base"
model_name = "deepseek-ai/deepseek-moe-16b-base"
tokenizer = AutoTokenizer.from_pretrained(model_name)
model = AutoModelForCausalLM.from_pretrained(model_name, torch_dtype=torch.bfloat16, device_map="auto")
model.generation_config = GenerationConfig.from_pretrained(model_name)