mirror of
https://github.com/deepseek-ai/DeepSeek-LLM.git
synced 2025-04-30 07:29:11 -04:00
Update README.md
This commit is contained in:
parent
1b79a65a10
commit
56f7d32c5c
@ -324,8 +324,6 @@ python convert-hf-to-gguf.py <MODEL_PATH> --outfile <GGUF_PATH> --model-name dee
|
|||||||
|
|
||||||
`UPDATE:`[exllamav2](https://github.com/turboderp/exllamav2) has been able to support Huggingface Tokenizer. Please pull the latest version and try out.
|
`UPDATE:`[exllamav2](https://github.com/turboderp/exllamav2) has been able to support Huggingface Tokenizer. Please pull the latest version and try out.
|
||||||
|
|
||||||
Remeber to set RoPE scaling to 4 for correct output, more discussion could be found in this [PR](https://github.com/turboderp/exllamav2/pull/189).
|
|
||||||
|
|
||||||
|
|
||||||
## 7. Limitation
|
## 7. Limitation
|
||||||
|
|
||||||
|
Loading…
Reference in New Issue
Block a user