From 2755d4d81fa3cd24dec57dc2dec085d669a52c94 Mon Sep 17 00:00:00 2001 From: StevenLiuWen Date: Fri, 8 Mar 2024 15:41:16 +0800 Subject: [PATCH] Update README.md --- README.md | 8 ++------ 1 file changed, 2 insertions(+), 6 deletions(-) diff --git a/README.md b/README.md index 2140680..9350451 100644 --- a/README.md +++ b/README.md @@ -147,11 +147,7 @@ On the basis of `Python >= 3.8` environment, install the necessary dependencies pip install -r requirements.txt -e . ``` -### Inference with Huggingface's Transformers - -You can directly employ [Huggingface's Transformers](https://github.com/huggingface/transformers) for model inference. - -**Simple Inference Example** +### Simple Inference Example ```python import torch @@ -208,7 +204,7 @@ answer = tokenizer.decode(outputs[0].cpu().tolist(), skip_special_tokens=True) print(f"{prepare_inputs['sft_format'][0]}", answer) ``` -**CLI Chat** +### CLI Chat ```bash python cli_chat.py --model_path deepseek-ai/deepseek-vl-7b-chat ```