diff --git a/README.md b/README.md index a305b33..10fc2c5 100644 --- a/README.md +++ b/README.md @@ -425,6 +425,11 @@ English/[简体中文](https://github.com/deepseek-ai/awesome-deepseek-integrati promptfoo Test and evaluate LLM prompts, including DeepSeek models. Compare different LLM providers, catch regressions, and evaluate responses. + + + deepseek-tokenizer + An efficient and lightweight tokenization library for DeepSeek models, relying solely on the `tokenizers` library without heavy dependencies like `transformers`. + Icon Langfuse diff --git a/README_cn.md b/README_cn.md index aefe93b..a280cc5 100644 --- a/README_cn.md +++ b/README_cn.md @@ -302,6 +302,10 @@ 测试和评估LLM提示,包括DeepSeek模型。比较不同的LLM提供商,捕获回归,并评估响应。 + + deepseek-tokenizer + 一个高效的轻量级tokenization库,仅依赖`tokenizers`库,不依赖`transformers`等重量级依赖。 + CR deepseek-review 🚀 使用 Deepseek 进行代码审核,支持 GitHub Action 和本地 🚀