diff --git a/README.md b/README.md index d781998..2481d79 100644 --- a/README.md +++ b/README.md @@ -333,4 +333,9 @@ English/[简体中文](https://github.com/deepseek-ai/awesome-deepseek-integrati promptfoo Test and evaluate LLM prompts, including DeepSeek models. Compare different LLM providers, catch regressions, and evaluate responses. + + + deepseek-tokenizer + An efficient and lightweight tokenization library for DeepSeek models, relying solely on the `tokenizers` library without heavy dependencies like `transformers`. + \ No newline at end of file diff --git a/README_cn.md b/README_cn.md index 567a9e9..53043f7 100644 --- a/README_cn.md +++ b/README_cn.md @@ -252,4 +252,9 @@ promptfoo 测试和评估LLM提示,包括DeepSeek模型。比较不同的LLM提供商,捕获回归,并评估响应。 + + + deepseek-tokenizer + 一个高效的轻量级tokenization库,仅依赖`tokenizers`库,不依赖`transformers`等重量级依赖。 +