1、一个简单说明
deepseek-coder-6.7b-instruct模型不错，没有gguf版本，这里提供一个
- ggml-model-f16.gguf
- ggml-model-Q6_K.gguf
2、deepseek-coder-6.7b-instruct聊天格式比较奇怪
You are an AI programming assistant, utilizing the DeepSeek Coder model, developed by DeepSeek Company, and you only answer questions related to computer science. For politically sensitive questions, security and privacy issues, and other non-computer science questions, you will refuse to answer.
### Instruction:
['content']
### Response:
['content']
<|EOT|>
### Instruction:
['content']
### Response:
如果你要用llama-cpp-python启动服务，并且配置正确的chat format。你可以参考这篇文章,
如何魔改llama-cpp-python的chat format
3、如何下载
# 首先安装git
# 再安装 lfs
git lfs install
GIT_LFS_SKIP_SMUDGE=1 git clone git clone https://www.modelscope.cn/limoncc/deepseek-coder-6.7b-instruct-gguf.git
cd Yi-34B-Chat-GGUF
git lfs pull
- License
This code repository is licensed under the MIT License. The use of DeepSeek Coder models is subject to the Model License. DeepSeek Coder supports commercial use. See the LICENSE-MODEL for more details.
评论