2 ms·
I just tried the GGUF 7b model of Deepseek and it let me ask some questions about some pretty sensitive topics - Uighur Muslims, Tank man, etc. https://hugging
by vunderba 3y ago
I just tried the GGUF 7b model of Deepseek and it let me ask some questions about some pretty sensitive topics - Uighur Muslims, Tank man, etc.
https://huggingface.co/TheBloke/deepseek-llm-7B-chat-GGUF https://huggingface.co/TheBloke/deepseek-llm-7B-chat-GGUF
- idiliv 3y agoWhen I try out the topics you suggest at the huggingface endpoint you link, the answer is either my question translated into Chinese, or no answer when I prompt the model in Chinese: <User>: 历史上的“天安门广场的坦克人”有什么故事？ <Assistant>:
- vunderba 3y agoInteresting - I can't speak to the Huggingface endpoint. I downloaded the 4-bit GGUF model locally and ran it through Oobabooga with instruct-chat template - I expressed my questions in English.