3 ms·
This just isn't working for me, phi-2 starts summarizing the document I'm giving it. I tried a few news articles and blog posts. Does using a GGUF version make
by politelemon 3y ago
This just isn't working for me, phi-2 starts summarizing the document I'm giving it. I tried a few news articles and blog posts. Does using a GGUF version make a difference?
- CuriouslyC 3y agoDepending on the number of bits in the quantization, for sure. The most common failure mode should be minor restatements which you can choose to ignore or not.