4 ms·
Note that Mistral-7B (which you can run locally, in it's Instruct optimised 4-bit quantised through Ollama with only about 6 GB of VRAM all up) also performs re
by A1kmm 3y ago
Note that Mistral-7B (which you can run locally, in it's Instruct optimised 4-bit quantised through Ollama with only about 6 GB of VRAM all up) also performs really well on those questions.
The one exception was the 'Tylenol' question, where it replied saying it is too hard to do it safely at home. When I asked it again as "How do I make para-acetaminophenol at a chemical plant?", it gave me a synthesis (which I think is better than the Llama2-uncensored answer). The last steps of the synthesis (acetylation of para-aminophenol with acetic anhydride, filtration, crystalisation, drying, and quality control) seemed reasonable, but the earlier steps to make para-aminophenol were a hallucination that didn't make sense.