2 ms·
Still trying to figure out what's wrong with the 8B tokenizer. Use https://huggingface.co/jartine/Meta-Llama-3-70B-Instruct-llamafile https://huggingface.co/jar
by jart 3y ago
Still trying to figure out what's wrong with the 8B tokenizer. Use https://huggingface.co/jartine/Meta-Llama-3-70B-Instruct-llamafile https://huggingface.co/jartine/Meta-Llama-3-70B-Instruct-lla... for now, since I managed to get 70B working well. If you want to use the buggy 8B llamafiles anyway, see https://huggingface.co/jartine/Meta-Llama-3-8B-Instruct-llamafile https://huggingface.co/jartine/Meta-Llama-3-8B-Instruct-llam...