3 ms·
8B llamafile when? :^)
by d-z-m 2y ago
8B llamafile when? :^)
- jart 2y agoStill trying to figure out what's wrong with the 8B tokenizer. Use https://huggingface.co/jartine/Meta-Llama-3-70B-Instruct-llamafile https://huggingface.co/jartine/Meta-Llama-3-70B-Instruct-lla... for now, since I managed to get 70B working well. If you want to use the buggy 8B llamafiles anyway, see https://huggingface.co/jartine/Meta-Llama-3-8B-Instruct-llamafile https://huggingface.co/jartine/Meta-Llama-3-8B-Instruct-llam...