Partially true...if you are looking for general purpose models. Instead of general purpose, I rather like more specialized models. I have some transcription co

Partially true...if you are looking for general purpose models. Instead of general purpose, I rather like more specialized models. I have some transcription correction needs, and I had a set of prompts that could get GPT4 to do it...but boy was it expensive, and I had to break the problem down into multiple steps to get accurate results, increasing costs further. My 13b Llama2 fine-tune Inkbot ( https://huggingface.co/Tostino/Inkbot-13B-8k-0.2 https://huggingface.co/Tostino/Inkbot-13B-8k-0.2 ) is able to do those same tasks with a single shot prompt. I have some examples of the specific tasks I trained that model on in the readme. But it isn't intended to be a general purpose model. It has a specific skill-set, and it's best to stick to those types of tasks. I'm also able to do batch inference at over 1k tokens/sec with this model on my desktop. That is something simply not possible with a 70b model on consumer hardware.