> I don't mean to be negative but - has anyone at all found a use for any of the 7B models? Productive/generative and logic-based tasks improve with the size o

> I don't mean to be negative but - has anyone at all found a use for any of the 7B models? Productive/generative and logic-based tasks improve with the size of the corpus, but smaller models are useful for reductive tasks where florid prose and accuracy are not a requirement-- i.e. summarize this or classify that. I use dolly-3B for quick-and-dirty work like this since I can run it on spare hardware. Commercially, you could probably get away with hot-swapping large models for small ones during periods of high demand-- for a chat service, kick every 3-4th exchange to a smaller, cheaper model to reduce load on the larger one. Nobody is perfectly coherent all the time...