For most use cases this article is right on target. I have been self hosting a 16K context size model and there is a lot you can do with 16K or larger context.

For most use cases this article is right on target. I have been self hosting a 16K context size model and there is a lot you can do with 16K or larger context. There are also great use cases for fine tuning. For example, if you are writing a chatbot for your company’s products, it might make sense to fine tune on product data and then RAG it with specific customer data when setting up a chat session.