8k is very little if you want to add almost any additional data in context, or have a more complicated prompt. Otherwise your knowledge retrieval needs to be a

8k is very little if you want to add almost any additional data in context, or have a more complicated prompt. Otherwise your knowledge retrieval needs to be almost spot on for llm to provide a proper reply. Ditto with any multi shot prompts.