Although the attention is really good at focusing on specific information, I've had problems with this approach. It seems like if I ask a task and provide a lar

Although the attention is really good at focusing on specific information, I've had problems with this approach. It seems like if I ask a task and provide a large enough API it gets distracted or ignores the chunk of text and does its own thing anyway. Also it's still more expensive to increase the context length