I will add that it seems: 1. The context window size to output accuracy problem seems like a genuinely hard problem 2. The vast majority of resources are bein

I will add that it seems: 1. The context window size to output accuracy problem seems like a genuinely hard problem 2. The vast majority of resources are being poured into driving down costs, not increasing output accuracy (and definitely not on gigantic context windows) I will also add: * I'm astounded at how terrible LLMs are at writing assembly in my experience. This seems like something they should excel at. So I'm genuinely confused on that piece.