3 ms·
Not sure what you mean. Time series chart of model performance over time to see if proprietary models get degraded? That's in the works, but we will need a coup
by gertlabs 6mo ago
Not sure what you mean. Time series chart of model performance over time to see if proprietary models get degraded? That's in the works, but we will need a couple months more data collection before launch.
- DeathArrow 6mo agoYes, probably performance helps. The idea is that the larger a coding task is and the longer the coding agent is, the higher the chance is for the agent to not follow the rules and guidelines.