3 ms·
It would be interesting to try to control for system prompt although obviously there's some coupling to what the harness provides and the instructions the model
by nijave 1mo ago
It would be interesting to try to control for system prompt although obviously there's some coupling to what the harness provides and the instructions the model receives on using it
- Edward40 1mo agoWe'd rather not mess with system prompts, we just eval them as shipped to keep the results reproducible.