Y
HN Search
Hacker News Search
new
|
comments
|
top
|
jobs
adamkinney
searching PlanetScale…
1.
▲
2.
▲
3.
▲
4.
▲
5.
▲
6.
▲
3 ms
·
1.
▲
by
adamkinney
4mo ago
Right! If memorizing the upstream fix counts against the model, you're measuring how stale your benchmark is, not what the model can do. The fix is only score on issues newer than the training cutoff, and rebuild the set every cycle. &