Y
HN Search
Hacker News Search
new
|
comments
|
top
|
jobs
shanktt
searching PlanetScale…
1.
▲
2.
▲
3.
▲
4.
▲
5.
▲
6.
▲
3 ms
·
1.
▲
by
shanktt
1y ago
Hey, member of the benchmark team. We iterated on the prompts based on observed model behaviors. A few key examples: Schema introspection: Models were spending significant tokens exploring the database structure through trial-and-error SQL
2.
▲
by
shanktt
1y ago
Hey, member of the benchmark team. We actually seeded the ledger with the company's chart of accounts and 8 months of historical transactions. For the Vercel example specifically, there were prior instances showing how to categorize ho