Y
HN Search
Hacker News Search
new
|
comments
|
top
|
jobs
edonadei
searching PlanetScale…
1.
▲
2.
▲
3.
▲
4.
▲
5.
▲
6.
▲
4 ms
·
1.
▲
by
edonadei
2mo ago
happy to see ant taking a real shot at this, I had the intuition it was an important problem space some months ago already with this open-source take https://github.com/edonadei/caliper
2.
▲
Anthropic released a CLI to evaluate skills and plugins
(code.claude.com)
3 points
by
edonadei
2mo ago
|
1 comments
3.
▲
Don't make a prompt cut you can't measure
(edonadei.com)
1 points
by
edonadei
5mo ago
|
0 comments
4.
▲
by
edonadei
5mo ago
Hey, glad that you appreciate it! Model version, yes you can either overwrite with the --model and --judge-model you can overwrite at runtime or in the yaml spec. For the seed: no I haven't added it, and I don't think the harnesse
5.
▲
by
edonadei
5mo ago
btw FYI, a really good article on evaluation, I vastly based my research and iteration from it https://www.anthropic.com/engineering/demystifying-evals-for...
6.
▲
Show HN: Caliper – pass@k reliability testing for Claude Code and Codex skills
(github.com)
3 points
by
edonadei
5mo ago
|
3 comments
7.
▲
I built a simple comparison tool for LLMs (like GPT-4, Claude, Gemini)
(thesota.fyi)
2 points
by
edonadei
2y ago
|
1 comments
8.
▲
by
edonadei
2y ago
Hey everyone I found myself constantly searching for updated information about different LLMs and their capabilities, so I built thesota.fyi - a simple dashboard that compares AI language models. What it does right now: Shows key metrics f