Y
HN Search
Hacker News Search
new
|
comments
|
top
|
jobs
AIReach
searching PlanetScale…
1.
▲
2.
▲
3.
▲
4.
▲
5.
▲
6.
▲
5 ms
·
1.
▲
BenchmarkAggregator: GPQA Diamond to Chatbot Arena – Top LLMs, Easily Extensible
(github.com)
1 points
by
AIReach
2y ago
|
1 comments
2.
▲
by
AIReach
2y ago
BenchmarkAggregator is an open-source framework for comprehensive LLM evaluation across cutting-edge benchmarks like GPQA Diamond, MMLU Pro, and Chatbot Arena. It offers unbiased comparisons of all major language models, testing both depth
3.
▲
ModelClash: Dynamic LLM Evaluation Through AI Duels
(github.com)
2 points
by
AIReach
2y ago
|
1 comments
4.
▲
by
AIReach
2y ago
I've developed ModelClash, an open-source framework for LLM evaluation that could offer some potential advantages over static benchmarks: * Automatic challenge generation, reducing manual effort * Should scale with advancing model capa
5.
▲
ModelClash: Dynamic LLM Evaluation Through AI Duels
(github.com)
1 points
by
AIReach
2y ago
|
1 comments
6.
▲
by
AIReach
2y ago
Hi! I've developed ModelClash, an open-source framework for LLM evaluation that could offer some potential advantages over static benchmarks: * Automatic challenge generation, reducing manual effort * Should scale with advancing model
7.
▲
by
AIReach
2y ago
The Long Multiplication Benchmark evaluates Large Language Models (LLMs) on their ability to handle and utilize long contexts to solve multiplication problems. Despite long multiplication requiring only 2500 tokens for two seven-digit numbe
8.
▲
The Long Multiplication Benchmark: A Serious Challenge for Modern LLMs
(github.com)
1 points
by
AIReach
2y ago
|
1 comments
9.
▲
The Long Division Benchmark
(github.com)
2 points
by
AIReach
2y ago
|
0 comments
10.
▲
Two Sides of the Same Coin
(medium.com)
2 points
by
AIReach
2y ago
|
0 comments
11.
▲
AI Five Years from Now
(medium.com)
3 points
by
AIReach
2y ago
|
0 comments
12.
▲
Show HN: VoiceMouse: Control Your Mouse with Voice Pitch and Volume
(github.com)
1 points
by
AIReach
2y ago
|
0 comments
13.
▲
I Might Stop Programming, Even Though I Love It
(medium.com)
4 points
by
AIReach
3y ago
|
4 comments
14.
▲
Show HN: A Definitive Benchmark for AGI
(medium.com)
1 points
by
AIReach
3y ago
|
0 comments
15.
▲
What Exactly Is AGI? Introducing a Unique and Rigorous Standard
(medium.com)
1 points
by
AIReach
3y ago
|
0 comments
16.
▲
PullRequestBenchmark Challenge: Can AI Replace Your Dev Team?
(github.com)
1 points
by
AIReach
3y ago
|
0 comments
17.
▲
When Will AI Sound Just Like Us? A Look Ahead
(medium.com)
2 points
by
AIReach
3y ago
|
0 comments
18.
▲
PRBenchmark – Expert PR Review Capabilities Equals Expert PR Creation Capability
(github.com)
1 points
by
AIReach
3y ago
|
0 comments
19.
▲
by
AIReach
3y ago
You've brought up good point. But let's consider this: Current LLMs are capable of generating code that rivals human output. However, two major challenges persist. First, there's no infallible method to evaluate the "qua
20.
▲
The PullRequestBenchmark: The Final Countdown to Full Developer Job Automation?
(github.com)
1 points
by
AIReach
3y ago
|
3 comments
21.
▲
by
AIReach
3y ago
PullRequestBenchmark introduces a new standard for Large Language Models (LLMs)—reviewing pull requests with human-like discernment. Approaching full developer job automation, this benchmark mimics professional code evaluations as LLMs appr
22.
▲
Towards Complete Automation of SW Development: The PRBenchmark Challenge
(github.com)
1 points
by
AIReach
3y ago
|
0 comments
23.
▲
by
AIReach
3y ago
Thanks and I agree. Especially because it's easily scalable to longer contexts. It's trivial to use the "framework to" run the tests but I cannot prioritize it right now so either someone will have to pick it up or I mig
24.
▲
by
AIReach
3y ago
I don't currently have any money to spare on the API but might create a result for GPT-4 through ChatGPT.
25.
▲
LongScope: Assessing fragmented knowledge use in extended contexts
(github.com)
1 points
by
AIReach
3y ago
|
4 comments