jbellis

7 ms·

91.
by jbellis 10mo ago
Has the current administration made it harder to qualify for an o1 visa?
92.
by jbellis 11mo ago
swebench is (1) terrible and (2) saturated
93.
by jbellis 11mo ago
"Released" but not available on API. I think they rushed it out before Gemini 3 drops.
94.
by jbellis 11mo ago
if you're getting near-perfect recall with int8 and no reranking then you're either testing an unusual dataset or a tiny one, but if it works for you then great!
95.
by jbellis 11mo ago
two great points here: (1) quantization is how you speed up vector indexes, and (2) how your build your graph matters much much less* These are the insights behind DiskANN, which has replaced HNSW in most production systems. past that, well
96.
by jbellis 11mo ago
About twice the price of the Dell 8k.
97.
by jbellis 1y ago
This is extremely well trodden ground, and he's right. The world doesn't need him to spend time explaining that water is wet.
98.
by jbellis 1y ago
Deepseek pioneered automatic prefix caching and caches on SSD. SSD reads are so fast compared to LLM inference that I can't think of a reason to waste ram on it.
99.
by jbellis 1y ago
https://groq.com/blog/inside-the-lpu-deconstructing-groq-spe...
100.
by jbellis 1y ago
groq is quantizing, even though it's not labeled as such on openrouter (super frustrating)
101.
by jbellis 1y ago
this sounds like wishful thinking to me
102.
by jbellis 1y ago
It's the original. I'll update the label to clarify.
103.
by jbellis 1y ago
Added Qwen3 Next to the Brokk Power Ranking Open Round (coding benchmark). It's roughly GPT-OSS-20b strength. Full set of open weight model results: https://brokk.ai/power-ranking?version=openround&models=ds-r...
104.
by jbellis 1y ago
I've added results for GLM 4.5 and 4.5 Air.
105.
by jbellis 1y ago
no, I'm pretty skeptical that it's better than qwen3 coder but if you have evidence that it could be, I'm down to test it
106.
by jbellis 1y ago
swe-bench's bigger problems include (1) labs train on the test and (2) 50% of the tickets are from django; it's not a representative dataset even if all you care about is Python. I created a new benchmark from Java commits that ar
107.
by jbellis 1y ago
Quantization matters a lot more than r/locallama wants to believe. Here's Qwen3 Coder vs Qwen3 Coder @fp8: https://brokk.ai/power-ranking?version=openround-2025-08-20&...
108.
by jbellis 1y ago
Benchmarked here: https://blog.brokk.ai/grok-code-fast-1-added-to-the-power-ra...
109.
by jbellis 1y ago
About halfway between V3 and Qwen3 Coder. https://brokk.ai/power-ranking?version=openround-2025-08-20&...
110.
New Benchmark for Coding LLMs puts GPT-5 at the top(blog.brokk.ai)
1 points by jbellis 1y ago|0 comments
111.
by jbellis 1y ago
the accompanying blog post explains: xAI did not respond to our requests for a grok 4 quota that would allow us to run the evaluation
112.
by jbellis 1y ago
GPT-5 is the best model now for writing code by a significant margin. https://brokk.ai/power-rankings
113.
by jbellis 1y ago
if they left them both on defaults, flash is thinking-by-default and sonnet 4 is no-thinking-by-default
114.
by jbellis 1y ago
Just completed a new benchmark that sheds some light on whether Anthropic's premium is worth it. (Short answer: not unless your top priority is speed.) https://brokk.ai/power-rankings
115.
The Brokk Power Ranking LLM Coding Benchmark(brokk.ai)
10 points by jbellis 1y ago|0 comments
116.
A first look at GPT-OSS-120B's coding ability(blog.brokk.ai)
3 points by jbellis 1y ago|0 comments
117.
by jbellis 1y ago
I'm really shocked at how slow people are to realize this, because it's blindingly obvious. I guess that just shows how much the early adopter crowed is dominated by python and javascript. (BTW the answer is Go, not Rust, because
118.
by jbellis 1y ago
It's Find My. No great solution. I turn my iPad off now when not actively using it.
119.
by jbellis 1y ago
I used to use JED when I was stuck on DOS. I was surprised to find out that it's still being maintained on github and the author recently made a commit to improve vms (!) support. https://www.jedsoft.org/jed/
120.
by jbellis 1y ago
If you're looking for something more complete and actively maintained, check out https://github.com/GumTreeDiff/gumtree . (I evaluated semantic diff tools for use in Brokk but I ultimately went with standard textua

More ›