jgilias

5 ms·

1.
by jgilias 2mo ago
This probably throws a spanner in the wheels there: > Every piece of reasoning the frontier model does for free has to be rebuilt here as deterministic state. EDIT: Not to shit on this though. I totally believe that some smart mixture of
2.
by jgilias 2mo ago
What harnesses do you use? Ours is basically Claude in a box. There’s some complexity because of that, but the advantage is that it’s very flexible and people who have a bunch of Claude-shaped skills can just basically give those to an agen
3.
by jgilias 2mo ago
At $DAYJOB we do something very similar shape-wise. I wonder - it sounds like you have a dedicated agent comms plane? In our case we found that the easiest and most straightforward was to just use our default company chat app directly for t
4.
by jgilias 2mo ago
Maybe it does. Need to run evals to see if it does or doesn’t. Point was - everything in the context window affects the output. Including “silly” things like “it is known AI can do this”. And that has nothing to do with superstition, as the
5.
by jgilias 2mo ago
Not OP. That’s not implied at all. The fancy autocomplete produces statistically likely continuations to the source text (the context window). For a problem that’s hard for humans one likely continuation is: “this is hard, can’t do”, even t
6.
by jgilias 2mo ago
If it’s 3 days it’s something like 15 minutes, if it’s 3 weeks, that takes a couple hours lol. Seems like there’s some sanity to the estimates after all when you think about it, it’s just the scale it gets wrong due to estimating human time
7.
by jgilias 2mo ago
A contrarian take - the models aren’t advancing anymore at a pace where each new model would represent a huge capability jump, all being incremental improvements, so the doomsday marketing strategy being invoked since GPT-2 isn’t as effecti
8.
by jgilias 2mo ago
I chuckle that this is in Windows XP days. You know, the pinnacle of Windows usability in retrospect.
9.
by jgilias 2mo ago
It does matter, yes. Because it won’t lead to the outcome you want until someone actually gets a painful fine.
10.
by jgilias 2mo ago
In medicine there’s this well known axiom that if an intervention regime would technically work, but is something that the patients tend to not follow through, then the intervention regime doesn’t work.
11.
by jgilias 2mo ago
I’m so tired of every model release being touted as AGI or similar. Since <checks notes> GPT-2.
12.
by jgilias 2mo ago
Cool. I’ve realized though that I don’t really need better models anymore. SOTA is good, I just want them faster/cheaper now.
13.
by jgilias 3mo ago
Volkswagen has a couple too. Like, actual laboratories with people in white coats working in them. You don’t call Volkswagen “a lab” because of that.
14.
by jgilias 3mo ago
Ok, so, what research department did Nvidia grow out of?
15.
by jgilias 3mo ago
_why_ have people started to call companies “labs”?!
16.
by jgilias 3mo ago
Would be cool to get this thing try and run the vending machine experiment.
17.
by jgilias 3mo ago
That’s not surprising. He’s, like, really dense.
18.
by jgilias 3mo ago
Hooked me with the first couple sentences, and I just had to keep going, as I just wanted to know what happens next. Thanks, a good read!
19.
by jgilias 3mo ago
You have it mixed up. This guy is “the new generation of product people”. The old generation had to be technical enough to be able to grok the systems that they ‘producted’ over. It’s exactly the ‘new generation’ that LLM themselves right i
20.
by jgilias 3mo ago
For the completion to work, the source text needs to be ‘good’. That’s a basic kernel of how the thing works. Even with a perfect oracle autocomplete if the source text is ‘bullshit’, the output is too. Or, slightly changing this. The sourc
21.
by jgilias 3mo ago
We have a product guy on the team who was in a deeply not technical role before AI who is trying to do the “hey Claude, read this Jira ticket, implement” thing. It doesn’t work for the vast majority of tickets he attempts because he doesn’t
22.
by jgilias 3mo ago
Being a European, I first upvoted, then moved on to read the article. I assume I’m not the only one. And my corner of Europe is relatively not that red-tape-ish. But many places are pretty horrible when it comes to that.
23.
by jgilias 3mo ago
My neighbour has a battery installation because where I live they subsidise both - the panels and the battery. In the event of a power outage he can keep running his house for ~3 days if being somewhat frugal with consumption. And the batte
24.
by jgilias 3mo ago
The more they fiddle with the autocomplete system, the more they move away from the autocomplete faithfully producing the completion I need. The more it makes sense to move to an open weights model not served by them.
25.
by jgilias 3mo ago
Definitely. I can easily cut my individual AI spend by 50% at least. But I won’t, until someone tells me to. For three reasons: 1. Thinking about how to optimize AI spend is one more thing to think about when I have too many things to think
26.
by jgilias 3mo ago
I wonder if there’s path dependence there. It _seems_ like just because you build up lots of “defence” tech that doesn’t necessarily mean you _have_ to use it? Or does it? I wonder what happened with those markets during the Cold War.
27.
by jgilias 3mo ago
What I’m doing is running a kind of a meta harness that uses different models (and underlying harnesses) to work on a problem, or review the solution. Idea is to get to an error rate better than each of the underlying models can provide. Sa
28.
by jgilias 3mo ago
Oh boy, thanks for sharing this, truly mind blowing. It was chatjimmy.ai
29.
by jgilias 3mo ago
But not the original authors of those answers.
30.
by jgilias 3mo ago
Very apt comparison! This is how I feel too. In the sense that when I’m coding as a hobby, especially something like advent of code, using an LLM would defeat the purpose for me. A bit how I don’t double check my moves with an engine when p

More ›