tosh

22 ms·

661.
The Shape of Things to Come(yegge.ai)
87 points by tosh 3mo ago|79 comments
662.
Go json/v2(pkg.go.dev)
2 points by tosh 3mo ago|0 comments
663.
South Korea records its highest(theguardian.com)
2 points by tosh 3mo ago|0 comments
664.
smol(smolenv.com)
4 points by tosh 3mo ago|0 comments
665.
Welcome to Agents Week(blog.cloudflare.com)
9 points by tosh 3mo ago|4 comments
666.
Shelley Is a Coding Agent(github.com)
2 points by tosh 3mo ago|0 comments
667.
Devtools must be open source(blog.exe.dev)
11 points by tosh 3mo ago|1 comments
668.
by tosh 3mo ago
repo is published now: https://github.com/smol-env/smol
669.
Why I've become interested in aesthetics(twitter.com)
2 points by tosh 3mo ago|0 comments
670.
OpenAI Lost Its AI Crown–and the Fight to Win It Back(wsj.com)
1 points by tosh 3mo ago|0 comments
671.
AI labels to be compulsory on authentic-looking content under EU rules(theguardian.com)
7 points by tosh 3mo ago|1 comments
672.
Software Abundance(twitter.com)
2 points by tosh 3mo ago|0 comments
673.
by tosh 3mo ago
I do think prompting and reference files (e.g. for architecture, tech stack, …) can be extremely helpful. I also do this in my projects (challenge is keeping drift of these documents at bay). What I wanted to emphasize is that whatever is i
674.
by tosh 3mo ago
I agree, only looking at the token burn is not enough in this case it was 10 tasks and all harnesses could complete the tasks successfully, of course now the question is: will this hold for more and more complex tasks but I had to start som
675.
by tosh 3mo ago
coming in a few hours you can follow this org in the meantime https://github.com/smol-env or on twitter here: https://x.com/__tosh
676.
by tosh 3mo ago
smol currently is very simple so it definitely does less things, like no subagent orchestration I will look into how token usage looks like for longer sessions and more complex tasks re caching: the cache ratio for this bench looks 'ba
677.
by tosh 3mo ago
agree, that makes it a bit tricky to compare (esp if you also want to add different models and reasoning levels into the mix) I will add more tasks (esp longer ones) and think more about grading, the current tasks were easy to grade because
678.
by tosh 3mo ago
will do!
679.
by tosh 3mo ago
smol only has 1 tool: sh the system prompt of smol is shorter than the system prompt of Pi smol has no system prompt system prompt of Pi 0.83.0 """ You are an expert coding assistant operating inside pi, a coding agent harnes
680.
by tosh 3mo ago
in my book anything that is (I'm sure well intentioned) and injected to help the agent — but doesn't help it — is a waste of tokens but even injected context that when I read it sounds useful can oversteer the model and make it se
681.
by tosh 3mo ago
I will look into it more to see if I have configured it wrong but I think the token efficiency hurts cache use as caching only starts at 1024 tokens so for tasks where smol is under or close to 1024 tokens most of them are uncached
682.
by tosh 3mo ago
smol is also prefix caching the uncached tokens are also from runs where smol finished a task below 1024 tokens (the minimum amount of tokens needed to activate caching) which is less tokens than other harnesses are using for their system p
683.
Visa to Cut 7% of Workforce(bloomberg.com)
11 points by tosh 3mo ago|0 comments
684.
by tosh 3mo ago
I built an ad-hoc custom comparison framework to inspect system prompts, caching behaviour, tool call outputs, exact api requests and responses and so on I agree fewer tokens is not necessarily better but a bit counter-intuitively often the
685.
by tosh 3mo ago
ty re --disallowed-tools for coding agents 'shell' is often all you need (just make sure the environment has the necessary tools)
686.
by tosh 3mo ago
the system prompt still takes up useful space in the context window and steers the model into unnecessary actions and over-thinking patterns
687.
by tosh 3mo ago
smol is basically this 9 line python agent re-implemented in Go https://news.ycombinator.com/item?id=49006862 I'll have more about it in the next hours/days, you can follow me on twitter in the meantime ( https:&#
688.
by tosh 3mo ago
the tasks were all simple agentic tasks like creating a checksum of a file, merging csvs and so on, fixing a makefile pipeline with known 'good' outcomes all harnesses could reach the outcomes, only cost, time, number of tool uses
689.
by tosh 3mo ago
I can only recommend to regularly measure how many tokens a harness+model combination uses for a certain task There are huge token efficiency/bloat differences between agents while working on the same tasks, using the same model, in th
690.
Grok: Imagine Video 1.5(twitter.com)
2 points by tosh 3mo ago|0 comments

More ›