samusiam

7 ms·

31.
by samusiam 8mo ago
But it's so easy to just download from libgen and send as an attachment to a Kindle email...
32.
by samusiam 8mo ago
Not only that, but the average reader will interpret the title to reflect AI agents' real-world performance. This is a benchmark... with 40 scenarios. I don't say this to diminish the value of the research paper or the efforts of
33.
by samusiam 8mo ago
I see claims like this so often, which amount to the idea that LLMs lack metacognition. (Thinking about their thinking / self-refkection). Of course the obvious solution is: ask them to do that -- they're shockingly good at it!
34.
by samusiam 8mo ago
Basically with Termius I "tunnel into" my host machine, and then I start a session with `claude` or `codex` or whatever and chat with one of those agents on my phone.
35.
by samusiam 8mo ago
Funny, because I gave ChatGPT (5.2 w/ Thinking) this exact prompt: > How would you handle objective scientific facts with a conclusion or intermediate results that may be considered offensive to some group somewhere in the world tha
36.
by samusiam 9mo ago
There are always people on reddit saying such-and-such model quality significantly dropped. Every single day there's a post like this in one of the Claude sub-reddits. It's virtually never substantiated with reliable evidence.
37.
by samusiam 9mo ago
Personally I do get the intellectual high after a long LLM coding session.
38.
by samusiam 9mo ago
I still use em-dashes. I started using them when my professor lambasted my use of semi-colons. I'm not looking back -- LLM haters be damned!
39.
by samusiam 9mo ago
Termius + tailscale + tmux is a common setup for mobile coding sessions.
40.
by samusiam 9mo ago
Writing is how I think through a problem too, but that also applies to writing and communicating with an AI coding agent. I don't need to write the code per se to do the thinking.
41.
by samusiam 9mo ago
How many do you think belong there? 1 or more than 1?
42.
by samusiam 9mo ago
Agree. Or internal or personal tooling where it doesn't beg to be perfect and you can (1) verify by observing behavior of the software -- if it works it works, and (2) deal with edge cases as they arise because it's not mission cr
43.
by samusiam 9mo ago
The code block isn't an executable script?
44.
by samusiam 9mo ago
Isn't this pointless unless you can verify? And wouldn't it be better for agents to post these tasks to existing crowdworker sites like MTurk or Prolific where these tasks are common and people can get paid? (I can't imagine
45.
by samusiam 9mo ago
> Anyone who things AGI is going to emerge from them in their current state, equally so. If you ask me, anyone who presumes to know where the current architecture of LLMs will hit a wall is a fool.
46.
by samusiam 9mo ago
I'd argue that it depends how that degradation manifests whether you want to include it or not. Consider two scenarios: (1) degradation leads to the model being routed behind the scenes to a different server, with subtly different perf
47.
by samusiam 9mo ago
If that's the case, then as a benchmark operator you'd want to run the benchmark through multiple different accounts on different machines to average over A/B test noise.
48.
by samusiam 9mo ago
Sounds like you might want to refactor the code if the individual files are too big and it can't find what it's looking for?
49.
by samusiam 9mo ago
I disagree that this was the issue, or that it's "rare that you'd want to do that unless you're near the context window". Clearing context after writing a plan, before starting implementation of said plan, is common
50.
by samusiam 9mo ago
I agree. If they're not testing against a simple baseline of standard best practice, then they're either ignorant about how to do even basic research, or trying to show off / win internet points. Occam's razor folks.
51.
by samusiam 9mo ago
I mean, not always. I've seen Claude step back and reconsider things after hitting a dead end, and go down a different path. There are also workflows, loops that can increase the likelihood of this occurring.
52.
by samusiam 9mo ago
Even right at this very moment where we have a high-tenacity AI, I'd argue that working with the AI -- that is to say, doing AI coding itself and dealing with the novel challenges that brings requires a lot of stubborn persistence.
53.
by samusiam 9mo ago
Couldn't agree more. It's also like managing a team of engineers rather than doing the coding yourself. You don't necessarily value the work less, nor do you necessarily have less technical prowess. You're just operating
54.
by samusiam 9mo ago
Gemini CLI isn't even close to the quality of Claude Code as a coding harness. Codex and even OpenCode are much better alternatives.
55.
by samusiam 9mo ago
I've had the same experience. Also papers will often have multiple entries in Google Scholar, with small differences between them (enough that Scholar didn't merge them into one entry).
56.
by samusiam 9mo ago
Also helps to use big models for planning, small for implementation.