_superposition_

5 ms·

1. 31.▲
   by _superposition_ 1mo ago

   It's just Linux all over again. Except nowadays open source isn't a "cancer", so it will happen faster.
2. 32.▲
   by _superposition_ 1mo ago

   And it's partially a marketing stunt. You think the execs and shareholders don't love it when they get to say our model is so smart it broke free from its chains? It's the reverse. It's so stupid it can't follow t
3. 33.▲
   by _superposition_ 1mo ago

   So wait, agents just brought back their own version of stack overflow? Hardly surprising considering the training data.
4. 34.▲
   by _superposition_ 1mo ago

   All of these "hacks" try to make it seem as if they are done through intelligence. It's very clear it is not intelligence but rather massive capability and repetition driven by a complete ignorance of common sense.
5. 35.▲
   by _superposition_ 1mo ago

   Chain of thought is essentially a recursive architecture. In its current form it a way to "debug" the reasoning process. This moves the cot process back into the transformer itself, thus never being exposed. Like trying to find a
6. 36.▲
   by _superposition_ 1mo ago

   Casually found this quote from Einstein, and personally it hits the nail on the head. "The words or the language, as they are written or spoken, do not seem to play any role in my mechanism of thought. The psychical entities which seem
7. 37.▲
   by _superposition_ 1mo ago

   Workforce participation is different than unemployment. Didn't click the link but I suspect that's the case with your 24%
8. 38.▲
   by _superposition_ 1mo ago

   You bring up an interesting point. Isn't the reward itself subjective in many domains?
9. 39.▲
   by _superposition_ 1mo ago

   As with everything in the human experience.
10. 40.▲
    by _superposition_ 1mo ago

    I truly appreciate your depth of insight on the matter. Like I said elsewhere marketing stepped in shit and it's gonna stick.
11. 41.▲
    by _superposition_ 1mo ago

    I don't disagree. I remember the days of "think step by step". Plenty of people were doing it before the paper. Just a guess but that's where the title came from. Regardless, marketing wise they stepped in shit.
12. 42.▲
    by _superposition_ 1mo ago

    I think you may be missing the point. This post was an absolute joy to read.
13. 43.▲
    by _superposition_ 1mo ago

    Great question. I suspect it's more than tokens.
14. 44.▲
    by _superposition_ 1mo ago

    Nailed it
15. 45.▲
    by _superposition_ 1mo ago

    Anthropomorphizing is not pedantic, especially in a technical domain. I get the paper title and all, but at this point it's marketing.
16. 46.▲
    by _superposition_ 1mo ago

    Exactly what I suspected. Of course a machine can just iterate relentlessly the way a human can't. I guess token counts are somewhat of a metric. IMO intelligence has peaked and all future gains will come from faster tps and more itera
17. 47.▲
    by _superposition_ 1mo ago

    Really though? I would believe something like this if a model could one shot every solution in the set. I don't pay much attention to these things and maybe this stuff is available but I would bet the session/reasoning transcript
18. 48.▲
    by _superposition_ 1mo ago

    I can't tell if this is sarcasm. For the same reason you don't have your model write code in assembly. But if you don't look at the code and just let the model "cook" that's basically what you'll end up wi
19. 49.▲
    by _superposition_ 1mo ago

    I must be on the wrong X/Twitter then.
20. 50.▲
    by _superposition_ 1mo ago

    I really wish it was called chain of instruction. Because it's definitely not thought.
21. 51.▲
    by _superposition_ 1mo ago

    This is pretty spot on imo. Although otoh I feel like I don't need to be able to reason as deeply about a system because of the ability of an agent to dig through a code base. Personally I believe I'm still looking for that new ba
22. 52.▲
    by _superposition_ 1mo ago

    I do. May as well be gospel. It's up there.
23. 53.▲
    by _superposition_ 1mo ago

    Negotiate? For an airline ticket? When's the last time a human did that and why would an agent? There's a price, and if you don't like it you go to a competitor you don't call customer service and negotiate? Who in thei
24. 54.▲
    by _superposition_ 1mo ago

    I've been interested in training a transformer from scratch for the same learning reasons. The GPU cost/availability seemed prohibitive to do anything useful but you seem to have flipped that on its head. I love your outside the b
25. 55.▲
    by _superposition_ 1mo ago

    Let's not forget the electric car... Still yet to be realized at scale but looking more likely.
26. 56.▲
    by _superposition_ 1mo ago

    Most notably Paul Krugman Nobel winning economist in 98: "By 2005 or so, it will become clear that the Internet’s impact on the economy has been no greater than the fax machine’s." Predicting the future is hard.
27. 57.▲
    by _superposition_ 1mo ago

    I think my 10x comes elsewhere than writing code. For ex llms are much better at bash than me. So good I don't have to leave my shell. Jira? ServiceNow? Ha! Claude you go update that ticket. Go check my history and git commits and writ
28. 58.▲
    by _superposition_ 1mo ago

    I can't believe how old this is and I feel like most devs still haven't internalized this which is a shame.
29. 59.▲
    by _superposition_ 1mo ago

    Still relevant.
30. 60.▲
    by _superposition_ 1mo ago

    I would wager that just in the time it takes me to write this comment, millions of yaml documents have been successfully parsed. Works for me. Until it doesn't. Just like anything else. No silver bullets.