FuckButtons

5 ms·

91.
by FuckButtons 5mo ago
Clearly I’ve hit a nerve if you’re stooping to whataboutism. Perhaps you should reflect on why that is.
92.
by FuckButtons 5mo ago
I’m not claiming it hasn’t been, but if you would look around, it’s not just the USA this has impacted.
93.
by FuckButtons 5mo ago
tiananmen square was in 1989. Hong Kong was snuffed out like a light. Covid saw people caged and sealed in their houses. You do not need to look back at the cultural revolution to see the prc for what it is.
94.
by FuckButtons 5mo ago
I think their motives are pretty transparent, as are china’s, as ever, you have to pick the lesser of two evils.
95.
by FuckButtons 5mo ago
There is not ‘must’ here, they did not ‘have’ to undercut every other strategically and technologically important industry the rest of the world has, but they did as a point of national policy.
96.
by FuckButtons 5mo ago
I’ll be sure to pick up my copy of the peoples daily to read about those statistics in the morning.
97.
by FuckButtons 5mo ago
yes, they want to win the same way they won more or less every other economic competition in the last 30 years, scale out, drop prices and asphyxiate the competition.
98.
by FuckButtons 5mo ago
No. There is no moral equivalence with totalitarianism.
99.
by FuckButtons 5mo ago
As with everything Anthropic recently this is a supply constraint issue. They have not planned for scale adequately.
100.
by FuckButtons 5mo ago
But if you have a tiered cache, then waiting several seconds / minutes is still preferable to getting a cache miss. I suspect the larger problem is the amount of tinkering they are doing with the model makes that not viable.
101.
by FuckButtons 5mo ago
From a utility perspective using a tiered cache with some much higher latency storage option for up to n hours would be very useful for me to prevent that l1 cache miss.
102.
by FuckButtons 5mo ago
I mean, this is straight out of chinas playbook, it should not be surprising that China is making an inferior derivative product at an artificially lower price point: state subsidies to massively drive up internal scale and supply chains le
103.
by FuckButtons 6mo ago
It’s good enough that I’ve been having codex automate itself out of a job by delegating more and more to it. Very excited for the 122b version as the throughput is significantly better for that vs the dense 27b on my m4.
104.
by FuckButtons 6mo ago
Hopefully just kill off the javascript for everything mindset to be honest.
105.
by FuckButtons 6mo ago
I’m also a C++ programmer, I can’t even use half of the C++ stdlib for real time thread work, I certainly can’t use a GC.
106.
by FuckButtons 6mo ago
Exactly, the Venn diagram of programmers using c/c++ and programmers who can use a garbage collector for their workload is two circles.
107.
by FuckButtons 6mo ago
if I understand you correctly, this is essentially what vllm does with their paged cache, if I’ve misunderstood I apologize.
108.
by FuckButtons 6mo ago
Because he should know better? Because it’s obviously a shit show but he keeps on being very vocal about his shit show? Because it’s annoying to have to see yet another delusional vibe coded project being hyped up instead of this forum bein
109.
by FuckButtons 6mo ago
What is the point of a cli if you aren’t allowed to script it? Nonsense.
110.
by FuckButtons 6mo ago
It seems pretty transparent that they are heavily resource constrained, (training run for Claude 5.x, higher usage / growth than anticipated). I don’t disagree that their long play is monopolistic pricing, but what we’re observing seem
111.
by FuckButtons 6mo ago
No, when you’re the richest most powerful men in the world you don’t get compassion.
112.
by FuckButtons 6mo ago
It only feels like that if you’re just catching up. The logical consequences you are just realizing are the reason OpenAI was founded.
113.
by FuckButtons 6mo ago
The limitation is efficiency and efficacy. If you have to add an additional layer of inference to any request you’re negatively impacting your bottom line so the companies, which are compute bound, have a strong incentive to squeeze everyth
114.
by FuckButtons 6mo ago
If you’re getting prompt injected, you have skipped right passed thinking critically about what you’re doing and into the same level of intellectual dishonesty as cheating, ie, not learning the thing and then attempting to still attain a gr
115.
by FuckButtons 6mo ago
But debugging mutable state is much easier than debugging a distributed system. Even in C if some global gets mishandled I can just use: gdb, dtrace, strace or even just look at a core dump and know that whatever caused the problem will be
116.
by FuckButtons 6mo ago
It seems entirely logical that if an llm allows each ic to do the work of a 2-3 person team (debatable, but assume it’s true for the sake of argument) then you’ve effectively just added a layer to the org chart, meaning any tool that was ef
117.
by FuckButtons 6mo ago
3.5-plus was also only available via api. I don’t know what the long term business model for open weights is, I hope there is one, but it seems foolish to assume that companies will be willing to spend millions of dollars of compute on an a
118.
by FuckButtons 6mo ago
To a certain extent, I do wonder if just letting claude do everything and then using the bug reports and CVE’s they find as training data for an RL environment might be part of the plan. “Here’s what you did, here’s what fixed it, don’t fuc
119.
by FuckButtons 6mo ago
I’ve heard this take before, but if you’ve spent any time with llm’s I don’t understand how your take can be: “I should just let this thing that makes mistakes all the time and seems oblivious to the complexity it’s creating because it only
120.
by FuckButtons 6mo ago
because a regex on the client is free vs gpu compute is absolutely not.

More ›