BearOso

5 ms·

31.
by BearOso 3mo ago
I posted on an older article that I thought it probably cost half a million in API pricing. 165k USD is a lot lower. I wonder what the actual compute cost was. When this first hit the news, Opus 4.7 was brand new and required 6x the compute
32.
by BearOso 3mo ago
That's probably in an overscan area on most TVs, so it might not even show up.
33.
by BearOso 4mo ago
Lenovo has an incentive to say prices will never go down. They need to continue selling right now when prices are high, but customers will wait if they have reason to think they'll go lower.
34.
by BearOso 4mo ago
Backticks ` ` are used to trigger code-style formatting in markdown. Since all the coding AIs are trained almost entirely on github, you see it everywhere in their output. They'll use it even in places where it's supposed to be ju
35.
by BearOso 4mo ago
Slack uses this? Thanks for the info. I've never been forced into Slack, so I wasn't aware of that. Either way, it's stupid to use in places it doesn't induce formatting.
36.
by BearOso 4mo ago
Yeah. It simply shouldn't be falling back to a software cursor in the first place. That's the bug.
37.
by BearOso 4mo ago
I'm seeing lots of bots/agents misusing backticks like this. It's because people are writing agent plans in markdown and the agent thinks it's appropriate everywhere. Maybe you shouldn't be running all your comment
38.
by BearOso 4mo ago
You do realize that an LLM is an enormous decision tree? The prompt is the state and output tokens added to that are the subsequent state that's fed back into the machine. Running the math without deliberately adding any randomness wou
39.
by BearOso 4mo ago
He's referring to accumulator styles, eg. the 6502.
40.
by BearOso 4mo ago
In our small town, the local compliance officer is colluding with a tree-cutting company that has a contract with the city. They lie and claim trees are "dead" and they're constantly cutting them down unnecessarily at the tax
41.
by BearOso 4mo ago
We're in this situation because of laziness. I doubt doubling down on it is the solution.
42.
by BearOso 4mo ago
Avoid the backtick quotes, too. Claude also mistakenly uses them outside of markdown.
43.
by BearOso 4mo ago
We had less intrusive ads. Google AdSense was originally text-only and small-sized ads. What happened? It became far too lucrative to switch to the annoying ads by taking advantage of their trusting user base. Ad companies have only one ser
44.
by BearOso 4mo ago
Alternatively, you could have downloaded an existing one. What you did is just a roundabout way of acquiring one of the many WASM Rust GB emulators in the training set. Except it probably now has several problems from reconstruction. You di
45.
by BearOso 4mo ago
There is a fallacy here in assuming there's 256 steps from 0 to 255. That's not true, there's 256 values that can be represented in 8 bits, and 255 steps (spaces between those values) from 0 (black) to (255) pure white. Thus,
46.
by BearOso 4mo ago
I've noticed as well. A lot of pull requests are just agents running constantly, hoping to have produced something of value. Entropy is at an all-time high, though.
47.
by BearOso 4mo ago
Going from Opus 4.5 to 4.7 secretly required 6x more compute to run. 4.8 is apparently 30% more on top. I haven't seen any optimizations lately aside from distillation. Nobody's optimizing, they're just scaling up.
48.
by BearOso 5mo ago
I agree. The pope seemed to take the opportunity to talk about the ethics in good faith, no pun intended. But Olah just used the association to aggrandize AI for marketing sake.
49.
by BearOso 5mo ago
That line comes across as a wink to investors. They aspire for AI to displace human labor, as does he. Reading between the lines, it just confirms business as usual, and consequences aren't even worth thinking through.
50.
by BearOso 5mo ago
What novel data hasn't already been used in training? What new algorithms are there? Can you post some links so we can read about them?
51.
by BearOso 5mo ago
Unless there's a new paradigm, scaling up is all they can do to improve performance. They've shrunk down all the way to 1-bit models and all the low-hanging fruit is gone. There's no way for them to get much smaller, so they
52.
by BearOso 5mo ago
Meta also took on an additional $100B in debt recently to push AI and fired 4000 employees. The economics just don't add up at Meta, so they're a bad example.
53.
by BearOso 5mo ago
> Weren’t Schmidt’s comments on AI the harsh “truth” from the perspective of someone who directly benefits from the wealth extraction capabilities of AI? There are no wealth extraction capabilities yet. It's a money pit. They'r
54.
by BearOso 5mo ago
We also have a very limited number of compilers and a small number of prevalent architectures today. As long as you know the behavior of the target compiler and architecture, the behavior is defined, it's just not specified.
55.
by BearOso 5mo ago
From the leaked internal prompts, Opus 4.7 vs 4.6 recomputes several times over before returning the result. For heavy use like this, it costs Anthropic far more than you're paying as a consumer. They rely on the light users to offset
56.
by BearOso 5mo ago
It costs several times what it would cost a small team of engineers, even assuming you gave the engineers more time to do it. I'm guessing (wildly) this was around 0.5M USD in compute time. You do get the result quicker, though.
57.
by BearOso 6mo ago
Not competing, I just develop it occasionally for fun. I'm the first to suggest bsnes or another of Near's projects as a first choice. Mesen2 is pretty good, too, but the Avalonia UI kind of irks me. Definitely run that through Re
58.
by BearOso 6mo ago
> This is from the original authors of ZSNES. I think they know what they're doing. ZSNES is popular because of legacy and nostalgia. It was very fast and came at just the right time, but the developers aren't quite coding gods
59.
by BearOso 6mo ago
I came up with something similar to your idea, a GPU compute PPU for future Snes9x. What they're doing is using legacy fixed-function API to draw quads, then blend a bump map on with the final image. It's weird. We have the tools
60.
by BearOso 6mo ago
If you paid attention to the power requirements and amount of hardware being put into data centers, you should have realized that it cost them an order of magnitude more than you were being charged. To rework your analogy: they hooked you,

More ›