samuelknight

5 ms·

31.
by samuelknight 3mo ago
Programs are tightly shaped to their dependencies and software frequently breaks when bumping a dependency versions. That's why we have package managers that are carefully built around lock files. Models should be thought of like a dep
32.
by samuelknight 3mo ago
It's not a smell. Why should these developers rebuild a core piece of their stack every few months. Switching out a model requires a new round of testing and validation when we should be able to rely on a piece of software the behave t
33.
by samuelknight 3mo ago
There is an issue on the page that causes the benchmark tables to get cut off. If you highlight and drag right you can see a few more models like Gemini and Claude Opus. It's also interesting that they introduced explicit caching, whic
34.
by samuelknight 3mo ago
This is the bind of an arms race. Any lab that tries to pump the breaks quickly becomes second rate. Regulatory capture doesn't work either because the technology crosses jurisdictions.
35.
by samuelknight 3mo ago
You can create an index on an expires_at column and opportunistically DELETE on each write to the cache table.
36.
by samuelknight 3mo ago
Inference has been decreasing in cost by about 10x per year since 2023.
37.
by samuelknight 3mo ago
My startup develops self-serve pentesting tool. https://vulnetic.ai/
38.
by samuelknight 3mo ago
> replacing BANG with the title of _a_ video on this channel. The agent has knowledge of private videos, so the proof of concept causes it to construct a URL that sends one video identity to the attacker which may be a private video. The
39.
by samuelknight 3mo ago
The first day Fable was released I tried to get it to summarize it's own announcement on the Anthropic blog and it dropped to Opus. On top of being very expensive you pay for the refusal inference and the fallback and fresh cache write
40.
by samuelknight 4mo ago
The Reddit poster called it spyware which is not right. They are using stenography to fingerprint accounts using Claude Code instances routing through Chinese resellers.
41.
by samuelknight 4mo ago
It will be much harder for Chinese models to close the gap than it is to keep the historical 6-9 months behind. Their models' performance are heavily propped up on distillation runs. The capital going to their frontier labs is 10x-100x
42.
by samuelknight 4mo ago
Buying all the RAM can't work forever. Scarcity increases prices, high prices increase supply, improves RAM R&D budgets, and forces users to find ways to economize around low RAM availability.
43.
by samuelknight 4mo ago
I didn't connect the reseller pricing to DS and GLM prices until you explained it. Very good observation. Deepseek v4 pro in particular is priced so low that it's hard to imagine that they have any margin. 0.76/1.52 for a 1.6
44.
by samuelknight 4mo ago
If it has steps to reproduce, you give it to your coding agent to "fix [bug] using TDD". If it can't make a test it wasn't reproducible.
45.
by samuelknight 4mo ago
A reviewer can only test the model they have access too. They should not speculate about what the model could have done without provider tampering. I think Anthropic's mistake here was not calling it Fable 5 Preview, because now people
46.
by samuelknight 4mo ago
We can speculate it has more parameters because it's 2x the price. If I had to guess I would say that they made a very sparse MoE. There are some other things happening here. More parameters is the simplest possible explanation for a s
47.
by samuelknight 4mo ago
Yes, I should have said autoregressive.
48.
by samuelknight 4mo ago
And by Fable they really mean Opus 4.8, because every mundane workflow or chat I try to use it in will eventually drop to Opus.
49.
by samuelknight 4mo ago
Some of these comments miss the advantage of diffusion. This is will have a big impact on edge devices, such as your phone or the GPU in your computer. An LLM's decoder computes tokens one-at-a-time because attention has to account for
50.
by samuelknight 4mo ago
I learned a long time ago to avoid writing long emails because people don't read them. LLMs are quite the opposite, and will have 'attention' for every word you prompt it with.
51.
by samuelknight 5mo ago
Except this model has a broader domain than text-LLM models. More than the old omni models too since it takes video input. The architecture is exotic but I don't see tuning here that is more extreme than open models released every day.
52.
by samuelknight 5mo ago
It feels noticeably sharper than Opus 4.7
53.
by samuelknight 5mo ago
The smarter the models, the less you have to structure the workflow. If you have a workflow that works well with a model today, you are in a good position because in a few months time you can switch to a much cheaper model. One strategy I n
54.
by samuelknight 5mo ago
AI meeting notes are not transcripts. While they do cause an unprecedented amount of record creation (as the article notes), there are also challenges that a defense can use. Note takers get small details wrong all the time, they often are
55.
by samuelknight 5mo ago
Frontier price will keep going up as AI gets smarter and can be applied for more economically useful tasks. That isn't the same as "AI pricing is going up" because intelligence per dollar has consistently cratered and will co
56.
by samuelknight 5mo ago
I couldn't merge earlier but navigation around my project worked. Maybe if I generate even more PRs some will get through!
57.
by samuelknight 6mo ago
They have always released slowly, and they are usually tagged "preview".
58.
by samuelknight 6mo ago
It's not that simple. API is still up and there are multiple API providers. https://openrouter.ai/anthropic/claude-opus-4.7
59.
by samuelknight 6mo ago
There is no realistic risk of a SHA collision attack. Getting supply chain attacked via NPM dependencies is much more likely. Hopefully the actions creators are also pinning their hashes.
60.
by samuelknight 6mo ago
We are in a transition phase where you need systems and coding skill but you can't be sufficiently productive without AI.

More ›