drob518

8 ms·

91.
by drob518 2mo ago
Of course. They’ll never put “stop the Chinese models” in the organization’s bylaws. But don’t be naive about why they are doing it.
92.
by drob518 2mo ago
In some aspect, yes, or they fear they will. For instance, Anthropic may fear that Chinese models will become “better” because they won’t put as many guardrails up, so they want everyone to agree to the guardrails such that if a model comes
93.
by drob518 2mo ago
I made no value judgment about it. I merely note that it’s a game. Meta is not being altruistic or doing anything for the “good” of humanity or whatever. To be clear, I like competition with companies releasing open weight models.
94.
by drob518 2mo ago
The HP silicon team that I worked with went on to develop Itanium silicon (they were not responsible for the architecture, just the implementation).
95.
by drob518 2mo ago
It’s a long term pattern. When you’re winning (Anthropic), you keep the tech closed and try to monetize it as much as possible. When you’re losing (Meta), you open it up or drag it into a standards committee to either devalue it or slow the
96.
by drob518 2mo ago
I’m waiting for the bubble to pop. I suspect we’re 12-18 months away. We’re at the point where manufacturers are going out of business because the tech market is contracting so much. That’s not sustainable.
97.
by drob518 2mo ago
I was about a week away from buying a very tricked out MacBook Pro with 128 GB RAM, but was on vacation and worried about it arriving while I was away, and then the price hikes went into effect. Grumble. Oh, well. Serves me right.
98.
by drob518 2mo ago
The machines that can run this are pricey, but not beyond a high end developer machine.
99.
by drob518 2mo ago
Agreed, the trend in this consumer-accessible range is encouraging.
100.
by drob518 2mo ago
That’s part of it. There’s also just a natural back-and-forth between what I call “time sharing” and “personal.” When the thing you want is expensive, you share it remotely, but as soon as costs fall, everyone wants it under their desk.
101.
by drob518 2mo ago
Any company working in a competitive industry is generally aware of what their competitors are doing. PR is an important aspect to market success, so it factors into release schedule. It may not be the dominant factor given engineering cons
102.
by drob518 2mo ago
If it’s open, do you care so much that it’s from Meta? At least it should be able to give you an honest answer about Tiananmen Square.
103.
by drob518 2mo ago
Yea, there were things like shift and add to do multiplication more efficiently, but they were all one-cycle instructions. It was very regular that way, all designed around a clean pipeline without a stalls or bypassing. But, consequently,
104.
by drob518 2mo ago
This tells me we’re getting close to “peak bubble.” We saw these same sort of stupid headlines just before the dot-com bubble popped, too. When companies are distorting regular business to do the new thing, they’ve gone past the point of re
105.
by drob518 2mo ago
I worked on the first PA-RISC workstations (“snakes”, 1989-1991). PA-RISC started as a fairly pure RISC design and was consequently very simple and predictable (short pipeline, 1 delay slot, no complex instructions). The philosophy of the d
106.
by drob518 2mo ago
Yep, exactly. Engineers always think these sorts of “ask the user what to do” mitigations will be effective, but they forget that users have no clue and the repetition causes users to tune them out. And I say that as an engineer.
107.
by drob518 2mo ago
Yes, agreed, but I think it’s going to be difficult to have a high quality model that “does it all” and have it be local. For a quality “does it all” model, you’re going to need a lot of parameters and that means you’re almost always going
108.
by drob518 2mo ago
So, Kimi K3 in silicon sometime soon?
109.
by drob518 2mo ago
Does anyone know if this is available via OpenRouter or just directly via Meta? I've looked on OpenRouter and it just shows the standard pricing with a single provider. Was hoping they would add another provider with lower pricing for
110.
by drob518 2mo ago
Images of Zuck driving a white van near elementary schools…
111.
by drob518 2mo ago
For Deepseek specifically, OpenRouter has a number of non-Chinese providers. Pricing varies.
112.
by drob518 2mo ago
I agree. I don’t mind you training on my data if you’re up front about it and you are willing to compensate me for it in some way. And if I don’t like the deal, I can always pay full price or use a different model.
113.
by drob518 2mo ago
This is a well-known issue with all “Do you want to let me maybe do bad stuff to your system, but 999 times out of 1000 it’s not a problem?” prompts. Users get reflexive about hitting “Yes” and stop reading the prompt. You want to delete al
114.
by drob518 2mo ago
IMO, purpose built or “adapted” models are The Next Big Thing. If I’m using a model to write Python code, for instance, I really want the 8B or 27B expert model for exactly that, which would also be runnable locally. I don’t care about the
115.
by drob518 2mo ago
I agree with this. Interestingly, I’ve been using Deepseek v4 Flash a lot these days but I definitely have to constrain it a lot with tests. Fortunately, I can have it write the tests. It’s extremely cost effective. Still trying to figure o
116.
by drob518 2mo ago
And Poolside’s latest models (Laguna S 2.1) are pretty good (not frontier, but competitive with the tier 2 models). Which means that Mistral could certainly compete in that space.
117.
by drob518 2mo ago
I think Deepseek is selling roughly at cost (perhaps a slight premium). They don’t guarantee that they don’t train on the submitted prompts, so I suspect they are mining the data. Mining for what? Well, who knows. Best case, mining to make
118.
by drob518 3mo ago
> If a process tells me that "if the light is blue and the sound is sharp then the lever must be lowered", it outputs reasoning By this definition, all computer programs using simple IF statements are reasoning.
119.
by drob518 3mo ago
Yes, a proper definition of reasoning must be provided. How are you defining reasoning, exactly? You imply that formal logic is reasoning. Is reasoning just formal logic or is formal logic just a subset of reasoning? If a subset, what’s the
120.
by drob518 3mo ago
I was hoping for a test of the old Pringles can antenna.

More ›