mediaman

4 ms·

31.
by mediaman 3mo ago
None of this matters, this is the judge approving a voluntary settlement reached between the parties last year. If you think it should be different then you have to make a cogent argument why the public should get to interfere with a settle
32.
by mediaman 3mo ago
He's saying they just plug your USB stick into some gizmo sold to the state, and it's going to find enough to escalate it. If the idea is that there's no point in encrypting anything on a USB stick, and you just hope they don
33.
by mediaman 3mo ago
Because they don't have a lot of parameters to store general Wikipedia knowledge. They're small. Use big models that have high parameter capacity to store general information. Or build a harness around the small model that searche
34.
by mediaman 3mo ago
Small open source models shouldn't be used for world knowledge, that's not their purpose.
35.
by mediaman 3mo ago
Gemma 4 was released in April. It's a good series of multimodal models.
36.
by mediaman 3mo ago
There was some recent reporting that a July release of the Pro model got pushed back for exactly that reason. Its performance was not good compared to the OpenAI/Anthropic big models. They are having a lot of problems with posttrain.
37.
by mediaman 3mo ago
You're correct, but that's a different market segment and not the market GLM 5.2 and its peers compete in. The labs are not interested in the small, fast, single purpose end of the market. Google increased their pricing on Flash s
38.
by mediaman 3mo ago
The (quite excellent) article discusses several of your points. If you haven't read it, I recommend it. - Commodity market profitability is determined by marginal cost of production. LLMs have marginal cost; traditional software do
39.
by mediaman 3mo ago
Convergence in coding makes them highly substitutable. But I could see harnesses configured for different purposes -- let's say, a harness for creating teaching plans -- being able to cater to its audience better than a coding harness.
40.
by mediaman 3mo ago
This happens all the time. The government can decide legislatively that certain commercial terms are simply unenforceable. Making distillation clauses unenforceable in tort law would be straightforward. They can decide what customers they w
41.
by mediaman 3mo ago
The problem with many of these kinds of works is that they are a product of a provincial SV mindset that is largely unaware of the broader world or anything at all outside of its cultural and economic ecosystem, so it winds up being a super
42.
by mediaman 3mo ago
Because quality of writing matters. Good communicators learn to use the written word. Bad ones rely on mental crutches. Good communicators get an audience, and bad ones won't. You think it's a lost cause, but it's not, becaus
43.
by mediaman 3mo ago
That's annoying, but it's not why scaled manufacturing is lowering unit costs of panel production. Look at bare panel prices, they've followed the same cost curve down. The same problem exists in the airline market. Airline t
44.
by mediaman 3mo ago
I have seen the SWIFT thing happen for $100k. I think AI could actually be better for this, because it's often easier to implement hard rules for the AI. With the SWIFT incident I saw, there was a rule that no payment can go to a vendo
45.
by mediaman 3mo ago
You can fix this simply by using normal controls. That's why we have purchase orders that can only be entered by buyers. Product is received and approved by buyer. Invoice goes to accounting, who can't approve it unless there&#x27
46.
by mediaman 3mo ago
Looks like it's planned. https://github.com/orgs/chattocorp/projects/1?pane=issue&ite...
47.
by mediaman 3mo ago
They did use RLHF at the time, at which point it is not a pure probabilistic representation of the training corpora. Bizarrely, RLHF never came up in the paper.
48.
by mediaman 3mo ago
Bender's paper had this to say about stochastic parrots: "Contrary to how it may seem when we observe its output, an LM is a system for haphazardly stitching together sequences of linguistic forms it has observed in its vast train
49.
by mediaman 4mo ago
Regulatory capture doesn't necessarily mean the regulated get to decide what the regulators do in precise steps. It can simply mean they support and exist within a regulatory regime that greatly benefits the regulated. In fact, you gen
50.
by mediaman 4mo ago
He has this wealth as a function of having sold the equity in the company he co-founded, so in fact virtually all his wealth has already gone through a tax event at the federal and state levels.
51.
by mediaman 4mo ago
On-prem versus cloud inference doesn't matter for concentration of power. Concentration of power exists when the model makers are the same as (or control) the inference providers. Making a model is capital intensive, so there aren&#x27
52.
by mediaman 4mo ago
The tools aren't owned by a cabal of state-adjacent parties. Specific implementations are. But open-source models have saved the day here.
53.
by mediaman 4mo ago
Yes, people conflated progressive disclosure as a method with skills as a particular implementation because skills became the first widely adopted use of progressive disclosure. But progressive disclosure is just a method that you can apply
54.
by mediaman 4mo ago
Why? That doesn't make any sense. The government would be far better off figuring out how to take commodity models and applying them to government functions where they can, with deterministic scaffolding and guardrails, to make governm
55.
by mediaman 4mo ago
It's right that they steer toward the center of their distribution. But I would offer a different view on whether that's a step up for half the population. Writing isn't a distribution on a single dimension that goes from &qu
56.
by mediaman 4mo ago
I can't stand it when LLMs tell you to tone it down. Their writing advice is almost universally awful. They want you to write the most cliched bland content possible. Sometimes I see technical people who feel they aren't good writ
57.
by mediaman 4mo ago
Anthropic is, I believe, fully pursuing the idea that you shouldn't use their model with anything but their own products. They don't care whether it generalizes. I agree it's very frustrating to use with custom tools/har
58.
by mediaman 4mo ago
Double check your math. All of their posts in this thread are correct. 1/30,000 * 100 = .003
59.
by mediaman 4mo ago
That is not what their policy states. It specifically says they will sabotage even non-distillation attempts, such as distributed training pipeline design. And given that they are so far very nonperformant in classification accuracy, expect
60.
by mediaman 4mo ago
The funny thing about this comment is that neural networks are universal function approximators. The most fundamental essence of what they do is exactly what you say they don't: estimate.

More ›