qeternity

5 ms·

31.
by qeternity 3mo ago
But these aren't the right services where the test should be, right? There's another service that says "ok we take the 100 bytes from A, and we take the $17 SKU from B, and this should equal $X". It's the third serv
32.
by qeternity 3mo ago
It's a defensive tactic to reduce the effectiveness of distillation. Say of that what you will, but it's not because they want to wrest control from users. It's because they don't want Chinese companies to do exactly wha
33.
by qeternity 3mo ago
Public in this context just means publicly listed on a stock exchange. It does not mean it is state-owned.
34.
by qeternity 3mo ago
Empirically this isn't true. However you feel about "true" capitalism vs socialism, countries underpinned by capitalism have prospered, even the socialist flavors (China, Scandinavia)...while the countries that have attempted
35.
by qeternity 3mo ago
> is supposed to be the central bank's job. What? No it's not, and never has been. Without even getting into the practical vs. theoretical of Fed dual mandate (funding deficits), even the most uncharitable take on modern CBs wo
36.
by qeternity 3mo ago
We are quite literally talking about launching 100k satellites into space. This is necessarily a question that requires thought and speculation about the future. You can't just flip a switch and do it overnight if it turns out there is
37.
by qeternity 3mo ago
It's sort of amazing that people still say these sorts of things today. I don't think it's at all inconceivable where people in the future are streaming high resolution multi modal personal sensor arrays to AI that is running
38.
by qeternity 4mo ago
There is a huge amount of vendor financing available for this exact reason. Hetzner presumably have been making use of this for years already. It's far more likely they simply began raising prices and realized the market would tolerate
39.
by qeternity 4mo ago
I think it very much is worth it! But the point was that quality didn't magically increase.
40.
by qeternity 4mo ago
It's not better quality: 59.3% vs 59.4% fp16 on AIME 25
41.
by qeternity 5mo ago
> Venture capitalists & private investors are sucking all of the possible growth and future upside from these companies and then dumping them on retail investors when there's nothing left. A lot of the money that is deployed by
42.
by qeternity 6mo ago
I haven't read TFA yet but a common technique is speculative decoding where a fast draft model will generate X tokens, which are then verified by the larger target model. The target model may accept some Y <= X tokens but the speedu
43.
by qeternity 6mo ago
> They paid a billion dollars for a vibe coded mess just for the opportunity to associate themselves with the hype. Lol no they didn't. It wasn't even an acquihire. They just hired Peter. Maybe they are paying him incredibly we
44.
by qeternity 6mo ago
> It's not any company, its Meta and the channels they administrate come with a set of responsibilities and principles Sorry, which laws stipulate these special responsibilities and principles?
45.
by qeternity 6mo ago
> or if the model might actually have emitted the formatting tokens that indicate a user message. These tokens are almost universally used as stop tokens which causes generation to stop and return control to the user. If you didn't
46.
by qeternity 6mo ago
This does not solve the problem at all, it's just another bandaid that hopefully reduces the likelihood.
47.
by qeternity 7mo ago
Yes, it is written for a specific audience. That is not a reason for snark. As other commenters have noted, it’s well written.
48.
by qeternity 8mo ago
Yes, lots of things can create indeterminism. But nothing is inherent.
49.
by qeternity 8mo ago
Yes, lots of things can create indeterminism. But nothing is inherent.
50.
by qeternity 8mo ago
> LLMs are inherently non-deterministic. This isn't true, and certainly not inherently so. Changes to input leading to changes in output does not violate determinism.
51.
by qeternity 8mo ago
> With prompt caching, verbose context that gets reused is basically free. But it's not. It might be discounted cost-wise, however it will still degrade attention and make generation slower/more computationally expensive even i
52.
by qeternity 8mo ago
> Tradition warrants a negotiation phase when one party wishes to change the terms of an agreement, or becomes cognizant that the counterparty may wish to do the same. They didn't change the agreement. One party violated it, and the
53.
by qeternity 8mo ago
Number of parameters is at least a proxy for model capability. You can achieve incredible tok/dollar or tok/sec with Qwen3 0.6b. It just won't be very good for most use cases.
54.
by qeternity 8mo ago
I would guess you haven't done this in practice. Yes, of course inference is memory bound at low batch sizes. This is why we run larger batch sizes! Also there does not exist any batch size > 1 where per-request throughput is equal
55.
by qeternity 8mo ago
Yes this article is full of misunderstanding. The main explanation of bottleneck is wrong: it’s the model weights which dominate memory bandwidth (and hence why batching multiple requests in a single pass increases total throughput). If cop
56.
by qeternity 8mo ago
Sure, and again, she should do something else then. She isn't entitled to have a large family and work whatever job she finds fulfilling.
57.
by qeternity 8mo ago
If you have any understanding of history, it's naive not to.
58.
by qeternity 8mo ago
Yes, this was empirically true at the time. Things change. And that does not invalidate my comment in the least.
59.
by qeternity 8mo ago
> I don’t think it would be possible without the tax exemption. Maybe it shouldn't be possible. Society is telling your friend that her work is not particularly valuable and that she should probably consider doing something else.
60.
by qeternity 8mo ago
Have there been any reported instances of Waymo cars being stolen? Disabled and then loaded into a lead-lined trailer or something. I imagine the IP running locally on the cars is worth billions.

More ›