fulafel

11 ms·

241.
by fulafel 8mo ago
> So I think it's untrue to say that Sweden doesn't rely on coal power. Without coal power it'd have regular blackouts. The european grid is interconnected so it's basically all fungible. But it's not the case th
242.
by fulafel 8mo ago
The quote from Forbes in the article is a claim that a subscription could use up to 5k worth of tokens. Which is different from actaully costing 5k in tokens per Claude Code user. As users won't max out their subscriptions. And there
243.
by fulafel 8mo ago
It does and that is exactly why the article's title is sensationalized. The title is refuting a strawman argument that wasn't actually made, and that the article itself doesn't claim was made.
244.
by fulafel 8mo ago
That's claiming that worst case, a subscriber _can_ use that much. It's possible that's wrong too, but in any case a lot of services are built on the assumption that the average user doesn't max out the plan. So the arti
245.
by fulafel 8mo ago
Requiring exploits is not how vulnerability research works, with or without AI. Vulnerability discovery and exploit development / weaponizing them are different things. Vendors have long since learned to take vuln reports, with our wit
246.
by fulafel 8mo ago
A terminology tangent because it's an econ publication: Notice that the article doesn't talk about productivity. Productivity is a term of art in economics and means you generate more units of output (for example per person, per i
247.
by fulafel 8mo ago
The GPL was historically of course a counter-reaction to copyrightability of code. Hence "copyleft" etc.
248.
by fulafel 8mo ago
Build and colocate the needed rewnewable (solar/wind/battery) capacity with the data centers and make them energy efficient by eg choosing cool locations.
249.
by fulafel 8mo ago
The field explored this direction before in vector computers with high bandwidth memory (Cray etc).
250.
by fulafel 8mo ago
Does it include externalities (co2 emissions)? Increasing natural gas generation is of course disastrous policy with a major death toll from the climate disaster, there needs to be a rampdown of fossils use and production.
251.
by fulafel 8mo ago
If your computer was faster at it, you could run more capable models at the same token rate.
252.
by fulafel 8mo ago
This is broadly correct for currently favoured software, but in computer science optimization problems you can usually trade off compute for memory and vice versa. For example just now from the front page: https://news.ycombinato
253.
by fulafel 8mo ago
So it's not measuring output tokens/s, just how long it takes to start generating tokens. Seems we'll have to wait for independent benchmarks to get useful numbers.
254.
Next-Token Predictor Is an AI's Job, Not Its Species(astralcodexten.com)
1 points by fulafel 8mo ago|0 comments
255.
by fulafel 8mo ago
The marketing subterfugue might be about this exactly, technically prompt processing means the prefill phase of inference. So prompt goes in 4x as fast but generates tokens slower. This seems even likely as the memory bandwidth hasn't
256.
by fulafel 8mo ago
Yes, and for writing (the example is read-write) it's of course yet another kettle of fish. The error might never get reported at all. Or you might get a SIGBUS (at least with sparse files).
257.
by fulafel 8mo ago
It's very different since at random points of your program your signal handler is caleld asynchronously, and you can only do a very limited signal-safe things there, and the flow of control in your i/o, logic etc code has no idea
258.
by fulafel 8mo ago
Interesting connection. Are the tenets "Individuals and interactions over processes and tools" and "Responding to change over following a plan" aligned with fascism?
259.
by fulafel 8mo ago
It provides a libxml2-compatible C API and that accepted pointers, this would seem to necessitate unsafe at least.
260.
by fulafel 8mo ago
This could make an interesting language shootout benchmark.
261.
by fulafel 8mo ago
It does circumvent a flimsy control: "The env command is part of a hard-coded read-only command list stored in the source code. This means that when Copilot requests to run it, the command is automatically approved for execution withou
262.
by fulafel 8mo ago
Well, if we reduce it enough I supposed they can be seen as the same concept through a certain kind of philosophical lense. True and false also belong in the same class, they're handles to a pool of two possible boolean values. The dif
263.
by fulafel 8mo ago
They're more like capabilities or handles than pointers. There's a reason in Rust land many systems use handles (indices to a table of objects) in absence of pointer arithmetic. In the C API of course there's symbolic names f
264.
by fulafel 8mo ago
You're right in terms of fitting your program to memory, so that it can run in the first place. But in performance work, the relative speed of RAM relative to computation has dropped such that it's a common wisdom to treat today&#
265.
by fulafel 8mo ago
Why would it make a significant difference? On/off modulation intuitively seems likely to have the same effect.
266.
by fulafel 8mo ago
You can do this with Docker too without Dockerfile or rebuilding. You can treat the container as mutable and just start/stop it, doing changes manually, and make snapshots with docker commit. You'll forfeit the benefits of reprodu
267.
by fulafel 8mo ago
Seems it only support macOS so for practical purpouses it's local-only.
268.
by fulafel 8mo ago
Has DDR5 caught up to DDR4 latency yet? I remember it was worse at least in the beginning. There's more bandwidth per channel but a hw design can always add more channels for the desired BW. Not so for latency.
269.
by fulafel 8mo ago
Alert fatigue has been long identified and complained about, this is just a new kind of that. But it's hitting a different set of people.
270.
by fulafel 8mo ago
Yes, in the headlines the agencies playing adversaries to the common folk are definitely mainly chinese... /s

More ›