naasking

4 ms·

1.
by naasking 7d ago
llama.cpp has significant AI contributions. The Linux kernel too is receiving AI patches. You are seriously out of touch.
2.
by naasking 8d ago
> LMs generate text output that appears to be useful, but regularly is not. No, they are empirically useful, and only getting more useful. This is not even a debate anymore.
3.
by naasking 8d ago
Is there a known source of internal flaws/porosity in an otherwise solid part? Presumably laser melting produces a puddle which shouldn't allow for internal pores, as long as it isn't printed too fast (or solidifies too fast,
4.
by naasking 8d ago
Sure, but I mean what's the technical reason a material isn't it 3D printing friendly? Are we talking grain structure here? Is it something that can be at least partly mitigated by some post-printing heat treatments, like temperin
5.
by naasking 8d ago
Individual incidents aren't representative of accuracy or well-tuned truth seeking processes, that can only be assessed over time.
6.
by naasking 8d ago
> LLMs are vectorial databases with losses that index statistically filled data Yes, and that statistically filled data is insanely useful . It remains true that it's a relatively poorly understood how this can be applied in variou
7.
by naasking 8d ago
What's the current theory for why this is?
8.
by naasking 8d ago
Model, Q4_K_M: https://huggingface.co/agentionai/Signal-3.8-27B-GGUF DFlash2, Q8_0, --spec-draft-n-max=7: https://huggingface.co/z-lab/Qwen3.8-27B-DFlash2-GGUF I run llama.cpp with -ctv=8, -ctk=q4
9.
by naasking 8d ago
I've found the opposite on my R9700 (n-max=7, no other speculative decoding like ngram-mod, which I found slows it down). I think it depends whether your workload and system are bandwidth limited or compute limited. I see draft accepta
10.
by naasking 14d ago
Move fast on the concentric (increases power), move slowish on the eccentric.
11.
by naasking 14d ago
Resistance training should be a form of stretching. If you're taking the loaded muscle through full ranges of motion, as you should be, then that also means ranges where the muscles are fully stretched. Unfortunately many people cut th
12.
by naasking 16d ago
> We have hope for these approaches but the reality of this stuff is way more nuanced than you think it is. Sure, everything has more nuance. The point is this stuff is available now; this isn't some future sci-fi, it's only go
13.
by naasking 16d ago
We're already doing those experiments. Tailor made mRNA vaccines targeted to one's own specific cancer mutations can be bought right now. The techniques are getting more sophisticated and more targeted every year. Our ability to p
14.
by naasking 16d ago
We're doing that science right now. We're using AI to do it. By the time AGI truly spreads, we'll have a lot of the knowledge you say will be needed. This is simply not as far fetched as you seem to think. Next few years, unl
15.
by naasking 18d ago
> The said user (Tristan Buckmaster) didn't solve the millennium problem. He didn't really accuse that OpenAI stole his research either. The beef came from the fact OpenAI asked him to remove another mathematician, who works fo
16.
by naasking 18d ago
Q4 isn't an extreme quant, and I average 75 toks/s on code, 45 tok/s on prose with MTP.
17.
by naasking 23d ago
Yes, both the output should be "milestones" of sorts, like lemmas and theorems in math. Important plateaus that serve as a launching pad to the next phase. Regurgitating every thought potentially degrades signal:noise ratio.
18.
by naasking 23d ago
It's not easy to test as there is no formal definition or formal criteria for AGI, only exclusionary criteria like "not X". That's why he phrased it that way, he's saying it's going to be clear with hindsight o
19.
by naasking 23d ago
They detected a single weird event , not necessarily a particle.
20.
by naasking 24d ago
BlueSky in no way represents a very large number of humans. Most laypeople I've spoken to are fairly neutral on AI at this point.
21.
by naasking 24d ago
There's actually already a fork that implements the preliminaries: https://github.com/ggml-org/llama.cpp/discussions/21961
22.
by naasking 24d ago
Instead of creating your own engine, would it really be that hard to add paged attention to llama.cpp?
23.
by naasking 24d ago
For one, by synthesizing the results of multiple papers and suggesting novel experiments. If one paper sets constraints X for some system, and another paper sets constraints Y where Y!=X for a system that's similar but slightly differe
24.
by naasking 25d ago
> amazon would publish every single boon without giving a cent to writers. it would be reqlly hard for writers to make a living. Not quite, Amazon would just become the publisher that buys new books/articles/whatever directly f
25.
by naasking 28d ago
If it's consistently bad with no signs of improving, banning makes sense. People made mistakes even before LLMs though, and you'd only ban them if they didn't improve and so were a giant waste of time. I don't see why th
26.
by naasking 29d ago
> I'm also concerned these things will mostly be used by Big Tech for their A.I. data-centers Why is that a concern?
27.
by naasking 1mo ago
> I strongly disagree with this take. AI does not have the theory of mind to manage complex social environments Does Musk have a complex theory of mind to manage his employees, or does he just have a brutally efficient organizational str
28.
by naasking 1mo ago
This guy claims 6% throughout hit for this approach: https://x.com/0xBakeer/status/2092694905978237224?s=20 Crazy how fast things move these days.
29.
by naasking 1mo ago
That probably includes the 51b ngrams too. It's possible that those could be streamed from NVMe on-demand. The Engram paper that developed this technique streamed from RAM to VRAM at only ~1% performance degradation, but these strix ha
30.
by naasking 1mo ago
You can read posts you link to directly, but no comments. That's what makes it less useful.

More ›