DiabloD3

3 ms·

1.
by DiabloD3 7d ago
Thats a weird way for Disney to announce the end of Disney+.
2.
by DiabloD3 8d ago
Surprised its not meaningfully slower. Vulkan and ROCm paths are missing a few optimized versions of the quants they're using.
3.
by DiabloD3 9d ago
I agree, this is misleading. If he wanted a Gemini replacement verbatim, its called locally inferring it's sibling, Gemma.
4.
by DiabloD3 12d ago
That's the other way of doing it, which solves the context rot problem in a more complex way. The model at the top says, "hey, sub-agent, go figure out the answer to this question and give me the answer", and that sub-agent c
5.
by DiabloD3 12d ago
A lot of this is managed by the inference engine, and has nothing to do with the model. Models that use, for example, sparse attention mechanisms are just trying to make the bad situation slightly less bad, such as using less RAM for contex
6.
by DiabloD3 12d ago
That usually ends up being a poor use of LLMs, and is an unsolved problem with LLMs. RAG was supposed to be the way out on that, and ended up being mostly abandoned.
7.
by DiabloD3 12d ago
The article doesn't really describe the problem: if your prompt is 35kb, your prompt is confusing, unfocused, and doesn't work right on any LLM, and is needlessly bloating your context. At this point in time, due to how most peopl
8.
by DiabloD3 16d ago
No, Guerrilla Games. The engine also already runs on virtually every platform, including the Xbox and PC, but also phones. Even though Guerilla Games is currently owned by Playstation Studios, they are still effectively an independent studi
9.
by DiabloD3 16d ago
Trent Reznor on good email providers: "I just want something I can never have" (maybe)
10.
by DiabloD3 19d ago
Those aren't equal, however. Aaron Swartz was murdered by a company that prints scientific journals that paywall papers paid for with US government grants; his "crime" was using the access granted to him by MIT, legally. At n
11.
by DiabloD3 19d ago
far right == 1930s and 40s right, from what I can tell.
12.
by DiabloD3 29d ago
Can't wait until Trump is out of office and we can just ban this stuff. Kind of insane harmless things like THC are Schedule I, but Nicotine isn't.
13.
by DiabloD3 29d ago
Can we just start flagging all AI written slop and have Dan moderate it? (Sorry Dan, but this needs to change)
14.
by DiabloD3 1mo ago
Heh, thats a weird way to announced the death of HuggingFace.
15.
by DiabloD3 1mo ago
Don't really know why this is interesting, CUDA is kind of a niche legacy API that Nvidia has kept on life support a little too long. Just use Vulkan for compute.
16.
by DiabloD3 1mo ago
They do run it when its off as well.
17.
by DiabloD3 1mo ago
Then turn off the warning: all modern OLED monitors that do not force you to run it can both change when the timer fires, but also just disable the notification altogether. This is what I have done on mine, and mine as well also runs it whe
18.
by DiabloD3 1mo ago
And thats why we have the warning that everyone bitches about: "Hey, the timer is up, but I'm not gonna make you do it, its just gonna wear the display out faster". Early OLEDs really did need to be pixel cleaned every 8 hour
19.
by DiabloD3 1mo ago
They can.... which everyone bitched about: they would do their cleaning cycle, no matter if you were busy or not.
20.
by DiabloD3 1mo ago
It does depending on the technique.
21.
by DiabloD3 1mo ago
Its the same way "embrace, extend, and extinguish" was coined. "Embrace and extend", without extinguish/exterminate, was used in Microsoft corp docs that were handed to the DOJ during the famous antitrust case, but
22.
by DiabloD3 1mo ago
I would not expect Ollama to be doing the right thing fwiw.
23.
by DiabloD3 1mo ago
What a weird way for Anthropic to announce they're going out of business.
24.
by DiabloD3 2mo ago
I think a lot of software engineers at Microsoft need to either be retrained or just let go entirely, and maybe so does a lot (or probably most) of the management. Why are you still using languages that make it trivial to write most kinds o
25.
by DiabloD3 2mo ago
H.261 is from 1988. JPEG is from 1992.
26.
by DiabloD3 2mo ago
They can't, unfortunately. Linux's drivers makes that happen, not ffmpeg; ffmpeg merely calls the API. Intel's own first party drivers simply follow the ACPI tables, Linux ignores them.
27.
by DiabloD3 2mo ago
See the end of https://news.ycombinator.com/item?id=49100144
28.
by DiabloD3 2mo ago
It very much is actionable. You might not know this, but the world of software development existed before NPM and Github, and it continues to exist after them. You are not beholden to either of them.
29.
by DiabloD3 2mo ago
Tell me where I can buy a car for $1k or $2k.
30.
by DiabloD3 2mo ago
Every single analysis I've seen done by anyone has basically come to the same conclusion: assuming sane BF16 or Q8 model quant, and BF16 or Q8 KV context quant (ie, not intentionally screwing over the model), you get about 250k before

More ›