Gracana

5 ms·

1.
by Gracana 5d ago
I'll probably manage with Mac OS well enough, but my linux distro comes out of the box with all the latest OSS tooling I'm familiar with, plus a package manager, and it has linux cgroups and namespaces that power the container tec
2.
by Gracana 5d ago
> And why would you need that to run LLMs? kokonokko1337 already said it was good enough to run LLMs, presumably RunSet isn't saying the source code is needed to run an inference server.
3.
by Gracana 8d ago
I think people responded that way because you strongly implied he was an unserious vibecoder who was just fooling around, and you called him suspicious as fuck. Your post and the ones that followed are a good example of the contrarian dynam
4.
by Gracana 12d ago
I think you would be pleasantly surprised by the content of the linked article.
5.
by Gracana 15d ago
The thing they don't show is the one we really need, especially because model providers can skimp on quality (run lower quantization, lower kv cache precision, etc) to improve their pricing and performance. I agree that it's proba
6.
by Gracana 15d ago
Haha, yeah, I mostly remember that they exist and then go look up the actual quote.
7.
by Gracana 15d ago
Rule of Acquisition number 34: War is good for business. Rule of Acquisition number 35: Peace is good for business.
8.
by Gracana 18d ago
I can’t say I really disagree, and as a visitor of the site that’s the solution I would prefer.
9.
by Gracana 19d ago
It’s done out of necessity, you can read about why here: https://people.kernel.org/monsieuricon/creepy-crawlies As a user/reader/viewer I absolutely hate Anubis and usually turn around when I see it pop up (a
10.
by Gracana 1mo ago
llama.cpp (but maybe not for reasoning models?) and sillytavern, maybe others... I'm half a country away from my desktop right now so I can't verify much right now.
11.
by Gracana 1mo ago
I had a discussion about this with a friend recently. I was using an LLM with a serial console that it wrote to allow us to share a connection to a Z80 computer running CP/M. I was having trouble with the assembler, it wouldn’t assembl
12.
by Gracana 1mo ago
Some LLM interfaces allow you to modify and “continue” an agent response. It’s very useful for guidance, including jailbreaking. Need the model to go in a certain direction? Got a refusal that you want to bypass? Just start it off in the ap
13.
by Gracana 1mo ago
Oh, interesting. I want to say there’s a “preserve thinking” option in mainline llama.cpp, but I’m seeing mixed results in my searches and my in-flight internet is not good enough to dig into it properly. Good to hear you have a solution th
14.
by Gracana 1mo ago
I’ve noticed dsv4 do that as well, but inconsistently. I thought it was broken at first, but no, it’s just kind of shorthand that it does while thinking.
15.
by Gracana 1mo ago
What’s that about the template breaking the kv cache?
16.
by Gracana 1mo ago
Yeah, of all the parts to leave a out, sorting out a little enclosure is certainly the easiest and most likely to require customization.
17.
by Gracana 1mo ago
I'm surprised that it's pretty much the same as the adapters you can get on aliexpress. Not even a case to protect it from feet in the passenger footwell. Especially compared to the windshield-mount unit, which looks like a very s
18.
by Gracana 1mo ago
That’s a good one. And yes, of course I mean its history of usage in computing, not in general.
19.
by Gracana 1mo ago
I wondered how far back the usage of that term went. I was familiar with it in patch, so I did a little digging and found it in the v1.3 (1985!) source by Larry Wall: https://groups.google.com/g/mod.sources/c/
20.
by Gracana 2mo ago
What influence do you have over these companies where your trust or distrust matters? [edit] This is an awfully pessimistic take. Even if these companies will largely do whatever they like, some of us can at least make choices to use altern
21.
Life is Short, but Snakes are Long(snakesarelong.blogspot.com)
1 points by Gracana 2mo ago|0 comments
22.
by Gracana 2mo ago
Linking here since the pruning method you're talking about wasn't the top search result when I looked: https://github.com/CerebrasResearch/reap
23.
by Gracana 2mo ago
It also has an “ed” that will make you miss UNIX’s “ed”. I’ve used it to write programs and it is not fun!
24.
by Gracana 2mo ago
If the printer doesn't extrude sufficient volume for the speed it's moving at, the layer lines become thin and leave gaps. It's more apparent in this picture: https://qidi3d.com/cdn/shop/articles&#x2
25.
by Gracana 2mo ago
> From January 1, 2026, all ACM publications will be published Open Access (OA), free to read, share, and reuse in the ACM Digital Library.
26.
by Gracana 2mo ago
I was looking at buying a house with big transmission lines crossing over the property. It was a misty not-quite-raining day when I went to look at it, and you could hear the lines crackling and humming the whole time you were outside. I fi
27.
by Gracana 3mo ago
Flagged for malware advertisements when I opened the link.
28.
by Gracana 3mo ago
https://xcancel.com/SandyofCthulhu/status/206959220964578529...
29.
by Gracana 3mo ago
You don't have to have a server, workstation motherboards support lots of memory channels. I was lucky to buy a lot of RAM before prices skyrocketed. I knew I wanted to play with this stuff, so I spent what felt like a lot of money at
30.
by Gracana 3mo ago
I think that's a lot better. "Please explain your wrongness" really had me scratching my head. Hopefully they can make improvements to the 3D architecture or find someone who can help.

More ›