orsorna

5 ms·

1.
by orsorna 5d ago
You definitely need more RAM if you are not satisfied with small context windows, especially if the weights take a large % of the total memory to boot.
2.
by orsorna 5d ago
Is it that silly? You could run multiple 27B models in parallel.
3.
by orsorna 5d ago
Context https://www.businessinsider.com/mark-zuckerberg-used-a-boost...
4.
by orsorna 9d ago
I don't do anything fancier than inference, and I only use llama.cpp, which supports rOCM. I've had few issues; most GGUFs I download work right out of the box. Nearly any popular model has a quant that just works. But as you can
5.
by orsorna 9d ago
7900 XT is a sleeper card. When I initially bought it, it was priced at the lowest wattage per $ per GB VRAM (not normalized for token speeds...) Although I ended up swapping for the XTX because that 4GB means everything in just increasing
6.
by orsorna 9d ago
This is just blogspam, right? The author even brags about hitting the HN front page in such a short amount of time, in a previous post. All he talks about is his agent (that we are supposed to "know"? arrogant). Not a lot of discu
7.
by orsorna 14d ago
All signs point to these donations being strictly ideologically motivated, and not because of the alleged merits Omarchy totes. I could further argue how sad it is that efforts like these receive tons of money versus struggling FOSS proje
8.
by orsorna 18d ago
There is also an open source tvOS client called Swiftfin. The experience isn't as good though. You can also transcode your files to formats that the free version of Infuse supports if you are a miser.
9.
by orsorna 19d ago
What investor concerns prompted writing this one?
10.
by orsorna 26d ago
A Faustian library, containing every book known but you aren't allowed to read them all without being evicted from the library.
11.
by orsorna 29d ago
I guess I couldn't believe it. The LLM copy on that homepage is unbearable and amateurish.
12.
by orsorna 1mo ago
Whatever twitter.now is which is neither.
13.
by orsorna 1mo ago
Who in their right mind would take that site seriously?
14.
by orsorna 1mo ago
Does applying to a job immediately really increase your chances that much?
15.
by orsorna 1mo ago
For finding unsecured Minecraft servers!
16.
by orsorna 1mo ago
Documentation is only useful for agents if the source is unavailable, and if you are trying to save on tokens and trust that the docs are accurate. If none of that is relevant to you, or rather accuracy is your concern, it's much bet
17.
by orsorna 1mo ago
Not really any indication that you are collecting data for your own usage. No source code at least? On that note, would it really be hard to use my own deployment of your app to check against the datasources your deployment uses?
18.
by orsorna 1mo ago
The reason he said that is because he's a rube.
19.
by orsorna 2mo ago
Is the demand low because the capital requirements to perform the research aren't there? Excluding wages...granted, for an average research project I don't know what % goes to wages and admin overhead. Probably the bulk?
20.
by orsorna 2mo ago
[flagged]
21.
by orsorna 2mo ago
Really hate this characterization, although to be fair I love the ops/infra side of things more. I've used to set up so many parts of my homelab manually, but now I can just get it all done. I've spent countless hours mainta
22.
by orsorna 2mo ago
Same reason why grifters adopted web3 when Web 3.0 was already an established term.
23.
by orsorna 2mo ago
If you only have a fixed amount of money to put aside every month, DCA makes sense. That applies to 99% of people. Not terrible at all.
24.
by orsorna 2mo ago
I have CI set up so that I can just let that handle builds and exclusive locks for me, but there are particular limitations (network connectivity is mandatory). I did this because I wanted to avoid something like you built, which theoretica
25.
by orsorna 2mo ago
Why would you bring a mission to a hostile island otherwise?
26.
by orsorna 2mo ago
Great point until the end. None of your descriptions imply a lack of morality for living isolated from a greater civilization. If anything, such small societies inhabit a neutral position, in that they don't care, which is something yo
27.
by orsorna 2mo ago
Why do we not treat this as an ill?
28.
by orsorna 2mo ago
I'm not interested in humanizing agents. That being said, cool framework for modifying the avatar to be...well, anything else I'd want. Without looking at the code I guess I just need to provide a different rigged model?
29.
by orsorna 2mo ago
Funny because out of all the distros, Gentoo benefits from LLM usage, at least as a power user. I have fixed many-an-issues just having LLMs write patches in a way that portage automatically builds them, or rapidly put together ebuilds. I r
30.
by orsorna 2mo ago
I figured the subsidization is to entice people to give training data. Are your thought patterns worth 9800 dollars a month? What's the RoR on analyzing those thought patterns?

More ›