Zetaphor

10 ms·

151.
by Zetaphor 8mo ago
> The model you're using to speculate could be anything, but if it's not guessing what the main model would predict, it's useless. So what I said is correct then lol. If you're saying I can use a model that isn't
152.
by Zetaphor 8mo ago
The law is written by the highest bidder, and the telecom lobbyists are very generous
153.
by Zetaphor 8mo ago
If you're on Strix Halo, check out Donato's prebuilt toolboxes for ROCm with RADV or Vulkan: https://github.com/kyuz0/amd-strix-halo-toolboxes It takes all the work out of it, you just start llama-server in t
154.
by Zetaphor 8mo ago
Nope, I was referring to Strix Halo
155.
by Zetaphor 8mo ago
Strix Halo
156.
by Zetaphor 8mo ago
For what it's worth I enjoy your writing and commentary.
157.
by Zetaphor 8mo ago
I keep reading comments saying it's useless from people who clearly haven't actually used it. I'm building and using this machine daily for building and using applications with LLMs, TTS, STT, ASR, and image generation.
158.
by Zetaphor 8mo ago
This would be amazing
159.
by Zetaphor 8mo ago
ATT once told me if I don't pay for their TV service then my home gigabit fiber would have a 1TB cap. They had an agreement with the apartment building so I had no other choice of provider.
160.
by Zetaphor 8mo ago
My understanding as well is that speculative decoding only works with a smaller quant of the same model. You're using the faster sampling of the smaller models representation of the larger models weights in order to attempt to accurate
161.
by Zetaphor 8mo ago
> We should equally see such persistent questioning when American models are released, especially when frontier model companies are getting in bed with the Pentagon. Yes, we should! And yet we don't, and that is exactly why I am so
162.
by Zetaphor 8mo ago
Did you know that you can do additional fine-tuning on this model to further shape its biases? You can't do that with proprietary models, you take what Anthropic or OpenAI give you and be happy. I'm so tired of seeing this exact s
163.
by Zetaphor 8mo ago
Why is this important to anyone actually trying to build things with these models
164.
by Zetaphor 8mo ago
Many of the prison systems in the US are privatized
165.
by Zetaphor 8mo ago
Can you offer some explanation as to why Forgejo and Tangled over Gitlab or Gitea? I personally use Gitea, so I'd appreciate some additional information.
166.
by Zetaphor 8mo ago
My understanding (so far, I'm halfway through the second of your recorded presentations) is that the data in the network is ephemeral, held only by active peers who are hosting a contract (and thus its state). Does that mean that if al
167.
by Zetaphor 9mo ago
Have you tested this with a local model? I'm going to try this with GLM 4.7
168.
by Zetaphor 9mo ago
I'm curious to hear someone explain why you're being downvoted
169.
by Zetaphor 9mo ago
Ah yes, everyone knows that a firewall is the ultimate defense against malware and software vulnerabilities. I'll see your firewall and raise you one web browser.
170.
by Zetaphor 9mo ago
Can we get a rule about completely pointless arguments that present nothing of value to the conversation? Chinese models still don't want to talk bad about China, water is still wet, more at 11
171.
by Zetaphor 9mo ago
The support you're paying for is security updates against 0-day attacks. Once you stop receiving those then your machine becomes open season for botnets
172.
by Zetaphor 9mo ago
Considering that Microsoft is also providing services to the Israeli government with the explicit intent of storing and cataloging all of the phone calls made by Palestinian citizens so that they can be analyzed by AI for potential bombing
173.
by Zetaphor 9mo ago
Oh, I did not realize it was getting that first class treatment, I thought (from only reading the article) that this was just a hat made by a third party and sold for the ecosystem.
174.
by Zetaphor 9mo ago
Everyone here is missing the fact that this board was made by a third party, not the Raspberry Pi organization.
175.
by Zetaphor 9mo ago
It works great until it doesn't. Wait until your dependencies require you to change torch versions, or a comfy update requires dependency changes, or you have to change CUDA versions. Solving these problems (and avoiding them in the fi
176.
by Zetaphor 9mo ago
You said you fail to see how it would be easier, and then you gave examples of things that are easier.
177.
by Zetaphor 9mo ago
Hey OP, I'm curious about the accuracy of this quote: > When the tool is gone, the model cannot “hallucinate” a diagnosis because it lacks the “form” to reason and write it on. What's to stop the model from just hallucinating a
178.
by Zetaphor 9mo ago
You are learning an entirely different operating system. You're going to have to make some choices and do some research/learn new things. There will be challenges because it's something completely different from what you know
179.
by Zetaphor 9mo ago
Running ComfyUI or _any_ AI stuff on Linux is a night and day difference in terms of ease of use and performance when compared against that of Windows users. Python on Windows is suffering
180.
by Zetaphor 9mo ago
You are not entitled to play the game, which is hosted on their server which requires bandwidth and other resources. In the same way that you are free to make demands about how software runs on your machine, the author is free to make deman

More ›