kennywinker

3 ms·

1.
by kennywinker 5d ago
File a complaint about chatgpt? I assume they’ve slurped up all of archive.org’s content
2.
by kennywinker 6d ago
I don’t think that will happen. It sounds good, and I would like it if things operated that way - but from the company perspective how do they, for example, have a tool call that gives the customer a discount, without it getting used when i
3.
by kennywinker 6d ago
So they aren’t intelligent. Like if a model can’t handle a task it hasn’t been trained on extensively, that’s not intelligence it’s memorization.
4.
by kennywinker 7d ago
Not a financial expert, but i think reduce implies it goes away, and absorb implies it’s still there but someone is taking it up. Like reducing the amount of water on the floor would be turning off the tap. Absorbing the amount of water on
5.
by kennywinker 7d ago
https://www.felonybench.com/
6.
by kennywinker 8d ago
Totally. Any MoE model can have experts swapped in and out from disk or system ram. I only framed it this way because the question was about the model fitting in vram.
7.
by kennywinker 8d ago
“Without context” was me gesturing at that. Interesting you can’t fit the whole model tho - why is beyond my current understanding :)
8.
by kennywinker 8d ago
Without context, it should be number of params * 1.76 (the “effective bits per weight”) / 8 So for this one, 27B * 1.76 / 8 = 5.94 GB For speed, far as I can tell it depends if your gpu is memory bandwidth bound or (mostly older g
9.
by kennywinker 8d ago
180b * 1.76 bits per weight = 39.6 gigabytes. Best you could realistically run in 32gb is like 28gb, or a 127B param model
10.
by kennywinker 8d ago
I run qwen 27b on an old-ass 16gb gpu. It’s very possible using unsloth 2bit and 3bit quants, tho there are a bunch of interesting quants that let you run closer to 4bit on 16gb. This article that’s currently also on the front page mentions
11.
by kennywinker 9d ago
Right below the headline it says: > Achieving world-class AI inference performance through Japan-developed 2nm 3D-stacked CPU and server integrated, developed, and manufactured in Japan Sounds pretty clear to me
12.
by kennywinker 9d ago
It’s only mass surveillance when cops search the mass surveillance database?
13.
by kennywinker 10d ago
Because the inequality between you and gates is there but you are above a threshold where you are comfortable. Your needs are met, you feel some sense of security in your position. If inequality is the wrong measure? Fine. Deep poverty, per
14.
by kennywinker 11d ago
Hopefully!
15.
by kennywinker 11d ago
No. I’d prefer to take that up with the state and federal governments. Some states have passed bans on these invasive cameras. All should.
16.
by kennywinker 11d ago
> What freedom is being impinged? Freedoms guaranteed by the 1st amendment: Freedom of the press - by harassing or criminalizing journalists who seek to expose gov or politicians who do wrong. Freedom of assembly - license plate readers
17.
by kennywinker 11d ago
Yes. Inequality creates antisocial asshole criminals at a far greater rate than more equal societies. But even if you disagree, you must still agree that antisocial asshole criminals will find ways to steal and get away with it, cameras or
18.
by kennywinker 11d ago
1. Cameras don’t prevent porch pirates. They give you a video after the fact of a masked person taking your package. Small theft is prevented by more equality in society, and a stronger safety net. (Source: the lower crime rate in other cou
19.
by kennywinker 11d ago
The government would never do that! /s https://www.aclu.org/news/national-security/dea-planned-moni... https://www.libertynation.com/flock-cameras-vs-gun-shops-the...
20.
by kennywinker 11d ago
It’s clear to me that these networked license plate cameras represent a fundamental impingement on freedom. Just one example: how is a journalist supposed to meet with a secret source if their locations at all times are logged? Even if thes
21.
by kennywinker 11d ago
We investigated ourselves and found no wrongdoing.
22.
by kennywinker 11d ago
I think the “fat chance” part is why these networked license plate cameras can not be allowed to continue to exist. If the solution to abuse is constant and careful oversight, that’s not a real solution. Any system will eventually be degrad
23.
by kennywinker 11d ago
This isn’t voting, i’m just trying to sell or buy some crap. For a while I listed stuff both places. In your voting analogy i guess i was voting third party? After a few dozen times where the only responses were from marketplace - i moved o
24.
by kennywinker 12d ago
You've moved the goalpost. The internet is happy to create alternatives. Network effects mean it's VERY hard to change the default social network once it's established. I hate using facebook marketplace, but over the past 6-i
25.
by kennywinker 12d ago
Would love to see Qwen3.8-27b here, since that is the model most people are running locally.
26.
by kennywinker 12d ago
> But like I said, the internet is largely unwilling to do this Sorry, what? The internet is unwilling to create twitter clones? Bluesky, mastodon, pleroma, misskey, diaspora, threads, fucking truth social… there is no shortage of twitte
27.
by kennywinker 12d ago
K2 horizon is also fully open source i believe - https://ifm.ai/k2/ I understand your quibble with terminology, but i think the “inscrutable binary blob” thing is a bit off base. You can create finetunes and post train
28.
by kennywinker 12d ago
You can create derivative works from open weight models
29.
by kennywinker 12d ago
I have somewhat of an understanding of how LLMs are created/operate, and from that I am drawing conclusions about if they can be moral or not. My conclusions match reality at the moment, but maybe that's a coincidence.
30.
by kennywinker 12d ago
I don't think that's true. About children, I mean. Either because we have some innate moral compass, or more likely because we pick up on cultural ideas beyond our immediate parenting - kids will often have strong moral compasses,

More ›