thot_experiment

5 ms·

61.
by thot_experiment 4mo ago
Because it's like 5x cheaper and beats it out spec wise in almost every way?
62.
by thot_experiment 4mo ago
Totally understandable. YMMV but I found the llama.cpp build process to work on the first try on my machine, and it only takes a couple minutes, which definitely isn't my usual expectation or experience. I was very pleasantly surprised
63.
by thot_experiment 4mo ago
I think comparing companies to Apple is kinda silly as they're unique. They're in a position of such market dominance that they can afford institutional arrogance. However, it's very illustrative in this situation because I t
64.
by thot_experiment 4mo ago
This is so sick except it only has 2 pulse counters instead of the 4 on the S3 which means I can't use it as a drop in replacement on my current project. Not really complaining, I cut my teeth as an embedded dev on the ESP8266 and for
65.
by thot_experiment 4mo ago
I just build llama.cpp from scratch on the PR that has MTP drafters. https://github.com/ggml-org/llama.cpp/pull/23398 Please don't use Ollama, it's a bad actor in the OSS community.
66.
by thot_experiment 4mo ago
They certainly wouldn't survive if capitalism was working as intended. GoPro is one of the most institutionally arrogant companies around, they seem unable to understand that they have competition. (Which to be fair they absolutely did
67.
by thot_experiment 4mo ago
You can get SXM V100s for like $100 off ebay, if you're willing to do the troubleshooting work to get em running with adapters you can build a computer capable of fitting a Q4 quant of a 120b model in VRAM for something like fifteen hu
68.
by thot_experiment 4mo ago
Ollama is a shitty project that steals from the open source community, don't use it, use llama.cpp instead.
69.
by thot_experiment 4mo ago
Hard disagree, Qwen multimodal is way better than google's, but Gemma 31b runs laps around Qwen 27B in complex engineering tasks. Maybe Qwen is better at slopcoding web framework CRUD, but for embedded dev there's no comparison.
70.
by thot_experiment 4mo ago
I don't know about this model, but the next one up, the 31B I've been using as an agentic coding assistant in OpenCode, and basically anything that's easy enough that I'd trust Sonnet to handle, I trust Gemma 4 to handle
71.
by thot_experiment 4mo ago
I've always found the Gemma models to vastly under-perform on vision tasks compared to Qwen so that's nothing new.
72.
by thot_experiment 4mo ago
I haven't tried this model yet, but I can run Gemma 31B w/ the MTP drafter in pure CPU at about 10tok/s so this should run at about 20-30tok/s on a decent CPU, it'll probably run at >50tok/s on any Mac that
73.
by thot_experiment 4mo ago
I think resiliency to the corruption isn't evenly distributed among the populace, there are definitely those people who are capable of resisting it long enough to get shit done. I just think it's mostly the levels of abstraction t
74.
by thot_experiment 4mo ago
It's so frustrating because even the notionally good actors look at this and think "yeah but it's not gonna corrupt me " No you fuck, the only way to walk the good path is to give up power and never let it concentrate a
75.
by thot_experiment 4mo ago
Love seeing AMD forcing Novideo to catch up for once rather than the other way around.
76.
by thot_experiment 4mo ago
lmao, you're completely out to lunch, my friend is a teacher in one of the most well funded districts in the entire country and it's a decent job but it's an incredible amount of work and he's not making an amazing wage
77.
by thot_experiment 4mo ago
q6 is fine for that qwen with ctx @ q8, and the dense models of that size are solid at q4 with q8 ctx
78.
by thot_experiment 4mo ago
Naw totally agree, we need way more robust protections for security researchers and way harsher penalties for corpos doing bullshit, it should be a percentage of revenue. We have way too much fuck around these days and not nearly enough fin
79.
by thot_experiment 4mo ago
Tried this extensively in OpenCode, never used it once since Gemma 4 came out, got into thought loops and did stupid edits I didn't ask for more often than the local 31b model. One of the worst "frontier" models I've eve
80.
by thot_experiment 4mo ago
I agree with the sentiment, but while New Glenn is likely a more economical rocket, it doesn't even have the same payload capacity that Falcon Heavy had eight years ago. They are nowhere near a meaningful competitor yet, and if Starshi
81.
by thot_experiment 4mo ago
Crazy that such a load bearing job isn't better funded and more respected. Arguably the most important job in society and the level of respect, pay and to some extent training (at least a lot of places require a masters for what that&#
82.
by thot_experiment 5mo ago
Who else has that Tux plushie tho? I've had one since I was like 11 years old.
83.
by thot_experiment 5mo ago
Sure, I definitely agree that the highest impact work would be to shine the light on the corruption among the leadership and hold them to account, in all cases. However in the institution of American police the corruption is endemic.
84.
by thot_experiment 5mo ago
Just sharing what I know to be an extreme minority opinion but for my money, cutting up SF traffic on a bike is the greatest feeling in the world. On some level I have a deep respect for the cars because they provide me with a matched partn
85.
by thot_experiment 5mo ago
I spend 10-20 hours/wk on the bike and I personally hate almost all bike infrastructure. I understand why it exists, and I'm pro it being built but personally miss me with that shit. I hate the separated bike lane more than anythi
86.
by thot_experiment 5mo ago
I don't know if anarchy helps in this situation, I actually think you need robust social systems with buy in from citizens to prevent the natural accumulation of power. The fundamental problem is that there's a diminishing cost to
87.
by thot_experiment 5mo ago
It's very easy to get started on this, you tax the shit out of people who have a lot of money because the old adage is true.
88.
by thot_experiment 5mo ago
You're so close! Instead of patching the issue maybe let's solve the root problem of spiky power distribution among humans. We don't need to make sure cops have immunity to prosecute powerful people. We need to not have power
89.
by thot_experiment 5mo ago
It's absolutely not the slightest bit crazy if you've paid attention to how cops behave at any point in the last history of the country. 100% agree about personal responsibility. You must understand that when the cops says that ov
90.
by thot_experiment 5mo ago
I assume they need to do a bunch of WebAPI bullshit to get around Youtube's draconian policies, but maybe one day https://txikijs.org/ will solve all problems with embedding javascript. I believe, and maybe the strengt

More ›