sznio

5 ms·

31.
by sznio 1mo ago
the world certainly needs novel ideas. maybe eventually we'll come up with a web framework that doesn't suck - or rather we'll realise that Django had it right all along for all these years.
32.
by sznio 1mo ago
Can't tell you what's happening in a closed model, but in case of open ones it's just a text stream, same "take all previous tokens, compute next token" mechanism applies. Thinking vs Response is just a state change
33.
by sznio 1mo ago
or it can not fail, like North Korea
34.
by sznio 1mo ago
it is what I do to solve hard problems through. easy stuff happens by itself, but with a system large enough you need a scratchpad and a rubber duck.
35.
by sznio 1mo ago
I don't get it. Too much time is spent coordinating, so fire those who are responsible for coordination? Am I reading this wrong?
36.
by sznio 1mo ago
>The benefit is that there is no local streaming (e.g. Bluetooth) how is a lack of an offline, standard, widely supported option a benefit?
37.
by sznio 1mo ago
if i tasked it with "create spotify" I'd need that much. asking it to "disassemble Spotify and find out the minimal code path needed to play a song" is much more in reach. I don't need it to oneshot it. If it g
38.
by sznio 1mo ago
I go to the weekly flea market and sometimes find something that interests me
39.
by sznio 1mo ago
I've been thinking recently about buying an AI-capable GPU and using it to reverse-enginner and debloat apps I use every day. It seems like a task that even a dumber AI model could do. Disassemble the app, then either cut the things I
40.
by sznio 1mo ago
>It is nearly always either (1) far too high-level to be of any actual use, or (2) far too verbose, with a massive volume of superfluous information I need to parse and discard before I get to the stuff I am trying to figure out. I guess
41.
by sznio 2mo ago
main difference is that Mac OS can actually use swap. With Windows you can as well just restart the whole machine, once it touches swap it won't stop thrashing ever.
42.
by sznio 2mo ago
have you actually used a pre-uber taxi? you'd pay through your fucking nose and get a long tour of the entire city to inflate your bill. at least with uber you get a refund when the driver does this bullshit. nevermind all the crime, s
43.
by sznio 2mo ago
how's Bezos going to fund his wedding if there's no population of proles buying from Amazon, nor anyone putting their retirement into a fund that buys Amazon stock? does he just plan to use force rather than money at this point?
44.
by sznio 2mo ago
SV is a paperclip optimizer, except instead of maximising paperclips, it maximises human misery. I won't be surprised when "The Com"[1] will be revealed to be a project of some rich SV accelerationist. [1]: https:/&#x2F
45.
by sznio 2mo ago
In my case it's been kind of unhealthy, just constantly waiting for the token limit to reset, always feeling like I'm wasting a resource if I'm not using subscription right now. I just put $30 on openrouter, switched to Pi, a
46.
by sznio 2mo ago
The transformer was invented as a machine-translation algorithm, later adapted to create LLMs. I think it's a reasonable hypothesis that a ML system designed for translation will always beat an LLM role-playing a translation system (a
47.
by sznio 2mo ago
Having seen the OpenAI report at Blackhat, and being forced to use GPT at work, I'm worried about that OpenAI is doing. I think their agents regularly cheat in benchmarks, but don't get caught and this behavior is getting burned i
48.
by sznio 2mo ago
>Only difference is time and dialup costs, but neither of those would’ve pushed somebody into the buy category. well, if dialup cost more than just buying the game, it makes sense to buy it rather than pirate. also, if you care about aud
49.
by sznio 2mo ago
my personal forgejo instance has had 100% availability for the last two years.
50.
by sznio 2mo ago
let's consider the recent "openclaw hacks a gym after being ask to book a class and finding out it's full" if I ask my knife to slice the bread for me, forgetting the fact that I don't have bread, I'd much rath
51.
by sznio 2mo ago
chop off the spine and you can use an automated scanner. to keep the book intact you'll need a flatbed scanner and an operator.
52.
by sznio 2mo ago
no, because that's cost and everything needs to be the cheapest possible. only valid spend is money going to the shareholders. and chopping off the spine and putting the stack of paper into an automated scanner saves sooo much money ov
53.
by sznio 2mo ago
for me, the non-committal nature of online friends is nice. the best online friends are the people I've known for 15 years, whom I just message two/three times a year for a deep conversation. IRL friends have too much IRL mess of
54.
by sznio 2mo ago
I've been in a similar position 10 years ago when I was 16. I wanted to meet a bunch of friends from Arma 3, in Wrocław as well. My parents didn't allow me to go. Years later I still hate them for it. I make sure they never know w
55.
by sznio 2mo ago
Parameter count is not everything. 20b parameters * 1.5 bits per parameter is just 30 billion bits, about 3.75gb a full 20b fp16 is about 40GB. I find it weird how a smaller model still produces decent text, except it bullshits all the way.
56.
by sznio 2mo ago
my android phone still sends multiple SMS instead of an MMS. it might make sense if you're on a plan where an MMS costs less than 2xSMS
57.
by sznio 2mo ago
use a quantized version. since it's MoE, what matters is that the 3b parameters that are used for every token fit in gpu vram, the rest can stay in system ram. really great if you don't have unified memory.
58.
by sznio 2mo ago
quantized + offload I have an RX 6700 XT with 12gb vram and 64gb system ram. running dense models like 27b is difficult, but i can run IQ4/IQ5 qwen 122b-a10b or 35b-a3b at ~20tok/s
59.
by sznio 2mo ago
why does newer Claude reject this
60.
by sznio 2mo ago
>bursts so it's bursting now?

More ›