Zambyte

4 ms·

1.
by Zambyte 6d ago
You could say the same thing about "license-washing" the model. It seems like you're just going through a guaranteed expensive process to have roughly the same risk as just using the model and potentially getting hit with leg
2.
by Zambyte 6d ago
Why would you even do that? Just... use it? There hasn't been any legal precedent on if models can even be copyright restricted. Labs just keep publishing license documents as if they matter.
3.
by Zambyte 8d ago
How? I'm running 4bit with a q8 kv on a 24gb card, and I'm not able to get 100k out of it. I use a context size of 90k.
4.
by Zambyte 8d ago
How are you sure about that? Undercutting your competition (at cost even) to minimize their power is a common strategy.
5.
by Zambyte 8d ago
How about Anthropic? I've seen people say it's surprising that their blog isn't written with AI, but I think it's far more likely that it is written with AI; they are just good at reviewing and getting a nice prose out o
6.
by Zambyte 9d ago
It's not, it just requires creativity. One example I can think of is limiting connectivity by distance between nodes. Something like Meshtastic seems unlikely to ever be commercialized in the same way that the Internet has been. Sure,
7.
by Zambyte 9d ago
Until it says it's done. One of the more surprising advancements for me in recent AI is that models don't just indefinitely nit pick issues like I would expect. If you have them write something, and then have it review it in a fre
8.
by Zambyte 9d ago
... doesn't one of those imply the other?
9.
by Zambyte 10d ago
The other tool I wanted to throw out there is voxtype (plus wtype). I've been looking for a good, global, local dictation solution for wayland for a while now, and finally landed on this one. It's great for rambling details that p
10.
by Zambyte 10d ago
LLMs are chaotic pure functions. Their input is usually randomized.
11.
by Zambyte 10d ago
It's at least important from philosophical perspective regarding whether LLMs have free will or not. It's hard to say whether or not a human thought or action is driven by free will, people have debated it for centuries. We can pr
12.
by Zambyte 10d ago
Traditional non-chaotic systems* LLMs are deterministic. They are chaotic, which people confuse for non-deterministic.
13.
by Zambyte 10d ago
No problem. I think it's less of people withholding information to have an advantage, and more people still not having settled on a workflow they like. Herdr is the most recent addition in my workflow as of only a few days ago, but it
14.
by Zambyte 11d ago
Up until the last couple of months, I have treated LLMs as a supercharged stackoverflow. I would ask it questions on how to do something in a general sense, and then adapt the answer to my use case. Now, my entire programming flow does not
15.
by Zambyte 11d ago
Well that's what they're doing.
16.
by Zambyte 11d ago
robots.txt is a suggestion, not a rule. It's a service to crawlers to help them avoid wasting time. Using robots.txt as a security measure is like trying to stop a foreign invader with a "road closed" sign. Edit: this is obvi
17.
by Zambyte 12d ago
I like that you specified that the car was self driving, but didn't specify the RV was.
18.
by Zambyte 12d ago
When sitting, the optimally comfortable angle to look, and the optimal place to hold a controller are very far from each other. The Deck is basically only fun for long sessions if you can play it laying down. VR is more flexible in this reg
19.
by Zambyte 12d ago
The whole point of butchered websites is to direct people to install their more invasive app. It's not like all companies just got bad at making websites somehow. There are conflicting incentives.
20.
by Zambyte 13d ago
To people downvoting: How do you define "general intelligence" in a way that AI currently is not able to do in some way, but humans are?
21.
by Zambyte 13d ago
AGI isn't coming, because we've had it for years. People just expect AGI to look like sci-fi, and hold the artificials to higher standards of "general" and "intelligence" than the naturals. Luckily, AGI is pret
22.
by Zambyte 13d ago
They did more than let them. In an abstract way, they told them to. They gave it all of the training data it had at that point, and then it did the thing it was trained on. Of course they should be help liable for programming their computer
23.
by Zambyte 14d ago
I haven't noticed.
24.
by Zambyte 14d ago
The advantage of busses and bikes are that they can use the same roads we already built for cars. We don't need to build new infrastructure to make busses and bikes much better, we just need to limit car access. That can be done by sig
25.
by Zambyte 14d ago
Yup, same here. Been using Kagi for years. It's boring, it just works. Hoping they can stay that way.
26.
by Zambyte 14d ago
I'm American, and I don't normally drive, because I use busses, bikes, and trains to get to my destinations. I sold my last (hopefully ever) car over a year ago. I'm sorry to shatter the dreams of most Americans, but the worl
27.
by Zambyte 14d ago
The solution to car problems is not more cars. It's serious alternatives to driving. We don't need Chinese cars. We need trains, busses, and bikes.
28.
by Zambyte 14d ago
What about selling busses and trains, and buildings bike lanes and train tracks? Loans and cars aren't the solution to loans and cars, but there are solutions.
29.
by Zambyte 15d ago
I like to think of it as a how -> what -> why pipeline. Early programming in assembly mostly involved telling the computer how to do things that you want it to do. You instruct it in terms of the mechanical capabilities of the machi
30.
by Zambyte 16d ago
Can you back that up with numbers or do you just expect people to take your word that cyclists have killed about as many people as WWII? https://en.wikipedia.org/wiki/World_War_II_casualties https://www.acad

More ›