lta

4 ms·

1.
by lta 9d ago
I'm doing the same with a context of about 128-150k Surprisingly, I get subjectively better results with Unsloth's 3 bit quants (UD-Q3-XL something), than their 4 bit quants (S or M)
2.
by lta 10d ago
That's going to create a lot less trouble the next time they have to do a round of layoffs to increase efficiency or whatever fancy BS they'll invent next time ^-^
3.
by lta 10d ago
The joy of a world with a duopoly reigning over a strategic core market We're really into the South Park cliché: Anal douche or Shit Sandwich. I wish regulators across the world did something about this, but even Europe shy attempts ar
4.
by lta 15d ago
Thank you for posting this <3. I've been thinking it daily for about a year and feel a little bit less alone. I understand this is a significant topic in the industry but the ratio is really high. Every time someone at OpenAI or Ant
5.
by lta 22d ago
If we needed any more.
6.
by lta 1mo ago
Would you mind elaborating a bit on your process ? Or share a few relevant exchanges, I've no clue how to start having this discussion. That would make a great blog post
7.
by lta 1mo ago
Nobody forced you to sell your soul. You made a pact with the devil. We all know how this ends up
8.
by lta 1mo ago
While I was reading the top level message I was thinking on something wrong those lines. That being said I think it's somewhat useful to be able to see the reasoning in a meaningful format. There's already enough hidden layers of
9.
by lta 1mo ago
I've been experimenting with a few settings in my 4090 , and if 3.6 run at 90-110 tps, 3.8 staya below 80 tps and it's most often at 60 tps. I'm using flash attention, mtp speculative decoding (n=2). I've looked at the
10.
by lta 1mo ago
That was pretty darn fast :) I'm curious whether they got a headstart or if they're that reactive
11.
by lta 2mo ago
The people that were sampled were probably already affected by the indoor exposure. I don't think it affects the validity of this study
12.
by lta 2mo ago
Yeah it's a llama.cpp fork and it's linked everywhere on their repo
13.
by lta 3mo ago
How is this relevant ? We're talking about open source analytics, and this looks like a shameless plus
14.
by lta 3mo ago
I'm genuinely flabbergasted to read this here. There's no possible comparison between Musk and Mamdani's gestures, at least from the perspective of someone who grew up in a region occupied by the Nazis during the war and had
15.
by lta 3mo ago
We don't have a lot of choices right now, especially regarding banking apps :'(
16.
by lta 3mo ago
Fwiw it's also linked in the article, so it's not exactly a surprise :)
17.
by lta 4mo ago
I started switching to DDG on some devices, this will motivate me to finish the transition ! Thanks
18.
by lta 5mo ago
I'm sorely disappointed by gitlab, I was hoping they would be a safe harbor against this whole AI bullshit typhoon.
19.
by lta 5mo ago
The announcement contains way too much marketing stuff for my own taste. Just tell us what you've done, we don't really care about how you're trying to surf the AI bubble
20.
by lta 5mo ago
Not as much as "Open" AI
21.
by lta 5mo ago
As long as they're not releasing 32bit .pt :)
22.
by lta 5mo ago
Every night praying for tomorrow
23.
by lta 5mo ago
I wanted to try it recently and went to their doc website. Ar first glance it looked surprisingly detailed for such a young project but why not. I didn't wanted to run a random, possibility vibe coded tool on my computer right away so
24.
by lta 6mo ago
I hear what you're saying and it's very insightful. But I'm under the impression the libertarians have moved a lot closer to fascism I'm the recent years so it's hard to keep them in any tent. The "society has
25.
by lta 6mo ago
I've been scrolling for a while and this is the first contact that makes sense to me. Ok, zuck has gone dark, yes tiktok governance and objectives are unclear. None of those companies are clean. But Musk is actively *evil* and using t
26.
by lta 6mo ago
That's just a drop compared to the ocean compared to this one time when he performed multiple nazi salute in front of an entire country, or when he single handedly decided to intervene in a foreign war via Star link control or when he
27.
by lta 6mo ago
That sounds like a very smart move at the time where Europe realize the US isn't such a gray partner and it's trying to reduce it's critical dependencies on foreign nations tech and infra. Good job. I'm actually very su
28.
by lta 6mo ago
I don't think it is. There are many many cases where you do want to own them. The people you rent yours from are making a shit load of money so it doesn't sound that bad of an idea
29.
by lta 6mo ago
Sounds like the code of OpenClaw haha
30.
by lta 6mo ago
Why does every tool on the face of earth try to add AI features ? Good tools are simple and orthogonal. If you want AI, there's already plenty of other tools doing it probably better. I'm overall fairly disappointed by this announ

More ›