pllbnk

5 ms·

31.
by pllbnk 1mo ago
The repository has many forks, suggesting that folks are trying to (vibe) code support for different GPUs. Might be worth a shot.
32.
by pllbnk 1mo ago
Why would they sound the alarm if they were not trained (reinforced) to do that? I hope we don't expect sudden emersion of moral values from statistical models.
33.
by pllbnk 1mo ago
Even without ninfer I would get over 80 on LM studio with default settings, so it should be noticeably more on 6000. You might want to try different a different inference engine or settings.
34.
by pllbnk 1mo ago
Just a couple days ago I learned about ninfer ( https://github.com/Neroued/ninfer ) and on RTX 5090 I can now get ~200 tok/s and over 400 tok/s on concurrent requests which is plenty fast for a local model of t
35.
by pllbnk 1mo ago
It's not that LLMs (I think that's what we are talking about when talking about AI) are not that useful. They are. But the most straightforward way to use them is to generate walls of text, which contain a lot of BS. In order to c
36.
by pllbnk 1mo ago
If everybody is rich, then no one is rich. In other words, if everyone has a lot of money, then the prices will be high enough to suck this money out of everyone. America, and now much of the Western world, runs on debt and taking on debt i
37.
by pllbnk 1mo ago
Last update from Anthropic was that they only allow third party harnesses via extra usage credits or API key: https://www.reddit.com/r/ClaudeAI/s/cNb55vmWqW
38.
by pllbnk 1mo ago
AI industry does everything on vibes :)
39.
by pllbnk 1mo ago
I think that technologies will continue to commoditize and arrive at the global mean (median?), so the need for accountants to have the vocabulary just disappear. They will say what they want and it will be coded, deployed, with CDNs and fi
40.
by pllbnk 1mo ago
Well, to be fair, you cut the 6 important words that show the context: > We’re working on exciting changes that will make it feel like you’re getting more from Claude On the other hand, I think the biggest improvement they could do is al
41.
by pllbnk 1mo ago
Just tried it, really cool and works as advertised.
42.
by pllbnk 1mo ago
I run similar workflows as the author on my 5090. It's really good and reasonably fast at ~90 tok/sec on LM Studio. I haven't tried ninfer yet. The only problem is having to be mindful about the context size. I am jealous of
43.
by pllbnk 2mo ago
I canceled today, so they should reduce that by $100.
44.
by pllbnk 2mo ago
Even then, LLMs are based on a lossy compression, so the quality is harmed by design.
45.
by pllbnk 2mo ago
Yeah, it's a pointless exercise. I hope the author is just trolling given that he is knowledgeable in the field. > Here are three 64-character hex strings. Two are random. One is HMAC-SHA256(secret_key, "anthropic"). You d
46.
by pllbnk 2mo ago
They are only talking about production, productivity, quantity, nothing else. The amount of produced content hasn't been in short supply. There is no talk about consumption. Who is going to consume all this content, _even_ if it someho
47.
by pllbnk 2mo ago
Back and forths with the LLM are very useful when the person inquiring the LLM is invested in the conversation and wants to uncover the ground truth. Ultimately, some good result can come out of it because the person has a goal and LLM help
48.
by pllbnk 2mo ago
Another important differentiator is determinism. When software has a bug and introduces mistake due to a bug, it's possible to trace back and fix the bug deterministically. With LLMs it's "works as designed". Also, the t
49.
by pllbnk 2mo ago
Many companies that are offering remote work knowingly provide lower salaries. And many people agree because added flexibility has a price too.
50.
by pllbnk 2mo ago
The author talked about conventionally successful people such as Musk with roughly a few dozen children, but that doesn't make them good parents.
51.
by pllbnk 2mo ago
The capitalist LinkedIn-dwellers are obsessed with productivity. They can claim that AI will raise productivity and that we will need to work even more at the same time. Ultimately, most of the productivity gains in the recent decades are f
52.
by pllbnk 2mo ago
I have vibe-coded a HN RSS feed reader and plugged an LLM into it to learn my preferences. So far it's been in the training mode over the past week and half but it's been getting better at predicting and I hope eventually to have
53.
by pllbnk 2mo ago
I can’t come up with a use case where I couldn’t extract the image details using another, multimodal model and pass it into the GLM’s context with as many details as I need.
54.
by pllbnk 2mo ago
I am surprised foldable phones have survived. I thought it was a terrible idea how they worked and still think it is. A flimsy screen with a crease looks and feels opposite of what a phone should be.
55.
by pllbnk 2mo ago
The race of ending personal computing is there. I am sure big players want to control entire stack and users just sitting in front of dumb monitors consuming their ads.
56.
by pllbnk 2mo ago
The life quality is definitely better. The affordability hardly so, unless you can secure your income streams.
57.
by pllbnk 2mo ago
The only phone I would consider upgrading from my 14 Pro Max is Air. I think phone cameras have hit a limit several years ago and stopped improving, the end results looking really weak even with all this heavy post processing. Air finally d
58.
by pllbnk 2mo ago
The _Intelligence_ part of AGI should be able to guide the user through that without all the knobs.
59.
by pllbnk 2mo ago
I think minority do. Imagine, you have been vibe-coding this project for a while and it works kind of fine but you just have to fix a few more bugs and you get something like `node /tmp/claude-1000/-home-user-source-github-us
60.
by pllbnk 2mo ago
They have to show this full-screen banner about driving safely with the buttons to turn it off disabled for a few seconds. It's annoying. I want to turn it off but I can't so I start driving and I am forced to look at the screen u

More ›