bavell

6 ms·

31.
by bavell 6mo ago
> I would also expect to see it taking exponentially longer to process a prompt. I don't believe LLMs work like that. Try this out using a local LLM. You'll see that as the conversation grows, your prompts take longer to execut
32.
by bavell 6mo ago
Yesterday I was playing around with Gemma4 26B A4B with a 3 bit quant and sizing it for my 16GB 9070XT: Total VRAM: 16GB Model: ~12GB 128k context size: ~3.9GB At least I'm pretty sure I landed on 128k... might have been 64k
33.
by bavell 6mo ago
> As a user, I _expect_ the cost of resuming X hours/days later to be no different to resuming seconds or minutes later. As an informed user who understands his tools, I of course expect large uncached conversations to massively eat
34.
by bavell 6mo ago
Definitely some problems in the current system, broad and creeping executive overreach extending back decades now. Pretty sure stealing from stores is already illegal, not sure I understand your analogy... lots of case law / precedent
35.
by bavell 6mo ago
I do agree it was a weak case, I think SCOTUS ruled correctly.
36.
by bavell 6mo ago
Haven't had a chance to test 4.7 much but one of my pet peeves with 4.6 is how eager it is to jump into implementation. Though maybe the 4.7 is smarter about this now.
37.
by bavell 6mo ago
The system prompt is always loaded in its entirety IIUC. It's technically possible to modify it during a conversation but that would invalidate the prefill cache for the big model providers.
38.
by bavell 6mo ago
Is it exponential or logistic?
39.
by bavell 6mo ago
Nope, the original tariffs were under IEEPA, then Supreme Court ruled they didn't have authority to use IEEPA, so they had to drop those tariffs and start working on refunds. It'd only have been illegal if they kept the tariffs af
40.
by bavell 6mo ago
https://marginlab.ai/trackers/claude-code/
41.
by bavell 6mo ago
Try it before you give up, I got plenty of AI stuff working on my 6750XT years ago.
42.
by bavell 6mo ago
Eh, YMMV. I was using rocm for minor AI things as far back as 2023 on an "unsupported" 6750XT [0]. Even trained some LoRAs. Mostly the issues were how many libs were cuda only. [0] https://news.ycombinator.com/item
43.
by bavell 6mo ago
I've been using CC a decent amount the past few weeks and have never seen this malware stanza...?
44.
by bavell 6mo ago
Self-aware meta commentary on HNers breaking HN guidelines to cite HN guidelines.
45.
by bavell 6mo ago
They're complementary but also have significant overlap. Hence all the confusion and strong opinions.
46.
by bavell 6mo ago
> How about we standardize this idea? We can have an endpoint to tell the agents where to find this text file and API Good news! It's already standardized and agents already know where to find it! https://code.claude.com&
47.
by bavell 6mo ago
Absolutely. You can get "locked in" to certain patterns / phrases just via muscle memory and familiarity. Need to balance that with a little improv to find new patterns phrases you like, and then can train those in via muscle
48.
by bavell 6mo ago
Preach. I have 4 monitors and one is a vertical 1440x2560. Massive productivity boost - terminals running claude code, reading docs, IDE panes, anything with lots of scrolling. Highly recommend it!
49.
by bavell 6mo ago
Wow that's bad. Unsure if this is an outlier or typical for YC companies.
50.
by bavell 6mo ago
Pretty sure this is illegal now across the board.
51.
by bavell 6mo ago
No, missing a MMU.
52.
by bavell 6mo ago
> What you are offering is NOT a free tool -- it is a demo, for a tool for which you are charging $12/month Commonly known as a "free trial"
53.
by bavell 7mo ago
I've found memories and state to be a mixed bag with LLMs. To the point I don't bother with long term memories - usually only short or medium-term session logs or task-focused docs.
54.
by bavell 7mo ago
Ooof, you're way behind - see sibling comments. Come join us in the promised land, brother!
55.
by bavell 7mo ago
Home Assistant integration a la Alexa would be awesome
56.
by bavell 7mo ago
And comfyUI workflows. People have been doing this for awhile now.
57.
by bavell 7mo ago
Asking for a walkthrough of the codebase? Sure you linked to the right page? I was expecting tips on code review instead based on your comment and GP.
58.
by bavell 7mo ago
One of the most sane and dispassionate takes I've seen. Kudos.
59.
by bavell 7mo ago
Great posts! So far [2] is the only "claw" that has caught my interest, mostly because it isn't trying to do everything itself in some bespoke, NIH way.
60.
by bavell 7mo ago
Who needs "claws" when you've got paws!

More ›