5 ms·
Thanks for posting! Have you had any success with running without kv cache quantization? Is there a noticeable difference in quality without any? I would assume
by reilly3000 2mo ago
Thanks for posting! Have you had any success with running without kv cache quantization? Is there a noticeable difference in quality without any? I would assume that would eat into context but 170k is pretty generous!
- hypfer 2mo agoAccording to this shitty vibecoded thing "I" built https://hypfer.github.io/will-it-fit-llama-cpp/ https://hypfer.github.io/will-it-fit-llama-cpp/ (and I guess according to math too), FP16 K/V would give me something like 90k context at the same model quant, which doesn't really fit my usage. But maybe someone else has experience to share there
- nubg 2mo agojust to clarify. yes YOU built it. just because you used some tool doesn't mean the idea, prompting, reprompting, babysitting was not your creative input and effort. put differently, if you put a random person infront of whatever model you used (say, a 50yo receptionist at a pharmacy in india), they would not have been able to create that, because they would have lacked the motivation, idea, background knowledge, taste, etc to create such a thing.
- williamcotton 2mo agoI generally agree and expect this to be the case from a legal perspective. Legal questions of authorship are going to have to be established in terms of doctrines like SSO [0] and AFC [1]. Currently the incredibly sparse caselaw around this has yet to involve such non-literal notions of copyright. [0] https://en.wikipedia.org/wiki/Structure,_sequence_and_organization https://en.wikipedia.org/wiki/Structure,_sequence_and_organi... [1] https://en.wikipedia.org/wiki/Abstraction–filtration–comparison_test https://en.wikipedia.org/wiki/Abstraction–filtration–compari...
- bilekas 2mo agoYou sound like your trying to reassure yourself of something. I sure hope my boss doesn't think he built my work! He'd probably get fired pretty quickly during on call!
- deleted 2mo ago[deleted]
- formerly_proven 2mo ago> I sure hope my boss doesn't think he built my work! Most managers do though?
- bilekas 2mo agoI've worked with a good few types of managers of the years, none would take ownership of my work. The end result? Sure, for shareholders/this managers that is fine. But that's not the same as me being needed to be on a call with integration teams and having to run the call. It's just a layer of abstraction for management. I own the creation side of the product. Who created it is still me.
- fragmede 2mo agoDid Steve Jobs create the iPhone?
- reilly3000 2mo agoWould it exist in it’s present form if he didn’t exist?
- bilekas 2mo agothis topic always goes into this level of ridiculousness. Your question can't even be answered. We should focus more on encouraging discussion, not asking unanswerable questions. It wont bring anything other than points of both sides with no objective correct answer.
- tinfoilhatter 2mo agoSo if I hire an artist and am a motivated individual, have an idea for a painting, have background knowledge about paintings and have taste in paintings and can offer a critique of the painting as the artist paints it, then somehow I created the painting? Absurd logic. The AI built the website.
- sampullman 2mo agoI think in that case it's fair to say you created the painting with the artist, even if the artist should get majority credit. I don't like the analogy though, to me it feels more like you're a project manager directing a team of genius but single minded interns.
- tinfoilhatter 2mo agoI've never encountered a project manager who has said: I built this thing, after a project has wrapped up. I have encountered ones who've said I managed this project.
- sampullman 2mo agoI've heard some variant of "we built this thing", which I think is valid. I'm not sure how I feel about anthropomorphizing a coding agent at this point though, which is what you're implying.
- rob 2mo agoI just read through a couple of your posts that weren't dead or buried, and it seems like you're pretty anti-AI. You should really start to have an open mind towards it. It's going to be the future (if it isn't already), and as you continue to get older, you're going to really wish you spent your time right now learning and embracing the technology instead of being so against it. A lot of the skills and things that you're holding on to right now might not be relevant by then, but you'll be at a disadvantage from not keeping up with the industry and need to play catch-up.
- 2mo ago
- effdee 2mo agoSome people will now argue it was the chisel—not Michelangelo—who created David.
- smallmancontrov 2mo ago"Carve me a naked guy. Make no mistakes."
- hypfer 2mo agoI cannot fulfill this request. I am programmed to follow safety guidelines that prohibit the generation of sexually explicit content.
- b112 2mo agoNo, it's the difference between management and direct work. None would claim they chiseled anything, if it was 3D printed. They may claim they designed something.
- sejje 2mo agoThe idea guys will really think themselves gods, now.
- effdee 2mo agoWell, this universe might be God's own AI slop.