Zetaphor

8 ms·

1. 121.▲
   by Zetaphor 6mo ago

   Nobody, and that's my point. 99% of people going to install the tool and never bother with the source. This was true before AI and is still true now.
2. 122.▲
   by Zetaphor 6mo ago

   If the tool meets your needs, does that matter? Were you planning to make a meaningful contribution to the source? My assumption is that the vast majority of the people making these comments would have never even bothered to read the code,
3. 123.▲
   by Zetaphor 6mo ago

   Are you implying that need for support would go away? If anything the demand would be artificially high at the start of a mass migration, and then presumably level out to something similar to what we see today with Windows. This is basicall
4. 124.▲
   by Zetaphor 6mo ago

   You can still stay pretty up to date (at least in AI) without even being on X, since everything distills out to every other platform anyway. Between /r/LocalLlama and the ThursdAI and Latent Space newsletters, I'm at most onl
5. 125.▲
   by Zetaphor 6mo ago

   For clarity here, "after" was 6 years later, once Meta and then the Chinese labs had already established the ecosystem
6. 126.▲
   by Zetaphor 6mo ago

   They don't need an excuse to not open the model weights (unfortunately). As far as I know the only western lab to release weights of a former flagship model is xAI with Grok 2. They said they were going to do the same for Grok 3 but no
7. 127.▲
   by Zetaphor 6mo ago

   Many of us would appreciate if you could share one of those reputable vendors with such cheap prices
8. 128.▲
   by Zetaphor 6mo ago

   One thing we've always been exceptional at is thinking we're exceptional
9. 129.▲
   by Zetaphor 6mo ago

   https://en.wikipedia.org/wiki/Copy_(publishing)
10. 130.▲
    by Zetaphor 6mo ago

    > I wouldn't call this totally accurate, especially as of late. What exactly has changed? Alibaba just released a bunch of new models and have said 3.6 weights are coming soon. The others labs have shown no signs of slowing down the
11. 131.▲
    by Zetaphor 6mo ago

    Please add OG/embed tags. It's both polite and helpful to let people see what they're about to land on when someone shares a link on socials/discord
12. 132.▲
    by Zetaphor 7mo ago

    We use local models in data processing pipelines. Being able to do compute with language has plenty of use cases
13. 133.▲
    by Zetaphor 7mo ago

    > I'm not interested in adopting an inferior closed source weight from a geopolitical rival. The open source weights argument was the one thing China had going and that I was seriously cheering them on for. They could have been our
14. 134.▲
    by Zetaphor 7mo ago

    There are plenty of examples in the RL training showing it how and when to prompt the human for help or additional information. This is even a common tool in the "plan" mode of many harnesses. Conversely, it's much harder to
15. 135.▲
    by Zetaphor 7mo ago

    SQLite is enough for 98% of all of these use cases, and 100% of the ones this would appeal to
16. 136.▲
    by Zetaphor 7mo ago

    Atuin[1] feels like the best of both worlds to me. [1] https://github.com/atuinsh/atuin
17. 137.▲
    by Zetaphor 7mo ago

    How do we report spam here?
18. 138.▲
    by Zetaphor 7mo ago

    I'd argue not, as with tool calls it has available to it at all times a description of what each tool can be used for. There's plenty of intermediate but still important information that could be compacted away, and unless there w
19. 139.▲
    by Zetaphor 7mo ago

    I would much rather have a stack I control. Additionally this can be used as a library.
20. 140.▲
    by Zetaphor 7mo ago

    I had such a godawful headache from that. Also tried the peanut shells, equally awful. I was a dumb teenager.
21. 141.▲
    by Zetaphor 7mo ago

    People wouldn't just lie on the internet!
22. 142.▲
    by Zetaphor 7mo ago

    Thank you for sharing this!
23. 143.▲
    by Zetaphor 8mo ago

    Or smaller on Nano
24. 144.▲
    by Zetaphor 8mo ago

    This has also been my understanding of all of these terms so far
25. 145.▲
    by Zetaphor 8mo ago

    I'm running this exact same setup on a Framework Desktop and I'm seeing ~30 tokens/second
26. 146.▲
    by Zetaphor 8mo ago

    Are they qualified to do the work? Evidently not as they were passed over for their peers who happen to also be immigrants.
27. 147.▲
    by Zetaphor 8mo ago

    I've found real utility in it, but the hype definitely exceeds the current capabilities
28. 148.▲
    by Zetaphor 8mo ago

    Are you basing that on your informed first hand experience, or based on your assumptions backed by no actual experience using the hardware? I don't know what you want me to tell you, you're welcome to believe whatever you want but
29. 149.▲
    by Zetaphor 8mo ago

    Is this not effectively the same thing as a Bitcoin ASIC?
30. 150.▲
    by Zetaphor 8mo ago

    Smaller quant of the same model. A smaller quant of a different family of model would be practically useless and there wouldn't be any point in even setting it up.