segmondy

8 ms·

1. 211.▲
   by segmondy 5mo ago

   Running local LLM in 2023 and I heard folks talking about interfacing LLM to tools. I wrote a system prompt and told LLM it can call some tools. If it wants to call a function to output func(params...) and do so in an XML tag. I provided
2. 212.▲
   by segmondy 5mo ago

   something pattern something matching something
3. 213.▲
   by segmondy 5mo ago

   Pretty cool, would have been great before the trackpad.
4. 214.▲
   by segmondy 5mo ago

   Are you surprised? Great hack by the author, the impact could be huge if someone is targeted, but overall the impact is very minimal. The vendor can't be bothered. For you to be a victim, you have to own this device, and your attac
5. 215.▲
   by segmondy 5mo ago

   You can run these on a turing machine. At what point is it not worth it? At some point the energy to generate each token matters. We often seen token per second. I think a missing metric is tokens per kilowatt. That is what really mat
6. 216.▲
   by segmondy 5mo ago

   same here, I feel all sorts of sadness since this sort of thing use to bring so much joy but now bring a bunch of yawn. i had sun 3s, earlier sparcs, IPX, IPC, decstation, HPs, SGI and you are right, it took getting older to feel the same.
7. 217.▲
   by segmondy 5mo ago

   it shows you what we could have if we were sufficiently advanced. think about it, it's software, all bits. we could theoretically have had all of this a long time ago.
8. 218.▲
   by segmondy 5mo ago

   sometimes that's it... you're thinking they are not great and if others feel the same, then it's no wonder they feel insecure and are fighting footing for recognition.
9. 219.▲
   by segmondy 5mo ago

   I use a cellphone internet provider, there have been many a sites I couldn't access because or cloudflare or stupid recaptcha. i know damn well what a bicycle, bus, traffic light or stairs is.
10. 220.▲
    by segmondy 5mo ago

    The most interesting and perhaps useful for most would be how they control the fan. If you are thinking of doing this, you really want to get those fans under control, they are loud. For anyone thinking of these, v100s idle super high! 25-
11. 221.▲
    by segmondy 5mo ago

    terrible deal
12. 222.▲
    by segmondy 5mo ago

    kinda, they put that on a PCIe socket, but it's passive. Meaning no fan. If you try inference on that it overheats in 1 minute unless you have it inside a server case.
13. 223.▲
    by segmondy 5mo ago

    Can you also confirm that you do not log/retain it. 100% pass through. If you are logging it, you could one day change your position on that.
14. 224.▲
    by segmondy 5mo ago

    Altman does appear to be an asshole, but I have bad news for you if you think Anthropic are the good guys. If anything, they might be worse than OpenAI.
15. 225.▲
    by segmondy 5mo ago

    The post is wrong, it's still free, see - https://openrouter.ai/tencent/hy3-preview:free it's free in kilo.ai https://kilo.ai/models/tencent-hy3-preview-free It's free in a lot of p
16. 226.▲
    by segmondy 5mo ago

    I wish I could retire...
17. 227.▲
    by segmondy 5mo ago

    High token usage cuz it's free doesn't count
18. 228.▲
    by segmondy 5mo ago

    Yup, if anything this should be a guide on how not to eval a model. Furthermore, let's say the labels were non ambiguous, why would we care about alignment between the models? The only number I would personally care about is percen
19. 229.▲
    by segmondy 5mo ago

    I think it is, I think it is also linked to diet. Learn to cook, avoid processed food, eat out less.
20. 230.▲
    by segmondy 5mo ago

    Nah, the main mistake is Jony Ive. one hit wonder.
21. 231.▲
    by segmondy 5mo ago

    you think? i can bring up my 40 yrs old NES and it works every time.
22. 232.▲
    by segmondy 5mo ago

    There's a reason folks like these can afford this and you can't. Go on with your cheap self
23. 233.▲
    by segmondy 5mo ago

    right here in good ol USA, workers are getting laid off. Plenty of folks will be happy without a bonus right now if they could just have a job.
24. 234.▲
    by segmondy 5mo ago

    All I can say is take my money!
25. 235.▲
    by segmondy 5mo ago

    our local AI models are already capable of running McDonalds.
26. 236.▲
    by segmondy 5mo ago

    K2.6, Qx/Q4, it's huge and mostly runs off CPU/system ram. So slow
27. 237.▲
    by segmondy 5mo ago

    This was generated locally with Kimi https://gistpreview.github.io/?d55f07c22d54badc8042a7c8b3785...
28. 238.▲
    by segmondy 5mo ago

    I'm surprised that, "they must have trained for it" camp is not here saying that rubbish.
29. 239.▲
    by segmondy 5mo ago

    You can use lots of open weight models today.
30. 240.▲
    by segmondy 5mo ago

    Everything, you heard the joke about those who don't know Lisp end up reinventing it, well, the same can be said for Prolog.