segmondy

10 ms·

1. 301.▲
   by segmondy 6mo ago

   "The reason I had not done this before is that local models could not call tools. " Rubbish, we have been calling tools locally for 2 years, and it's very false that gemma3 scored under 7% in tool calling. Hell, I was getti
2. 302.▲
   by segmondy 7mo ago

   Insane to you? why don't you tell us what you have contributed to the world to improve this outcome even if by .01%
3. 303.▲
   by segmondy 7mo ago

   AGI has been here for longer than a year, if you can't see that then you are blind.
4. 304.▲
   by segmondy 7mo ago

   get the wyze robot vacuum, it's pretty smart.
5. 305.▲
   by segmondy 7mo ago

   If you are young, you definitely should consider Detroit. 4.5 hrs drive to Toronto, 4.5 hrs to Chicago, 3 hrs to Columbus and Cleveland. 45 minutes to Ann Arbor. Growing up in Detroit, I partied hard in these locations with my friend. F
6. 306.▲
   by segmondy 7mo ago

   so? use Gemini, GLM, Kimi, DeepSeek, MiniMax, etc, tons of options out there ...
7. 307.▲
   by segmondy 7mo ago

   gardening, raking leaves, composting things, burning branches and woods, chopping trees, weeding, manuring, and planting flowers. that's the april project
8. 308.▲
   by segmondy 7mo ago

   so? go to a different provider, or even better, self host.
9. 309.▲
   by segmondy 7mo ago

   skill issues. in practice, these models are all great. no matter how great the hammer or saw is, you need skills to be a great carpenter.
10. 310.▲
    by segmondy 7mo ago

    opencode, kimi-cli, qwen-cli, pi-agent,
11. 311.▲
    by segmondy 7mo ago

    roll my own, there's absolute 0 framework out there that's good enough for serious work.
12. 312.▲
    by segmondy 7mo ago

    solar WILL power the world.
13. 313.▲
    by segmondy 7mo ago

    behold the incoming attempt at oct coup
14. 314.▲
    by segmondy 7mo ago

    exactly, I got into the scene in the mid 90s and none of us was into cracking at all. I mean, if you have the skills to code a demo you could probably crack most software, but at that point it was about taking a hardware and making it do wh
15. 315.▲
    by segmondy 7mo ago

    where did you think punch cards came from? you know, the punch cards that we use to represent the first computer programs? https://en.wikipedia.org/wiki/Punched_card . read the precursor section. Basile Bouchon develop
16. 316.▲
    by segmondy 7mo ago

    trying using firefox and then using a cellphone network for internet. sometimes i can't access a site, because i get infinite captcha. i know what a damn bus, stairwell, stop light or motorcycle looks like.
17. 317.▲
    by segmondy 7mo ago

    I was going to post the exact first sentence you posted word for word and talk about my wasteful hobbies ... I do have project car hobbies and latest addiction is "gpu collection"
18. 318.▲
    by segmondy 7mo ago

    You have more faith in the country than I do.
19. 319.▲
    by segmondy 7mo ago

    :-( I'm going to dig out my copy and read it next month.
20. 320.▲
    by segmondy 7mo ago

    ... does't matter if they got flagged as spam.
21. 321.▲
    by segmondy 7mo ago

    surprisingly, the ocr models don't need much vram, they are often about 2b, so most 6gb GPU will handle it fine.
22. 322.▲
    by segmondy 7mo ago

    yup, deepseek-ocr-2 will have crushed this. then there's glm-ocr, dots-ocr, etc, paddle-ocr-vl, etc tons of options ...
23. 323.▲
    by segmondy 7mo ago

    Yeah, it doesn't take much. I'm looking at it right now, KV cache is about 4gb of vram, compute buffer =~ 1.5gb at full 128k context.
24. 324.▲
    by segmondy 7mo ago

    yup, A interacts with B with the interaction originating from A.
25. 325.▲
    by segmondy 7mo ago

    you are correct, I did forget to add quad. you should join us in r/localllama check out what other people are getting. you're welcome. https://www.reddit.com/r/LocalLLaMA/comments/1nunq7s/gpto
26. 326.▲
    by segmondy 7mo ago

    So you also believe when you rent a server you are sharing your data with the cloud? AWS and GCP are copying all private data on servers? Give me a break. There's a big difference between renting a server and using an API.
27. 327.▲
    by segmondy 7mo ago

    Some of you folks on here love to argue, gpt-oss-120b was trained in 4 bits, so it pretty much takes up 60gb.
28. 328.▲
    by segmondy 7mo ago

    I'm most certainly not doing so. seg@seg-epyc:~/models$ du -sh * /llmzoo/models/* | sort -n 4.0K metrics.txt 4.0K opus 4.0K start_llama 8.2G nvidia_Orchestrator-8B-Q8_0.gguf 12K config.ini 34
29. 329.▲
    by segmondy 7mo ago

    renting GPU, how is that sharing data with the cloud? you can rent GPU from GCP or AWS
30. 330.▲
    by segmondy 7mo ago

    99% of interest is in inference. If you want to fine-tune a model, just rent the best gpu in the cloud. It's often cheaper and faster.