BoredomIsFun

4 ms·

31.
by BoredomIsFun 24d ago
> not 1 token on 1 session like local models. Local models can absolutely run in batch, what are even talking about? > If you had only batch inference and enough of it to fill the compute to 80% then you get cheaper local models. Even
32.
by BoredomIsFun 24d ago
> It's very possible that it costs you more than a cloud mode would ...which is almost always true in a single request/reply mode and never true in batch mode. Single request usually 2x-3x more expensive than cloud and batch mo
33.
by BoredomIsFun 24d ago
> Stylistically everything you see is an artifact of post-training, It is still not exactly clear if it is true or not. Unless we have base "pt" snaphot of Claude we can't say one way or another. I've played a bit wi
34.
by BoredomIsFun 24d ago
some folks at r/WritingWithAI some time ago mentioned that disclosing AI did not kill sales.
35.
by BoredomIsFun 25d ago
> write novel length stories This would never work. Anything longer than 1500 words gonna be bad. To get proper quality you should generate piece by piece then stitch.
36.
by BoredomIsFun 25d ago
Generally true, yes, but the absolutely best prose I ever got from a local model I can run on my PC (and I've used many, many of them last two years, explicitly for prose) was from a finetune of Qwen-3.6-27b from July 2026.
37.
by BoredomIsFun 25d ago
Ironically, his writing sounds very AI generated.
38.
by BoredomIsFun 25d ago
Perhaps only on the upmarket.
39.
by BoredomIsFun 25d ago
> No, they use "the same cadence and cliches" because they inflate a short and ambiguous prompt into long and specific prose by making statistical assumptions Even if LLM output has to largely follow some statistical rules, yet
40.
by BoredomIsFun 25d ago
> However, once it's understood that it wasn't written by a human it loses all value. Hmm...No. I actually enjoy generating short stories for myself - after light editing they are great; they are enjoyable irrespective of the p
41.
by BoredomIsFun 26d ago
> It's an awesome profession for those of us who love it. Yes, by definition of "love" and "awesome". > Tbf coding with ai is still super fun though. Agree, it could be entertaining. > I am hoping that eng
42.
by BoredomIsFun 26d ago
She is a grifter, not crank.
43.
by BoredomIsFun 26d ago
True. I like math and CS theory, but despise coding (pays well though). AI is finally taking over this soul-sucking occupation and all I can say - good riddance.
44.
by BoredomIsFun 27d ago
> such as how poorly it handles running out of memory What is interesting, FreeBSD last time I used it, had far ,pre simple predictable kernel OOM killer. Anyway, I always either switch off swap on Linux machines or install EarlyOOM.
45.
by BoredomIsFun 27d ago
> to be smarter than most people. Hell no. In very narrow tasks - yes, in vast majority, esp. involving state tracking (board games) and spatial reasoning - they are awful.
46.
by BoredomIsFun 27d ago
> we are all stochastic parrots to some extent. I think this statement is continuation of the old fallacy - every generation thinks of brain in terms of what is the current technology zaitgeist is - was it 19th century when they thought
47.
by BoredomIsFun 28d ago
> single RTX 3080 20G, I got 10 tok/s initially Add $200, buy a used 3060 and you won't need to offload cache to RAM. Yo'd have like 50-60 t/s with MTP enabled.
48.
by BoredomIsFun 1mo ago
Horse meat s very popular in Central Asia https://en.wikipedia.org/wiki/Qaz%C4%B1 . So, yeah, more than just "some".
49.
by BoredomIsFun 1mo ago
You are dumber thanme
50.
by BoredomIsFun 1mo ago
> I've spent several hundred thousand dollars in API costs in the last few years to power my app Which is kinda sad, if you've used Anthropic products, because you could get comparable performance from cheaper models for vast m
51.
by BoredomIsFun 1mo ago
> I've made over $6 million with my AI app in the last few years Oh, wow. > without worrying about temperature and other parameters. Tells a lot about you.
52.
by BoredomIsFun 1mo ago
GLM made pretty decent for that time small 9b vision model, GLM-4.1.
53.
by BoredomIsFun 1mo ago
You are flaunting your inability/unwillingness to use sampler settings.
54.
by BoredomIsFun 1mo ago
Have fun using web-interfaces for overpriced US models while I am getting my work done with Chinese models for a fraction of price on openrouter using API. Besides, when using API I am sure all American models, including Claude honour sampl
55.
by BoredomIsFun 1mo ago
1560 is Early Modern. *Per wikipedia:* https://en.wikipedia.org/wiki/Early_modern_period There is no pre-Modern. Right after Late Middle Ages [ https://en.wikipedia.org/wiki/Late_Middle_Ages ] goes
56.
by BoredomIsFun 1mo ago
Nemotron is okay. Better than Olmo.
57.
by BoredomIsFun 1mo ago
As I said, why would you use and finetune (burning lots of electrcity, not rounding error) Sonnet if you can cheaply tune Haiku? Press releases do not need advanced skills from LLMs.
58.
by BoredomIsFun 1mo ago
> You must not be doing much real work with these models, otherwise you would know that with the latest Claude models you can't even adjust the temperature or top p/k No, I do not. Good for me I guess. > The real way to actu
59.
by BoredomIsFun 1mo ago
> Why would they use Haiku for anything? Good enough for essentially blogposts? Easier to finetune? > They aren't paying for the tokens. They are paying for electricity, though.
60.
by BoredomIsFun 1mo ago
The author make a typical mistake, saying that witches were burned at stake in pre-modern times. Which is not true; surprisingly burning witches was not a big thing in Medieval period; it was actually early modernity when witch hunts have b

More ›