johndough

7 ms·

31.
by johndough 3mo ago
Why not? The model is 2.8T parameters with native MXFP4, which is 1400GB.
32.
by johndough 3mo ago
> Once the tide drops enough for hardware lead times to shorten to weeks Which will not be any time soon according to SK Hynix CEO: > We still forecast that customer demand will remain higher than our supply capacity even beyond 2030
33.
by johndough 3mo ago
> GPUs become obsolete in 5 years The GPUs are far from worthless after 5 years. E.g. the A100 80GB PCIe version cost around $15k when it was introduced in 2021 and now sells for $10k used. Things might be slightly worse for the data cen
34.
by johndough 3mo ago
Thanks for pointing that out. I haven't noticed any adds in years with Firefox and Ublock Origin extension. I'll look for a better image host in the future. I guess the economic incentives makes them all turn bad after a while.
35.
by johndough 3mo ago
Oops, autocorrect. Sorry about that.
36.
by johndough 3mo ago
Another point for consideration: Specialized SVG models create way better looking pelicans riding a bicycle. (E.g. Refract V4: https://jumpshare.com/s/8liB7Aiuoo3yucbWGXjZ mirror: https://postimg.cc/Mc
37.
by johndough 3mo ago
I would not put any trust into that AI-generated "research". It does not control for how OpenAI, Anthropic and Moonshot are doing tokenization and token healing, so the results are meaningless.
38.
by johndough 3mo ago
Neat, I did not know of that functionality. Thanks!
39.
by johndough 3mo ago
I am not arguing that Kimi did not distill Opus or Sonnet (which they almost certainly have, as opposed to Fable or Sol). I am arguing that even if they did not distill, the model could still identify itself as Opus or Sonnet. That being sa
40.
by johndough 3mo ago
Implementing your own agent is very easy. Here is a minimal agent in 60 lines of Python without dependencies: https://github.com/99991/MinimalAgent You only need a single tool to start with. All recent LLMs know how to
41.
by johndough 3mo ago
The exact model identifiers appear extremely frequently in code on GitHub. https://grep.app/search?q=claude-opus-4-5-20251101 https://grep.app/search?q=claude-sonnet-4-20250514 They also appear elsewhere on
42.
by johndough 3mo ago
> Zero emissions, silent, no illumination, etc. Mostly silent. High voltage transmission lines may have a low-frequency hum. You have to stand directly under them to hear it though.
43.
by johndough 3mo ago
But then again, the identity could also have slipped into the model from other sources during pretraining. The internet is full of "I am Claude": https://grep.app/search?q=i+am+claude and variants https:/&#x
44.
by johndough 3mo ago
Your comment sounds like an AI-generated advertisement.
45.
by johndough 3mo ago
If an uneducated acquaintance of yours was about to name their newborn child "Adolf", would you interject that this name might not be such a great idea?
46.
by johndough 3mo ago
It would be great if this could be combined with quantization-aware finetuning. In my experience, Qwen3.6-27B has much fewer repetitions at Q6 quantization level as compared to e.g. Q4, but that leaves little space for context on my 24GB RT
47.
by johndough 3mo ago
This does not seem to be true currently. In 2025, there were 45356 McDonald's restaurants worldwide and 13706 in the United States, which is about 3.3092. https://corporate.mcdonalds.com/content/dam/sites&#x2F
48.
by johndough 3mo ago
This could be another fine example of the Goomba fallacy: https://en.wiktionary.org/wiki/Goomba_fallacy Another explanation might be a general dislike of big establishments like AI companies and publishers (which gloss
49.
by johndough 4mo ago
Any specific abliterated big models you can recommend?
50.
by johndough 4mo ago
Do you have any plans on mitigating the privacy consequences of microtransactions? I'm fine with paying for (some) content, but I'd prefer if there weren't some companies using that information to manipulate me or the more im
51.
by johndough 4mo ago
> GLM-5.2 class models already need 1TB+ of RAM. If you quantize GLM-5.2 to 4 bit, you can do it in less than 500GB: https://huggingface.co/unsloth/GLM-5.2-GGUF (table on the right) If you find three finds
52.
by johndough 4mo ago
> What provider do you use. OpenRouter with pinned DeepSeek provider or OpenCode Go > Why do you trust it with serving full quality? Quality seems good so far. > What harness do you use? Why do you trust it
53.
by johndough 4mo ago
> Its not an issue to adhere with your private money if your product isn't causing damages. Might happen really easily though. E.g. you install some package which has been compromised, infecting your software product and suddenly al
54.
by johndough 4mo ago
Another approach that often works for these kinds of problems and does not require much intelligence: Work out the first few cases by hand (1,2,6,20 in our case) and then look up the sequence on "The On-Line Encyclopedia of Integer Seq
55.
by johndough 4mo ago
> It’s unclear to me what the advantages of openrouter are but it seems to be a default I see many people talking about here. The advantage of OpenRouter compared to using API providers directly is that you can switch between API provide
56.
by johndough 4mo ago
I had a look at eurouter.ai and it seems like an extremely bad offer. - The prices are ridiculous (15 % markup for free account). - They have a rate limit of 1000 requests per month, unless you pay 40€ per month for ... what exactly is thei
57.
by johndough 4mo ago
> Mythos and other models are not brute-forcing passwords (and with this analogy passwords, ie. systems are the same). I am not talking about literally bruteforcing passwords (although LLMs are being used for that, too), but bruteforcing
58.
by johndough 4mo ago
I don't think that is necessarily true. - With a weaker model, the time to break into the system might grow so larger that it becomes infeasible, similar to how password hashes can be bruteforced, but if the password is long enough, th
59.
by johndough 4mo ago
Works for me though, even when using a proxy that is usually blocked everywhere.
60.
by johndough 4mo ago
Article 53 of the AI Act: https://ai-act-law.eu/article/53/ The definition of a "genral-purpose AI model" is described in more detail in the "Guidelines on the scope of obligations for providers of

More ›