dannyw

9 ms·

301.
by dannyw 3mo ago
I've had an Alipay account since 2006 and never been to China. Of course they exist, Alipay is from Alibaba, think about who typically buys from OEMs/suppliers there...
302.
by dannyw 3mo ago
Usually offloading experts to system RAM. DDR4 has gone up a lot, but on a 8-channel used Xeon motherboard or whatever, you can get tolerable mem bandwidth out of it.
303.
by dannyw 3mo ago
Apple, like everyone else in the industry, doesn't have enough DRAM. For every 512GB in a Mac Studio, they could put those chips to 64 Macbook Neos^. Apple benefits enormously from on device AI (sells hardware) and prominently features
304.
by dannyw 3mo ago
LLM outputs do not have copyright protection in the US, there is no copyright element here.
305.
by dannyw 3mo ago
What censorship? ;) https://github.com/p-e-w/heretic
306.
by dannyw 3mo ago
I like my Apache 2.0 licensed Gemma, and NVIDIA’s Nemotrons are decent bases for finetuning or continued pretraining, esp thanks to good documentation and tooling. Oh, and Mira’s thinking machines lab dropped Inkling, a ~1T open weight mode
307.
by dannyw 3mo ago
Qwen3.6 is still the best agentic open weight LLM around 30b params (Gemma isn’t very good at agentic execution). I also find the model is a lot more predictable and less “glitchy” when made to think in Chinese. You can do this in the syste
308.
by dannyw 3mo ago
In China, you can’t officially use US APIs. The world saw a taste of this with Fable, but in China, this has been the situation all along. So it’s not a surprise why open weights are so cherished. As frontier models continue to block everyd
309.
by dannyw 3mo ago
There were a few tweets about it so they weren't super quiet about it. I think you can get it back by setting `model_context_window=YOUR_VALUE` in ~/.codex/config.toml though.
310.
by dannyw 3mo ago
Empirically it is quite easy to validate that the "20x" plan is misleading and only give you twice the weekly limits of the "5x" plan, and many people on r/ClaudeAI, etc can verify that. Anthropic is also the one of
311.
by dannyw 3mo ago
Wikipedia at least has a culture where (most of the time) if you’re objectively rude or mean, especially to newbies, you’re at least shunned a bit. Strict moderation etc isn’t a bad thing, but the environment and culture you mould is what m
312.
by dannyw 3mo ago
Doesn’t WMF hold hundreds of million and growing on their foundation balance sheet, and raise $150M+/year through donations when hosting expenses are $4M/year? Obviously they need staff and more costs than just hosting, but someth
313.
by dannyw 3mo ago
In my opinion, the main thing was toxic moderation and the general lack of effort in creating a welcoming or constructive environment. Moderation and community accessibility can exist. I think your points have described the early SO, but mo
314.
by dannyw 3mo ago
ARC AGI 3 is much better designed and harder, perfectly completable by a human in a couple minutes. Only a fraction of the games can be solved by Sol, generally at sub-human efficiency in terms of turns, AND at a cost of >$10,000 per gam
315.
by dannyw 3mo ago
Wait, the user asked for a SVG of a pelican riding a bicycle. That doesn’t make sense, and I need to think about whether this is a legitimate request. The user is asking to to generate an innocent and mundane graphic, possibly as part of a
316.
by dannyw 3mo ago
K3 is very different to K2, I wouldn't be surprised if there are different system prompts, parsing templates, etc; which confuse/poision the model's context.
317.
by dannyw 3mo ago
At least ~2 weeks as the mystery model in TextArena turned out to be Kimi K3.
318.
by dannyw 3mo ago
It might one prompt, but modern LLMs only really shine in agentic loop harnesses (e.g. Kimi Work, Cowork, etc). The OS demo was produced with 1 prompt in an agentic loop in Kimi Work.
319.
by dannyw 3mo ago
Probably all of them? On modern versions, Gatekeeper still adds a bunch of milliseconds and possibly a RTT network request to Apple before the first launch of many apps; although I think Apple's binary checking is cached for 24 hrs or
320.
by dannyw 3mo ago
This is a tech demo / proof of concept, promoting the SDK or whatever they're selling (PocketJS). It's for game developers, not gamers. They've written a reasonably non-trivial 3D game in TypeScript and got it running on
321.
by dannyw 3mo ago
Well, with the actions of the US government, for every business that does not exclusively operate in the US, they have now added _supplier risk_ to US companies. Even as a paying customer, even as an enterprise, your access to US models may
322.
by dannyw 3mo ago
We're looking at a MoE with 50B active params, each inference pass only requires the compute of a 50B dense model.
323.
by dannyw 3mo ago
Yeah, "experts" is a ML/research word for this (MoE was first published in 1991; and has been around for a long time, it even predates deep learning). it's not the everyday/colloquial meaning of 'expert'.
324.
by dannyw 3mo ago
I've found much better luck giving it an audit check-list, including some steers like: are there any visual glitches or SVG bugs, are the colours consistent, etc.
325.
by dannyw 3mo ago
Gamers Nexus has a good video where his team travelled to China and did some actual investigative journalism: https://www.youtube.com/watch?v=1H3xQaf7BFI Firstly, the export-restricted GB202s (e.g. 5090, RTX 6000 Pro Blackw
326.
by dannyw 3mo ago
I'm confident we will continue to see improvements in edge models at minimum. For example, Google has a vested interest in making Gemma as good as it can, because ultimately any edge inference is free for Google and they have a massive
327.
by dannyw 3mo ago
If you have a naive loop like this you will quickly poison your dataset with e.g. thumbs downs because someone is unhappy with the latest frontend update, or teach models to not correctly refuse. I’m sure the pipeline is more sophisticated
328.
by dannyw 3mo ago
Actually it does for a massive model, serving it correctly is not easy. I believe Kimi also does some sort of Q&A and eval for day 0 partners, since early on a long of inference providers just weren’t running their models properly.
329.
by dannyw 3mo ago
This is nonsensical AI slop with so many technical mistakes.
330.
by dannyw 3mo ago
24 kWh free for the three hours seems like a reasonable amount anyway.

More ›