astrange

28 ms·

571.
by astrange 11mo ago
The difference is there are exponentially more states than an n-gram model. It's really not the same thing at all. An LLM can perform nearly arbitrary computation inside its fixed-size memory. https://arxiv.org/abs&#x2F
572.
by astrange 11mo ago
If you mean FEAT_FlagM, that's standard in ARMv8.4. (There's also FlagM2 and AFP that are optional.) The JavaScript instruction is cooler though. https://developer.arm.com/documentation/dui0801/g/A64
573.
by astrange 11mo ago
It's not only present in Apple Silicon, it's just not required by the ARM standard. Fujitsu also has an ARM64 CPU with TSO.
574.
by astrange 11mo ago
What accessibility is it missing?
575.
by astrange 11mo ago
The tradeoff is you can't change anything if anything goes wrong.
576.
by astrange 11mo ago
An LLM is not a Markov chain of the input tokens, because it has internal computational state (the KV cache and residuals). An LLM is a Markov process if you include its entire state, but that's a pretty degenerate definition.
577.
by astrange 11mo ago
> This is entirely different from saying it can only reproduce samples which it was trained on. It is not a memory machine that is surgically piecing together snippets of memorized samples. (That would be a mind bogglingly impressive mac
578.
by astrange 11mo ago
> Edit: to clarify further as to what I want to know: people have been telling me that LLMs cannot solve problems that is not in their training data already. Is this really true or not? That is not true and those people are dumb. You may
579.
by astrange 11mo ago
The one that annoys me is that people think implicit type conversions are dangerous for some reason, so they also disallowed `char a = 10; short b = a;` without writing a cast even though this makes no sense.
580.
by astrange 11mo ago
They don't usually touch the reserve. They tell a bigger bank to buy them over the weekend and back it up. Afterwards they can use that, charge the other member banks or reopen: https://www.federalreserve.gov/financial-
581.
by astrange 11mo ago
Up to $250k per account yes. The bank would fail but you'd get it over the weekend.
582.
by astrange 11mo ago
Making your own stuff is definitely not always economically better. Google has the same supplier cost pressure as Nvidia for DRAM, fabs, etc.
583.
by astrange 11mo ago
You can also do it by buying risky stocks and pretending you're buying alpha!
584.
by astrange 11mo ago
It mostly does. Treasuries are a kind of dollar.
585.
by astrange 11mo ago
The data is everything you've ever heard of, and obviously contains things you wouldn't show to children, since that'd include NYT war journalism stories.
586.
by astrange 11mo ago
LLMs don't make typos.
587.
by astrange 11mo ago
Sonnet-4.5 has the lowest self esteem of any model I've used. Gemini frequently argues with me.
588.
by astrange 11mo ago
> their fash series Unfortunate typo.
589.
by astrange 11mo ago
> How about hundreds of thousands of factory workers that are being subjected to inhumane conditions to assemble iPhones each year? That would be bad if it happened, which is why it doesn't happen. Working in a factory isn't an
590.
by astrange 11mo ago
> laundering cobalt from illegal "artisanal" mines in the DRC They don't, all cobalt in Apple products is recycled. > and whitewashing what they do by using corporate layering and shady deals to put themselves at suffic
591.
by astrange 11mo ago
Google? Push wages down? Google is mostly known for paying top of market to keep a zoo of engineers whose only output is blog posts about how smart they are because they solved a problem they also caused. (presumably because if they touch t
592.
by astrange 11mo ago
You'd also have no intrinsic memory of past interactions if we removed your hippocampus. Coincidentally, the hippocampus looks like a seahorse (emoji). It's all connected.
593.
by astrange 11mo ago
We would say "We're working on Paperclip."
594.
by astrange 11mo ago
https://en.wikipedia.org/wiki/Psychology#WEIRD_bias
595.
by astrange 11mo ago
I don't mean codenames. I mean literally saying the word "project". It's like meeting a friend and saying "hello my friend I've known for the last 20 years".
596.
by astrange 11mo ago
> Project Gemini I have a theory that the idea you'd call your project "Project X" comes from TV shows. We work with project codenames and we don't call anything Project X. We just call it X. It feels like adding the
597.
by astrange 11mo ago
It's technology. Specifically communications technology.
598.
by astrange 11mo ago
Mostly by being retired. Boomers with 401ks are not generally what people mean by "power and money".
599.
by astrange 11mo ago
I've been told by people running Qwen locally in production that they'll have downtime incidents if it's required to think about anything with any implication that Taiwan is a separate country.
600.
by astrange 11mo ago
> but at the end of the day "the corporation" is still motivated by profit. OpenAI and Anthropic are both PBCs. So neither of them are supposedly purely motivated by this thing.

More ›