chpatrick

8 ms·

121.
by chpatrick 9mo ago
This has been happening for decades in the UK and the US regardless of the regime.
122.
by chpatrick 9mo ago
I think that definition is pretty obsolete for the last 20 years. To me "AI" is machine learning, statistical algorithms trained on data. That's not true for Lean.
123.
by chpatrick 9mo ago
Consumer local AI? Maybe. On the other hand everyone non-technical I know under 40 uses LLMs and my 74 year old dad just started using ChatGPT. You could use a search engine and hope someone answered a close enough question (and wade throug
124.
by chpatrick 9mo ago
I've been buying LPs after concerts just to have a nice souvenir, I can always listen to them on Spotify. I only just got a turntable this Christmas and it's cool to actually listen to them.
125.
by chpatrick 9mo ago
I know, it's just very unergonomic.
126.
by chpatrick 9mo ago
https://developer.mozilla.org/en-US/docs/Web/JavaScript/Refe...
127.
by chpatrick 9mo ago
Its type system is miles better than Python and it has some basic stuff Python doesn't have like block scope. Functional programming is also intentionally kind of a pain in Python with the limited lambdas. If TypeScript had the awesome
128.
by chpatrick 9mo ago
I went to a top university and most people's mental health was definitely in the gutter so I think it is worth talking about it.
129.
Roman Dodecahedron(en.wikipedia.org)
3 points by chpatrick 9mo ago|0 comments
130.
by chpatrick 9mo ago
Because FFmpeg is a swiss army knife with a million blades and I don't think any easy interface is really going to do the job well. It's a great LLM use case.
131.
by chpatrick 9mo ago
Common Side Effects anyone?
132.
by chpatrick 10mo ago
All of my non techy friends use it, it's the new search engine. I think at this point people refusing to use it are the echo chamber.
133.
by chpatrick 10mo ago
They only have the previous path in as much as n-gram Markov text generators have the previous path.
134.
by chpatrick 10mo ago
By that definition n-gram Markov chain text generators also include previous state because you always put the last n grams. :) It's exactly the same situation as LLMs, just with higher, but still fixed n.
135.
by chpatrick 10mo ago
> Sure, a LLM is a "markov chain" of state space size (# tokens)^(context length), at minimum. Okay, so we're agreed.
136.
by chpatrick 10mo ago
I think you're confusing Markov chains and "Markov chain text generators". A Markov chain is a mathematical structure where the probabilities of going to the next state only depend on the current state and not the previous pa
137.
by chpatrick 10mo ago
The KV cache doesn't affect it because it's just an optimization. LLMs are stateless and don't take any other input than a fixed block of text. They don't have memory, which is the requirement for a Markov chain.
138.
by chpatrick 10mo ago
It's not n sometimes, k tokens some other times. LLMs have fixed context windows, you just sometimes have less text so it's not full. They're pure functions from a fixed size block of text to a probability distribution of the
139.
by chpatrick 10mo ago
I'm not saying it's an n-gram Markov model or that you should store them as a lookup table. Markov models are just a mathematical concept that don't say anything about storage, just that the state change probabilities are a p
140.
by chpatrick 10mo ago
Sure many things can be modelled as Markov chains, which is why they're useful. But it's a mathematical model so there's no bound on how big the state is allowed to be. The only requirement is that all you need is the current
141.
by chpatrick 10mo ago
Not sure why that's contorting, a markov model is anything where you know the probability of going from state A to state B. The state can be anything. When it's text generation the state is previous text to text with an extra char
142.
by chpatrick 10mo ago
Then they'll be able to use those datacenters much more efficiently.
143.
by chpatrick 10mo ago
Sure, the type system isn't perfect but it still beats 90% of mainstream languages in use today.
144.
by chpatrick 10mo ago
Everything is already written in JavaScript. If we had WASM from the start and dozens of languages with different APIs we wouldn't be better off.
145.
by chpatrick 10mo ago
TypeScript is a really decent language though, I wouldn't feel happier or more productive using Fortran or whatever. Its type system is actually really powerful which is what matters when it comes to avoiding bugs, and it's easy t
146.
by chpatrick 11mo ago
And a dev board only costs a couple of dollars on AliExpress.
147.
by chpatrick 11mo ago
It's also kind of an impossible request given that AI tools are for generic unpredictable input.
148.
by chpatrick 11mo ago
What does deterministic mean in this case?
149.
by chpatrick 11mo ago
Why are they nondeterministic? You can use a fixed seed or temperature=0.
150.
by chpatrick 11mo ago
Sufficiently smart auto complete is indistinguishable from thinking, I don't think that means anything.

More ›