cheald

10 ms·

91.
by cheald 2y ago
Another way to look at that time series is that US debt as a percentage of GDP has doubled from 62% to 121% since 2007. https://fred.stlouisfed.org/series/GFDEGDQ188S
92.
by cheald 2y ago
We're the product of all the information we consume, but forums like HN aren't custom-tailoring what I'm shown to maximize engagement from me.
93.
by cheald 2y ago
It might be somewhat prohibitive to print the model weights for any sufficiently large model, though.
94.
by cheald 2y ago
Given that they were made immediately after and in response to the shooting of the United Healthcare CEO, it requires some fairly lithe mental gymnastics to not interpret them as an effective call for murder.
95.
by cheald 2y ago
Au contraire, I wear very large shoes, so my step size becomes a limiting factor at some point.
96.
by cheald 2y ago
I don't think that's true at all. 2FA has been a popular solution for many years, well before the addition of TOTP support to the popular password managers.
97.
by cheald 2y ago
Which is precisely why it's irresponsible to give people the rope to hang themselves with by supporting 2FA seeds in password managers (much less telling them it's a good idea), IMO. People take the path of least resistance; we kn
98.
by cheald 2y ago
I think it's a terrible idea, because it dramatically decreases the attack surface area needed to compromise accounts. 2FA is supposed to be "something you know' and "something you have"; putting your 2FA seeds in
99.
by cheald 2y ago
As an experiment, I tried implementing this for Stable Diffusion lora training, where I'm training on a single GPU with a batch size of 8, and it does actually seem to have an appreciable impact. In my case, I'm keeping a per-para
100.
by cheald 2y ago
This is specifically why I caution people against trusting OpenAI's "we won't train on your data" checkbox. They are specifically financially incentivized to do so, and have a demonstrated history of saying the nice,
101.
by cheald 2y ago
OpenAI's also in the position of having to compete against other LLM trainers - including the open-weights Llama models and their community derivatives, which have been able to do extremely well with a tiny fraction of OpenAI's re
102.
by cheald 2y ago
LLMs have been very useful for me in explorations of linear algebra, because I can have an idea and say "what's this operation called?" or "how do I go from this thing to that thing?", and it'll give me the mec
103.
by cheald 2y ago
You can just run Docker containers as `--u $UID:$GID`, presuming the docker container isn't set up in such a way that it's hostile to its contents being executed by a non-root user. Usually this just means ensuring that you don&#x
104.
by cheald 2y ago
The niche I've found for LLMs is for implementing individual functions and unit tests. I'll define an interface and a return (or a test name and expectation) and say "this is what I want this to do", and let the LLM take
105.
by cheald 2y ago
The first couple of seasons are a little rocky, but once it established its own cast of characters and mythos, it really became something special.
106.
by cheald 2y ago
I've done a lot of tinkering with the internals of LoRA training, specifically investigating why fine-tune and LoRA training result in such different results, and I'm no academic, but I have found that there are definitely some is
107.
by cheald 2y ago
+1 to all of this. The thing I'd add is that we use barman for our additional replicas; WAL streaming is very easy to do with Barman, and we stream to two backups (one onsite, one offsite). The only real costs are bandwidth and disk sp
108.
by cheald 2y ago
I'm sure that we could find ways to draw the same conclusions from social media and always-on connections in peoples' pockets, but study after study shows that we're lonelier than we've ever been. Maybe we should just s
109.
by cheald 2y ago
Yes, it's all the strings per language, for the SPA. We also have services which we can use to request a bundle of strings from the backend, which I guess could in theory be an avenue for JIT translation on the frontend, but so far the
110.
by cheald 2y ago
We do actually have per-language code splitting with React/Vite. We essentially just have a map of [language, loader], where the loader utilizes lazy imports. Vite is smart enough to split those all out of the main bundle and they get
111.
by cheald 2y ago
"Check fraud" isn't exactly a "glitch". This "works" because of a concession made to the customer to allow them to access funds before they're verified, because checks can take weeks to clear. It&#x27
112.
by cheald 2y ago
The absolutely killer feature of the Chromecast is that I can have guests over (or be visiting someone), and anyone can stream any content they're authorized for. Movies I've bought can be watched anywhere there's a Chromecas
113.
by cheald 2y ago
Last I looked, there was essentially no good programmatic route into local Nest control, unlike most home automation devices which use wifi/bluetooth/zwave/zigbee. I replaced my Nests with a couple of $25 Centralite Zigbee t
114.
by cheald 2y ago
Given that any of these bad actors can spin up local inference infrastructure to run their operations pretty trivially, what practical effect does this have beyond just "hey, look, we're doing something"?
115.
by cheald 2y ago
It seems like a whole bunch of unnecessarily liability. Once you place yourself in the position of moderator of what people may use their computers for, you are arguably liable for failures of moderation. To put it another way, nobody'
116.
by cheald 2y ago
FWIW, I've gotten in the habit of using Zotero ( https://www.zotero.org/ ) with a browser extension to do this. If I read something that I think I might want to reference later, I just hit an extension button and it gets
117.
by cheald 2y ago
It's worse than that, because lora requires two matrices per layer. At full rank, you have an additional NxN parameters to learn versus full finetuning, where N is min(input_features, output_features). For example, tuning a layer of 12
118.
by cheald 2y ago
"Make an argument for a fact you know to be wrong" isn't an exercise in lying, though. If anything, the ability to explore hypotheticals and thought experiments - even when they are plainly wrong - is closer to a mark of inte
119.
by cheald 2y ago
AFAIK, the "use" convention is just a convention used to indicate that you're dealing with something that is plugged into React's state management system, and is going to deal with some kind of state change that can caus
120.
by cheald 2y ago
Well, naturally, but neural nets are pretty good at feature extraction even in the presence of noise. I also just printed out his unblurred example at a scale approximating a real logo and took a photo of it. Came out just fine.

More ›