rcxdude

11 ms·

271.
by rcxdude 2mo ago
My mental model of LLMs is as a contractor you've just brought in, every time. They might be very capable but they're starting from scratch on your particular project.
272.
by rcxdude 2mo ago
It would not surprise me if it came up at some point in the long and tedious process of public consultations and planning permissions that such projects need to go through (basically anyone can write in to comment/object on such things
273.
by rcxdude 2mo ago
UK law can be quite intertwined with the church in a lot of cases, so I wouldn't want to confidently say this wouldn't turn up somehow. And churches are also pretty likely to be listed, anyhow. (It could also turn up as part of th
274.
by rcxdude 2mo ago
They didn't say the location contained them, just that it was associated with them, which obviously it is for at least some fraction of the population.
275.
by rcxdude 2mo ago
When I've heard the distinction (often in a historical context), 'nation' is usually meant to mean a set of people in a place with some sense of collective identity or origin, while 'state' is the governing body whi
276.
by rcxdude 2mo ago
Culture is part of the system, and probably one of the harder parts to change.
277.
by rcxdude 2mo ago
This might be a useful attitude to have individually but it's not really a plan of how to solve the systemic issue.
278.
by rcxdude 2mo ago
Question is why was this the case? I feel a natural explanation is it's a reaction to there being less people around on account of the huge number of deaths, in which case there's probably little reason to worry: if birth rate inc
279.
by rcxdude 2mo ago
I think probably things along the lines of what's been called the 'cozy web': networks of smaller groups that don't publish to or expect responses from effectively the entire internet as a whole. (This kind of thing has
280.
by rcxdude 2mo ago
From their phrasing I don't think the reward they're looking for is financial: more the emotional reward of knowing that someone else appreciated their ideas. I dunno how much less likely this is in the age of LLMs, though.
281.
by rcxdude 2mo ago
Scam might be too strong a word but it certainly has far higher false positive rates than they are claiming, and their output is at best misleadingly presented: https://freddiedeboer.substack.com/p/i-wouldnt-say-pangram
282.
by rcxdude 2mo ago
It essentially looks like the difference between two different runs of the model with the same prompt but different seeds. The watermark is essentially a small bias in the model such that when there's multiple different tokens that cou
283.
by rcxdude 2mo ago
It's obviously significantly better than brute force. A trillion is absolutely minuscule compared to the size of the search space (like, 'rounding down to 1 is basically the same' small).
284.
by rcxdude 2mo ago
The people who refer to LLMs as stochastic parrots generally do so to imply significant limits on an LLMs ability, not as an abstract statement about the underlying mechanism of how they work. Probably the defining thing that is surprising
285.
by rcxdude 2mo ago
Yup, it has the fun property that you'll get the same error in your estimate of the mean regardless of averaging time (though since it's not stationary this isn't even really that well defined). (though of course, a random wa
286.
by rcxdude 2mo ago
Yeah. pink noise is often confused with white noise in audio because it looks flat on a lot of equaliser displayers (because they show energy per octave instead of energy per Hz).
287.
by rcxdude 2mo ago
Pink noise is also perceptually flat noise, because it contains the same energy in each octave (or decade). 'truly' white noise (equal energy for equal bandwidth) tends to sound quite tinny/hissy in comparison.
288.
by rcxdude 2mo ago
LLM coding assistants have a bias towards writing standalone implementations instead of pulling in libraries to do a job, which does tend to sidestep probably the most common cause of bloated software: pulling in too many layers of abstract
289.
by rcxdude 2mo ago
Every comment without an /s at the end is definitely 100% serious and unironic.
290.
by rcxdude 2mo ago
It's not completely unexplained. Roughly speaking you can get that power spectrum in the limit when you are adding up many different events where the magnitude of the event is inversely proportional to its likelihood (and in practice,
291.
by rcxdude 2mo ago
I remember there were some complaints about the puzzle sections in a recent-ish God of War game where they had clearly tried to avoid this problem but by essentially having NPCs spontaneously tell you the solution to the puzzle at some poin
292.
by rcxdude 2mo ago
I think automatic global matchmaking is a bit of a cursed problem because how people want to play a game is multidimensional beyond just their skill level at the game, it may change from session to session, and some players are incentivized
293.
by rcxdude 2mo ago
I think it strongly depends on how it's done and how it plays into the feeling of the game. Certain kinds of level scaling can feel pretty cheap, for example, because they kind of work against the feeling of progression you get in the
294.
by rcxdude 2mo ago
It is frustrating that instead of fixing existing, fairly simple interfaces, web tech seems to instead create complicated and harder to use interfaces which are more likely to be used incorrectly or at least inconsistently. It feels like it
295.
by rcxdude 2mo ago
I feel like it's most useful to get in a bit of a groove with one setup and then poke your head up every now and again and try updating. Staying at the bleeding edge of anything can be a bit of a treadmill.
296.
by rcxdude 2mo ago
Eh, the requirement to return your work-provided laptop is about as strong, legally speaking, as a requirement to pay back the value of it when you leave. Perhaps even stronger (because a work laptop is never really even a loan to you). I w
297.
by rcxdude 2mo ago
The residential proxy operators are also not often within easy reach of western justice systems. Fines for torrenting movies are targeted against end users within the countries (and also not exactly effective, either, because the issue is q
298.
by rcxdude 2mo ago
This is true but lithium-ion batteries degrade even while not being charged or discharged, and this is worse at the extremes of the state of charge (including fully charged), and at higher temperature (and often a plugged in device is on co
299.
by rcxdude 2mo ago
Well, why run both a well-behaved, easily identifiable bot that probably already gets them all the data they need (they seem to be spending most of their time and money on getting higher quality data than your average internet scrape), and
300.
by rcxdude 2mo ago
A buggy big ball of mud that does mostly the right thing is still going to beat a high-quality, carefully architected solution that reliably does the wrong thing, though. And for a huge amount of code, it's not very hard to make it goo

More ›