hashmap

6 ms·

61.
by hashmap 5mo ago
this landed precisely on like 3 weird bugs ive been hitting and solving in different stupid ways for dealing with things like sgd collapsing too many good answers into one bad answer, and gave me a real direction to try to fix the link miss
62.
by hashmap 5mo ago
> If Apple could make money from removable batteries, meaning there was a market for it and people wanted it over some other alternative, are you suggesting they are not smart enough to do the research and work necessary to accomplish th
63.
by hashmap 5mo ago
that isnt how markets really work. you could say that if apple had two otherwise identical iphones except one has removable battery and one doesn't. but the enshittification cycle works via a ratcheting effect. once you achieve a certa
64.
by hashmap 5mo ago
Yeah, softmax may have useful applications, but anytime you find yourself using the same hammer for everything that looks like a nail it's a bit of a red flag. If you take instances of softmax that you find in training / inference
65.
by hashmap 5mo ago
Much easier. > easier than identifying text distilled from the words of almost everyone alive. Well, there's more than that going on. AI generated text encodes a high-dimension navigational trajectory that guides the model through i
66.
by hashmap 5mo ago
working to directly advance a product used substantially to oppress people via surveillance or war crimes, when you have many other choices, is immoral. easy.
67.
by hashmap 5mo ago
Oh, yeah $12k would not do it. For a UBI to work we would have to shift a significant portion of the concentrated wealth. I too was laid off long enough ago that by now I would be in a bad spot without help, also no mortgage or anything, an
68.
by hashmap 5mo ago
It does, and it should. With each iteration getting closer to the goalposts exposes the flaws in the goalposts, and then you try to make better goalposts. The problem people seem to have with the goalposts moving is they assume the goalpost
69.
by hashmap 5mo ago
You never see it how. Like in terms of raw resources or political will?
70.
by hashmap 5mo ago
if the original problem happened because it ignored something you told it, telling it to not ignore something is a category error. the determinism isn't added by the message you're sending it, it's in the enforcement mechanis
71.
by hashmap 5mo ago
> The language they do best with is the one with the largest corpus in the training set. Not the case, strangely. They do best with Elixir. https://arxiv.org/pdf/2508.09101
72.
by hashmap 6mo ago
if you think datacenters are a waste (they are), wait til you hear about department of war spending
73.
by hashmap 6mo ago
well yes and no, i meant https://en.wikipedia.org/wiki/Orthogonal_Procrustes_problem which, yes, is named for that stretchster
74.
by hashmap 6mo ago
The native way to skip all that is train a small thingy to map hidden state -> token/thingy you care about once per model family, or just do it once and procrustes over the state from the model you're using to whatever you made
75.
by hashmap 6mo ago
at certain scales, reality has to win out over whatever ideal you have in your head about how things should be. facebook is massive, a lot of society is on it, and its a problem to make recourse invisible to people most affected by the thin
76.
by hashmap 6mo ago
yann lecun has been saying this for years. but its not a language really its an abstract geometric representation. so similar semantic meanings of sentences in different languages land in the same place in different models, just rotated.
77.
by hashmap 7mo ago
adhd'er here too. maybe the practice is good, but it takes a lot of energy, which is finite. i find that leaning on my strengths gets me far, far better results than trying to get up to par with everyone else on things im bad at. if a
78.
by hashmap 7mo ago
if something like a popup appears that i didnt ask the page to do i snap close the page and never look at it again
79.
by hashmap 7mo ago
oh neat ill check that one out. i dont get that much speedup from ssd/128gb unified vs vram if im doing like a predefined set of prompts, since i have it load it from disk anyway and im just doing one forward pass per prompt, and just
80.
by hashmap 7mo ago
this is neat but to me seems like the circuitous path to just skipping autoregression, whereas the direct path is to just not do autoregression. get your answers from the one forward pass, and instead of backprop just do lookups and updates
81.
by hashmap 7mo ago
im kind of wondering like what the ceiling would be on reasoning for something like the 1.5T models with the repeating technique, but they would take a long time to download. i think if you have them already it would take maybe an hour or s
82.
by hashmap 7mo ago
dude thats sick! i tried it out and it works. theres a couple layers in there that are part of the voidy block that doesnt do much for the selected answer, so i narrowed it down to L48-53 where this model is mapping out its reasoning strate
83.
by hashmap 7mo ago
i literally suggested this metaphor earlier yesterday to someone trying to get agents to do stuff they wanted, that they had to set up their guardrails in a way that you can let the agents do what they're good at, and you'll get b
84.
by hashmap 7mo ago
these sort-of-lies might help: think of the latent space inside the model like a topological map, and when you give it a prompt, you're dropping a ball at a certain point above the ground, and gravity pulls it along the surface until i
85.
by hashmap 8mo ago
Yeah, that's more or less what I'm getting at.
86.
by hashmap 8mo ago
I can sort of see one angle for it, and the parent story kind of supports it. Bad software is a forcing function for good hardware - the worse that software has gotten in the past few decades the better hardware has had to get to support it
87.
by hashmap 8mo ago
if im not sitting on my right foot with left knee under my chin my thinking takes a hit, but i also have to constantly switch how im sitting so i dont get annoyed. its hard not to slouch/melt into whatever im sitting on and i think the
88.
by hashmap 9mo ago
"DEI" is an inherent part of the system - being "against DEI" is simply a statement about what kind of "DEI" you actually want.
89.
by hashmap 10mo ago
I do like the look of this! It seems like it nicely provides that without like kicking you into React, which I have ended up having to draw a hard line against in development after my first couple experiences not only with it, but how the d
90.
by hashmap 10mo ago
> GraphQL isn’t bad. It’s just niche. And you probably don’t need it. > Especially if your architecture already solved the problem it was designed for. What I need is to not want to fall over dead. REST makes me want to fall over dead

More ›