sdenton4

50 ms·

901.
by sdenton4 3y ago
It's complicated! My bet would be less on individual species slowly adapting, and more on mass extinction and re-specialization. When there's a big shock, specialists have a harder time, and generalist species have an edge. So, wh
902.
by sdenton4 3y ago
The sequence of model activations is being compressed. s4 treats each activation channel as an independent sequence, and applies a learned version of the Laplace transform, and drops less-significant components. This is similar to basic com
903.
by sdenton4 3y ago
How could you do anything intelligent without a strong beak? https://falseknees.tumblr.com/post/654380023602708480 The interactivity I mentioned is the bit that I think is actually important from embodiment - the abili
904.
by sdenton4 3y ago
I don't think it's obvious that we don't have sufficient computational scale already... The human brain has ~86 billion neurons, but they only fire at like 2Hz, so you get 192 billion firings per second. GPT-3 has 175 billion
905.
by sdenton4 3y ago
The Neveryon books and 'Times Square Red, Times Square Blue' are my favorite Delany. My introduction to Delany was randomly stumbling on the first Neveryon book in the stacks of a university library, being intrigued by the (wholly
906.
by sdenton4 3y ago
The work out of that group, starting with S4 layers, is 10000% the stuff to be paying attention to. https://srush.github.io/annotated-s4/ HiPPO was brilliant - instead of working with the raw sequence, you work with it
907.
by sdenton4 3y ago
And yet the military regularly hands machine guns to 18 year-olds...
908.
by sdenton4 3y ago
There's usually some description of why a game is marked playable, I think by clicking on the yellow symbol you'll get the lost of reasons. The most common reasons are requires using the on-screen keyboard and small fonts. Some pl
909.
by sdenton4 3y ago
Ha. Human problems never get fixed, just moved around. There's nothing new to help get the racism or of the justice system - a core piece of the problem is that there are only disincentives for mercy and no checks whatsoever on individ
910.
by sdenton4 3y ago
Meanwhile, human judges, juries, parole boards, etc are racist as hell and have no update algorithm...
911.
by sdenton4 3y ago
I've seen some indication that this is a measurement problem. Tech enables computers to do things that would be originally expensive for humans to do. Translation is an interesting example: some labor has been displaced, but not nearly
912.
by sdenton4 3y ago
I don't even know that it's even raw genius - our brains are full of 'ape shit' which at times includes close attention to hierarchy. Seems likely to be a combination of charisma, ape-dominance, and enough smarts to be a
913.
by sdenton4 3y ago
I have never owned a car. As a result, I look at each trip and think about the best way to accomplish it. Usually the optimum in terms of cost is by bicycle, or by bringing my bike with me on a transit connection. If I'm short on time,
914.
by sdenton4 3y ago
Calling I/o side effects makes FP seem hopelessly academic. Everything having to do with the world is seemingly a corner case - the core of the programming philosophy is only concerned with the part where we push bits around uselessly.
915.
by sdenton4 3y ago
Yes, but the techniques are typically close guarded secrets, to keep the antagonists guessing.
916.
by sdenton4 3y ago
To correct the common misconception: Sometimes AI image generators insert a watermark because they have seen a lot of watermarks on certain kinds of images during training. This does not mean that the image itself is a copy of any particula
917.
by sdenton4 3y ago
Eh, of you spend five years not telling stories, you will be woefully out of practice as a writer, with an underdeveloped craft. You are how you spend your time - spending five years on an engine means that there are a lot of things that yo
918.
by sdenton4 3y ago
Greedflation, in other words...
919.
by sdenton4 3y ago
I'm a big fan of the Fibonacci base: https://en.m.wikipedia.org/wiki/Fibonacci_coding It has the nice property that it's a) binary, and b) each number contains a '11' substring at the end, but nowhe
920.
by sdenton4 3y ago
To be sure, the seq2seq style already allowed multi length embeddings before transformers were a thing. RNN vs Transformer is entirely an implementation choice; you can build a seq2seq model with any combination of transformer, RNN, and con
921.
by sdenton4 3y ago
To save folks a click, Decker is a hypercard clone which runs on Mac, Linux, and even Windows. https://internet-janitor.itch.io/decker
922.
by sdenton4 3y ago
Are you saying that there are 42 million homeless people in California? (10B / $6 / 4 quarters / 10 years) Edit: fwiw, assuming 115k homeless in California (which incidentally is 1/3 of the US total), we get $2,170/
923.
by sdenton4 3y ago
Can we "just" build a Mars space elevator? It should be free of a lot of the concerns an earth space elevator would have - no terrorists, no populated areas, rather less gravity.
924.
by sdenton4 3y ago
Don't put that finger in your ear - you don't know where that finger's been!
925.
by sdenton4 3y ago
I've been saying for years that the sun will eventually turn into a red giant and consume the earth. But every day a same-sized yellow disk rises in the Eastern sky. At what point should I change my mind?
926.
by sdenton4 3y ago
I had a couple phones I really liked where the battery got puffy - ie, very very bad - while the device was otherwise great. Tried replacing with an ifixit kit, but the screen got borked in the process. Total waste...
927.
by sdenton4 3y ago
There's a pile of work on multimodal inputs to LLMs, generally finding that less training data is needed as image (or other) data is added to training. Text is an extremely limited input stream, but an input stream nonetheless. We know
928.
by sdenton4 3y ago
Eh, print/log debugging works fine. Especially in an interactive environment: you've got direct access to the variables and objects, and can easily inspect them directly. At some point I felt like I was a bad dev for not using a d
929.
by sdenton4 3y ago
That could be more a question of the sensorium than brain structure, though... And whales might say something similar about us, that humans have a very complex society despite being seemingly unable to learn to speak coherently.
930.
by sdenton4 3y ago
Meanwhile, bare QR codes are ugly AF and draw the eye away from any other design... Things like this might lead to greater use.

More ›