salamo

9 ms·

61.
Ichthyoallyeinotoxism(en.wikipedia.org)
4 points by salamo 2y ago|0 comments
62.
by salamo 2y ago
Yes, I've noticed it this week as well. Simple errors like misspelling variable names.
63.
by salamo 2y ago
I've had pretty good success with BM25 + stemming, or even easier, BM25 with trigram tokenization. If the index isn't too big, the whole search can be done client-side and is lightning fast.
64.
by salamo 2y ago
If the game was small enough to memorize, like tic tac toe, you could definitely train a neural net to 100% accuracy. I've done it, it works. The problem is that for most of the interesting problems out there, it isn't possible to
65.
by salamo 2y ago
Search is almost certainly necessary, and I think the trillion dollar cluster maximalists probably need to talk to people who created superhuman chess engines that now can run on smartphones. Because one possibility is that someone figures
66.
What is the maximum rate of human progress?(fortressofdoors.com)
5 points by salamo 2y ago|1 comments
67.
by salamo 2y ago
I think there is. In this case we have to clarify that an optimal strategy can still lose due to random chance, so the optimal strategy will only be clear after some large number of games.
68.
by salamo 2y ago
I guess it depends on the purpose. As a query rewrite, these cover much more of the physical scene, but lack accuracy and specificity. A couple of issues. First, the model completely botches the "Trike" brotherhood to "Tike&q
69.
by salamo 2y ago
Not a mathematician, but I can imagine a few different things which make proofs much more difficult if we simply tried to map chess algorithms to theorem proving. In chess, each board position is a node in a game tree and the legal moves re
70.
by salamo 2y ago
They claim that the average score for humans is between 85% and 100%, so I think there's a disagreement on whether the test is actually too hard. Taking them at their word, if no existing model can score even half what the average huma
71.
by salamo 2y ago
This is super cool. I share Francois' intuition that the presently data-hungry learning paradigm is not only not generalizable but unsustainable: humans do not need 10,000 examples to tell the difference between cats and dogs, and the
72.
by salamo 2y ago
What transformers have taught us is that gobbling up the whole internet can get you pretty far, but it doesn't change the fundamentals. Hallucinations still are trivial [1] to elicit. On the other hand, transformers are a software brea
73.
by salamo 2y ago
Hopefully the military will aim to minimize civilian casualties.
74.
by salamo 2y ago
I decided a long time ago that my main audience will be myself in the future. A blog post is the output of a project which at a minimum forces me to organize my thoughts on something important, and usually involves getting my hands dirty to
75.
by salamo 2y ago
Not only can you not access your files, but you are voluntarily restarting your phone. It seems pretty secure to me!
76.
by salamo 2y ago
One day I checked top and noticed that I had a python process was using 60 GB of RAM. Slightly worrying. Turns out I had a jupyter notebook open from a week ago that was casually consuming 60 GB with a huge dict. So part of the reason may b
77.
by salamo 2y ago
Reminds me of GPT Zero, which gained a ton of attention despite marketing promises which are fundamentally impossible to keep.
78.
by salamo 2y ago
I found out the other day that zstd supports dictionary compression [0]. It's a pretty neat concept: you can "train" a dictionary on your corpus of text, and use this dictionary to compress subsequent documents. This is reall
79.
by salamo 2y ago
To fix your car, step 1 is to visit the Golden Gate Bridge, step 2 is to fix your car.
80.
by salamo 2y ago
I'm wondering if this might be a cleaner way to incorporate symbolic knowledge bases into the model. In other words, with RAG we have to retrieve entire passages and ask the generator to pick out the relevant bits. Instead of doing tha
81.
by salamo 2y ago
Absolutely. "Refusals" all seem to follow a similar direction in the LLM residual stream, so preventing the model from representing this direction prevents it from refusing. https://www.lesswrong.com/posts/jGu
82.
by salamo 2y ago
Is this GPT4-o not the same as the one available on the pro plan? I can access it now.
83.
by salamo 2y ago
The text is very visually appealing, but it still cannot draw chess boards properly. We may need to wait for AGI for that one.
84.
by salamo 2y ago
Yeah "AI complete" is a bit tongue-in-cheek but it is a fairly spectacular failure mode of every model I've tried.
85.
by salamo 2y ago
The first thing I will do when I get access to this is ask it to generate a realistic chess board. I have never gotten a decent looking chessboard with any image generator that doesn't have deformed pieces, the correct number of square
86.
by salamo 2y ago
Really cool, I really enjoy the "follow" feature. Unfortunately, the balls get stuck sometimes and I have to follow a different one. I guess a few bugs slipped through the mod queue.
87.
by salamo 2y ago
Neat demo. It seems like there may be a few things happening in tandem. I uploaded a picture of a forest and it came back with visually similar images. So the first thing it might be doing is some kind of KNN, and if the pictures have locat
88.
by salamo 3y ago
No, just chessmate.ai
89.
by salamo 3y ago
I've been waiting for a while for the tech to catch up, but it should be more or less possible now to use Whisper and an LLM to run a virtual assistant locally. Virtual assistants always seemed like a privacy nightmare to me so I never
90.
by salamo 3y ago
Chess.com is also definitely using an evaluation-centric definition to label moves as blunders. The issue is that this definition is also some function of the change in winning probability. > So what is a blunder for a strong player may

More ›