s-macke

12 ms·

121.
by s-macke 2y ago
I know of one 2D version of this available on Shader Toy where you can immediately play around [0], but its speed is limited by the tooling available at Shader Toy. However, a quick search shows that this technique is already popular on the
122.
by s-macke 2y ago
WebAssembly programming is simply easier than GPU programming. My game here [0] 6 years ago uses WebAssembly with a Finite Difference approach for the fluid part. Nowadays, fixed-width SIMD [1] is standardized and supported in the browser.
123.
by s-macke 2y ago
I have realized that in my benchmarks [1]. Llama 3 was significantly better than Llama 3.1, which was puzzling. Then I realized, that I changed the provider. And the new one quantized Llama 3.1 with fp8. Then I tried Hyperbolic [2], because
124.
by s-macke 2y ago
Ok, then lets continue :-). This comic goes pretty deep. Cueball is godlike here, but actually is pretty limited in its own universe. But he has infinite time and space (and rocks) and hence unlimited energy. So that seems good enough for a
125.
by s-macke 2y ago
Every time I read about the simulation hypothesis, I think about a hypothetical implementation of it, especially the XKCD comic "A bunch of rocks" [1]. Can we communicate with the outside? Probably. Can we figure out the algorithm
126.
by s-macke 2y ago
Got it running. But it is a special setup. * NVIDIA Jetson AGX Orin Dev. Kit with 64 GB shared RAM. * Default configuration for flux-dev. (FP16, 50 steps) * 33GB GPU RAM usage. * 4 minutes 20 seconds per image at around 50 Watt power usage.
127.
OpenAI releases ChatGPT on your desktop for macOS(openai.com)
27 points by s-macke 2y ago|20 comments
128.
by s-macke 2y ago
BM25+Embedding and Embedding+BM25 is exactly the same and shows the commutative relation whether you start from keyword search or semantic search. For my tests, I used Ada-002. As data I used small news articles and no chunking and no prepr
129.
by s-macke 2y ago
You are talking about English, right? And only for searches without any special technical terms or abbreviations? Also my use case includes more than 20 languages. To find usable embeddings for all languages is next to impossible. However,
130.
by s-macke 2y ago
I find these discussions funny. For decades we had search engines based on the query terms (keywords). Then there were lots of discussions and some implementations to put a semantic search on top of it to improve the keyword search. A hybri
131.
Examination of Large Language Model Performance on Grade School Arithmetic(arxiv.org)
2 points by s-macke 2y ago|0 comments
132.
by s-macke 2y ago
Not here. The whole history of the moves fit in a context window of 8k. No RAG necessary.
133.
by s-macke 2y ago
Yes, exactly. All comparable. All struggle at the same point. This micro benchmark cannot show subtle differences.
134.
by s-macke 2y ago
Of course I have forced Claude to continue. But it seems, that Claude had everything forgotten from the bad ending. SITUATION: I have just woken up in a messy bedroom to a ringing phone. It seems I overslept after a difficult night, and the
135.
by s-macke 2y ago
Well, technically yes. Three models so far have managed to finish the first bad ending. But then it seems, all models fail at this specific point. I had hundred of reruns of exactly that bad ending and tried different prompting techniques.
136.
by s-macke 2y ago
Author here. Of course I have considered data contamination. Especially, because the repository is now one year old. If there are no transcripts elsewhere, they are now in this repository. So at some point I have to switch to another text a
137.
by s-macke 2y ago
Author here. Let's just say the game has two ends. But so far, no model in the second round has come up with the idea of looking under the bed. Claude 3 Opus was the closest.
138.
Llama3 is the first open model that can also win text adventures(github.com)
30 points by s-macke 2y ago|16 comments
139.
by s-macke 2y ago
We got RULER 3 days ago. https://arxiv.org/abs/2404.06654 https://github.com/hsiehjackson/RULER
140.
by s-macke 3y ago
We came a long way from the first synthetic singing voices. https://simulationcorner.net/SAM/sing.wav Edit: https://youtu.be/Rm4ZCGgzeeU?si=upK-qCMev8ZaibIa&t=222
141.
Java Microservices and the Battle for Stability Under High Load(blog.qaware.de)
2 points by s-macke 3y ago|0 comments
142.
by s-macke 3y ago
If you think the current APIs will stay that way, then you're right. But when they start offering dedicated chat instances or caching options, you could be back in the penny region. You probably need a couple GB to cache a conversation
143.
by s-macke 3y ago
Yes, that is the first "bad" ending. After that follow just the one relevant context clue and look under the bed. That might be already enough. I chose this game, because the game just helps you, at the every step, what you have t
144.
by s-macke 3y ago
The costs have dropped significantly months after I created the cost image. Now I use GPT-4 Turbo. This GPT-4 model understand how text adventures work and there is no need to give him known commands. Of course you try even more sophisticat
145.
by s-macke 3y ago
GPT-3 doesn't even manage the first few steps of the tested text adventure. And GPT-4 is not good at playing these adventures either. However, my code run a newer version of the Z-machine. So Zork and many other text adventures will wo
146.
by s-macke 3y ago
I didn't make text-adventures with LLMs. I try to solve them [0]. So, far, none of the 7 tested models were able to win even one of the easiest text adventures. I tried many prompting techniques. But only GPT-4 was able to play through
147.
by s-macke 3y ago
Here is my approach to reverse-engineer a DOS game: Starflight [1]. Actually, all the tools failed to disassemble the code and I had to write all tools myself. What I find most fascinating is that reverse engineering these kind of games is
148.
MambaByte: Token-Free Selective State Space Model(arxiv.org)
4 points by s-macke 3y ago|0 comments
149.
by s-macke 3y ago
Here is my list of my favorite channels: The best channel about AI - AI Explained: https://www.youtube.com/@aiexplained-official Papers and news about AI and computer graphics - Two Minute Papers: https://www.you
150.
Java Microservices and the Battle for Stability Under High Load(blog.qaware.de)
2 points by s-macke 3y ago|0 comments

More ›