michalsustr

7 ms·

61.
by michalsustr 1y ago
I'm not working on game-related topics lately, I'm in the industry now (algo-trading) and also little bit out of touch. > Has there been any meaningful progress after that? There are attempts [0] at making the algorithms work f
62.
by michalsustr 1y ago
I agree it is possible to build an LLM to play poker, with appropriate tool calling, in principle. I think it's useful to distinguish what LLMs can do in a) theory, b) non-LLM approaches we know work and c) how to do it with LLMs. In a
63.
by michalsustr 1y ago
In multi-player you don't have guarantees, but it tends to work well anyway: https://www.science.org/doi/full/10.1126/science.aay2400
64.
by michalsustr 1y ago
Humans are very bad at random number generation as well. LLMs can do sampling via external tools, but as I wrote in other thread, they can't do this in "token space". I'd be curious to see a demonstration of sampling of
65.
by michalsustr 1y ago
> It's not that the algorithm is currently not known but it's the nature of the game that deterministic equilibrium strategies don't exist for anything but most trivial games. Thanks for making this more precise. Generally
66.
by michalsustr 1y ago
Agreed. I don't know how fast it would get into the money, but an equilibrium strategy is guaranteed to not lose, in expectation. So as long as the variance doesn't make it to run out of money, over the long run it should collect
67.
by michalsustr 1y ago
This is the citation for [0]: Sparsified Linear Programming for Zero-Sum Equilibrium Finding https://arxiv.org/pdf/2006.03451
68.
by michalsustr 1y ago
I agree, but they should come up with the distribution as well. If you directly give the distribution to the LLM, it is not doing anything interesting. It is just sampling from the strategy you tell it to play.
69.
by michalsustr 1y ago
The tournament measures the cumulative winnings. However, those can be far from the statistical expectation due to the variance of card distribution in poker. To establish a real winner, you need to play many games: > As seen in the Clau
70.
by michalsustr 1y ago
I have PhD in algorithmic game theory and worked on poker. 1) There are currently no algorithms that can compute deterministic equilibrium strategies [0]. Therefore, mixed (randomized) strategies must be used for professional-level play or
71.
by michalsustr 1y ago
Interserver. But I don’t have personal experience (yet)
72.
by michalsustr 1y ago
The problem is most developers forget a simple thing. Hardware is the platform: https://www.youtube.com/watch?v=rX0ItVEVjHc&t=2891s
73.
by michalsustr 1y ago
Great! I find apache arrow ipc as the most sensible format I found how to organise stream data. Headers first, so you learn what data you work with, columnar for good simd and compression, deeply nested data structures supported. Might serv
74.
by michalsustr 1y ago
Are you thinking about adding stream support? I.e something along the lines of i) build up efficient vocabulary up front for the whole data and then ii) compress by chunks, so it can be decompressed by chunks as well. This is important for
75.
by michalsustr 1y ago
I'm working on a python library that allows you to put data on GPU as fast as your network/storage allows you to at the hardware limits. No more clunky DataLoaders that are too slow and have inconsistent perf. I achieved stable th
76.
by michalsustr 1y ago
and prof. Demlova too :) nice to see fellows from my alma mater here! https://math.fel.cvut.cz/en/people/demlova/
77.
by michalsustr 1y ago
Yes exactly, that’s why I posted this. If you (or dear other readers) have been using monoio or other io_uring implementations, can you please share your experiences?
78.
by michalsustr 1y ago
Benchmark is a bit old, but found this library to be the most interesting for thread-per-core setup.
79.
Monoio: High perf io_uring async runtime(github.com)
4 points by michalsustr 1y ago|3 comments
80.
by michalsustr 1y ago
Thank you for sharing, loved the article!
81.
by michalsustr 1y ago
Love the egui layout! Mind sharing which ui components you used? How did you find compiling for wasm compared to native?
82.
by michalsustr 1y ago
I think it’s because of https://en.wikipedia.org/wiki/Address_space_layout_randomiza... My interpretation is it’s basically a hack because C programmers can’t make their libs reliable/memory safe, and it throws so
83.
by michalsustr 1y ago
AE (algebraic effect) are very interesting! Great article, thank you. Reading through, I have some concerns about usability in larger projects, mainly because of "jumping around". > Algebraic effects can also make designing cle
84.
by michalsustr 1y ago
This also called opponent modeling. Used in e.g. poker, so you can maximise your earnings. https://scholar.google.com/scholar?hl=en&as_sdt=0%2C5&q=oppo...
85.
by michalsustr 1y ago
Did you publish these by any chance?
86.
by michalsustr 1y ago
If you want to build LLM specific to clojure, it could be probably engineered, to add the types as traces for training via synthetic dataset, and provide them from repl at inference time. Sounds like awfully large amount of work for non ma
87.
by michalsustr 1y ago
I agree. I am under the impression that unlike Rust, there aren’t explicit types required in Clojure. (I don’t know clojure) So there are examples online, with rust code and types and compiler errors, and how to fix them. But for clojure, t
88.
by michalsustr 1y ago
I understand the point , however I think explicit types are still superior, due to abundance of data in the training phase. It seems to me to be too computationally hard to incorporate a REPL-like interactive interface in the gpu training
89.
by michalsustr 1y ago
Hi, I made a new crate since I wasnt happy with the existing ones. I published first version: https://github.com/michalsustr/rust-automata Happy to get feedback.
90.
by michalsustr 1y ago
Hi, I just made a library which does that! I published first version: https://github.com/michalsustr/rust-automata Happy to get feedback.

More ›