4 ms·
Implementation of GPT-2 in pure CMake
- ahartmetz 2mo agoFWIW, this is most likely not even fast enough to laugh at how slow it is - for that, you need to see something happening in less than an hour or so. It can only use one core at a time, but that is not the worst thing: CMake is interpreted and stringly typed, so every number will have to be converted string -> number and usually back on every use.
- voxelghost 2mo agoWe just need to find a way to extend Moores law into the 4th dimension, and hardware will catch up to this.
- ahartmetz 2mo agoBtw, I just realized that "cannot use all cores" has become a similar performance handicap to "is interpreted". So many cores now!
- sirsinsalot 2mo agoA hellscape.
- pkilgore 2mo agodisgusting (complementary)
- paaloeye 2mo agoSomebody has more time than sense
- paaloeye 2mo agoReminded me https://github.com/mmozeiko/hello-world-winui3-c https://github.com/mmozeiko/hello-world-winui3-c
- _menelaus 2mo agoAI is gonna keep us around because it would never think to do this kinda stuff
- varun_ch 2mo agoIt might not think to do this but it’ll certainly help do it. The code is full of suspiciously AI code comments and file headers! https://github.com/AlpinDale/gpt2.cmake/blob/main/cmake/model.cmake https://github.com/AlpinDale/gpt2.cmake/blob/main/cmake/mode...
- avilay 2mo agoWhy? Just...why? I get that sometimes we like to build useless things because they are elegant, or beautiful, or "cool" in some sense of the word. But CMake is not cool in any sense of the word! I can barely use it to write build files, and that too I have gladly offloaded to AI. Sometimes when looking at CMake files in a large project, I become nostalgic about Makefiles, but then I think about what the rewrite would entail, and I resign myself to my fate.
- voxelghost 2mo agoSometimes these little endevors, are like art, they don't have to mean something, they just has to make you feel something. Feeling Queasy, is still a feeling, mind you.
- Bluestein 2mo agoThis is the best definition of so many things (from "enragement"/engagement) to the entire Drump presidency to, oh, so many things. So, thanks.- (Also, in a good way, mind: Art for art's sake.-)
- OJFord 2mo agoAn exercise in understanding gpt2, flexing the author's cmake skills, while demonstrating the absurd complexity of what it allows similarly to 'c++ templates are turing complete' or 'doom on my calculator'.
- edg5000 2mo agoIt's surprisingly tiny when you exclude the data
- inoffensivename 2mo agoTo quote April Ludgate: Gross. I love it.
- voxelghost 2mo agoUsing python as a build tool, and Cmake as the programming language, now all that is missing is a bit of config in ASM
- zombot 2mo agoI wonder when Doom will finally be implemented in pure CMake.
- da-x 2mo agoThese kind of things have used to be more impressive in the past, when you knew that humans made them.
- vivzkestrel 2mo agogood now build GPT 2 using brainfuck