robviren

5 ms·

31.
by robviren 7mo ago
For me it is an active question if coding training data "purity" matters. Python has Go on volume, but within that is a ton of API changes, language changes, etc. Is that free regularization or does it poison the dataset? As the a
32.
by robviren 8mo ago
I find the dependency creep for both rust and node unfortunate. Almost anything I add explodes the deps and makes me sweat for maintenance, vulnerabilities, etc. I also feel perpetually behind, which I think is basically frontend default mo
33.
by robviren 8mo ago
I have run into a surprising number of basic syntax errors on this one. At least in the few runs I have tried it's a swing and a miss. Wonder if the pressure of the Claude release is pushing these stop gap releases.
34.
by robviren 8mo ago
I have run into that a lot which is annoying. Even though all the code compiles because go is backwards compatible it all looks so much different. Same issue for python but in that case the API changes lead to actual breakage. For this reas
35.
by robviren 8mo ago
I find it fascinating to give the LLMs huge stacks of reflective context. It's incredible how good they are at feeling huge amounts of csv like data. I imagine they would be good at trimming their context down. I did some experiments b
36.
by robviren 8mo ago
Trying to use ESNs as a random projection for audio data and potentially rendered text data for some AI workflows. Seeing it I can use the echo states running both forward and backward through the data as a holographic representation which
37.
by robviren 9mo ago
I feel like wishing for UI innovation is using the Monkey's paw. My web experience feels far too innovative and not enough consistent. I go to the Internet to read and do business not explore the labyrinth of concepts UI designers feel
38.
by robviren 10mo ago
I want to explore the space of audio encoding and GPT like understanding of audio. I'm so highly interested in how a simple 1d signal must go through so much processing to be understood by language models, and am curious what tradeoffs
39.
by robviren 10mo ago
I keep everything in my self hosted gitea. Just made it public. https://gitter.swolereport.com/robviren/cspace
40.
by robviren 10mo ago
I'm trying to make a neural audio codec using a variety of misguided methods. One I am using ESNs wrong spreading leak rates in a logarithmic fashion acting like a digital cochlea. The other is trying to do the same with a complex mass
41.
by robviren 10mo ago
Love to see the Pi getting some rather creative use! The most use I got out of one was as a health check endpoint for power in my garage which was holding frozen milk for my newborn, but the circuit kept tripping. Had another server email m
42.
by robviren 10mo ago
I just liked programming when it contained a comprehensible amount of abstraction. Stacks have become so tall it is not even feasible for a single human to comprehend what is occurring. I also liked when standards had less surface area. Wor
43.
by robviren 10mo ago
I have been unable to get anything other than Cachy to run Baldur's Gate 3 as well as Windows on my Lenovo Legion 2021. Best I have found for performance and so far stable on my relative new tower.
44.
by robviren 1y ago
I found strong parallels between tech safety and nuclear safety. https://www.nrc.gov/docs/ML0534/ML053410342.pdf NRC is a good place to start. They have been at trying to prevent tech from hurting people for awhil
45.
by robviren 1y ago
Totally valid perspective. I only became part of the industry after Fukushima. I only knew an industry by its disasters. I will say, having gone through the training programs we studied the nuclear incidents and spent a year in training b
46.
by robviren 1y ago
I greatly appreciate the nuclear industry. Nuclear field engineering was my first "real" job out of college and they really committ to safety. Transparency in this industry is inspiring because everyone involved knows that one scr
47.
by robviren 1y ago
This has got to be one of the most visually pleasing explanations I have seen of these concepts. Congrats! I attempted some similar VQ-VAE work instead trying to tokenize rendered text. I was curious if I could make a visual llm working on
48.
by robviren 1y ago
I have been playing with the idea of an LLM native programming language focusing on token efficiency, comprehension, and attention. It is interesting to see what the various large models come up with. A common theme actually reminds me quit
49.
by robviren 1y ago
I have been thinking this as well. I desperately wish to develop a method that gives the models latent thinking that actually has temporal significance. The models now are so linear and have to scale on just one pass. A recurring model wher
50.
by robviren 1y ago
I feel it is interesting but not what would be ideal. I really think if the models could be less linear and process over time in latent space you'd get something much more akin to thought. I've messed around with attaching reservo
51.
by robviren 1y ago
What am I gonna do, leave my bank because the website loaded slow? Get tickets through some other option? Order differ food because it took 10 seconds to load a menu? I hate the slow web so much, but it just gets lost in the churn of life.
52.
by robviren 1y ago
Python and Typescript/JavaScript I largely agree. Those languages frequently top the list of most used languages with probably the most code represented in the popular foundation models. Even though Python has shifted over time the she
53.
by robviren 1y ago
Reminds me of WW1 airplane use. We are at the pilot dropping grenade and using pistol to shoot at other pilot stage for technical application I guess. Nobody really knows what to do but everyone is sure trying.
54.
by robviren 1y ago
I worked as a field engineer in nuclear power for maintaining reactors. Every plant you go to requires taking a training module before you can get in usually. Every single one had at least a slide showing the Swiss cheese model of "def
55.
by robviren 1y ago
Trying to make out paint for text (essentially a Large Symbol Model). Tokenize renders of PDFs with patches of some sort and see if I can make a multi language monochrome visual vocabulary where I can embed language and document metadata. I
56.
by robviren 1y ago
I feel this depends entirely on how you use it. Using it as a rubber duck to talk through ideas? doubt my brain activity is lower because of that. Using it to stub out boiler plate code? I'm glad my brain activity is lower for that. I
57.
by robviren 1y ago
I just got sucked into this idea recently! After some success with using genetic algorithms to clone voices for Kokoro I wondered if it would be possible to evolve architecturers. So interested in the idea of self assembled intelligence, bu
58.
by robviren 1y ago
Mainly just pulling from how my friends use it now, for the fun of it. We have sent each other silly generated videos of stuff we did or talked about. Kind of like how we used up compute, storage, and bandwidth to send memes and funny video
59.
by robviren 1y ago
I look forward to a day when capabilities like this are trivial and boring to the average person. When my phone (locally) will be able to generate a fully voice acted 24 episode series anime on a whim for a meme with my group chat. It'
60.
by robviren 1y ago
I do still actively wonder what portion of the effects are real vs placebo in audio "treatments". I'm not certain I am sold on things like binaural beats and such, but I do believe that pleasing music that relaxes the brain f

More ›