tbalsam

7 ms·

31.
by tbalsam 2y ago
Do you have a link to said starter pack? Have been having trouble finding a good one of those specifically in this vein. <3
32.
by tbalsam 2y ago
Do...do I open the modem and read the link off a piece of paper inside, kinda like a fortune cookie?
33.
by tbalsam 2y ago
I remember this post as the day that Keras died. Very strange political powerplay on the part of fchollet, and did immeasurable damage to the community and code that used TF, not just in that PR but also in the precedent it set for other st
34.
by tbalsam 2y ago
I saw this comment, thought, "yeah this reminds me of Adam Nemeck", and lo and behold.
35.
by tbalsam 2y ago
Did you...did you read the technical details? This is almost all they talk about, this method was created to get around. Take a look, it's good stuff! Basically a LoRA to reconstruct outliers lost by quantization, helping keep the perf
36.
by tbalsam 2y ago
Hi! Entropy unfortunately much more complicated than that in practice, mainly as actually finding the real underlying entropy of a variable is quite difficult in practice! However, we can define it as a quantity with respect to different va
37.
by tbalsam 2y ago
People make claims all the time on Twitter that don't end up really panning out. Above explains why it may work within the scope of theory despite being a poor method, but the success rate of methods like these is generally low enough
38.
by tbalsam 2y ago
And unfortunately seem to be difficult to train as well! Unfortunately there will likely always be popularity churn where a more shallow interpretation of a topic goes viral that has had significant research interest but has not been as wel
39.
by tbalsam 2y ago
Sophisticated may be a good word from it w.r.t. one of the historical uses of the word -- a thing with apparent complexity, but not necessarily a lot of depth. There is room I think for well-motivated samplers, but I think they really shoul
40.
by tbalsam 2y ago
A lot of the ML practitioners (including myself) that I know think that this is a pretty ridiculous algorithm, unfortunately. It's possible that it has value, if you flip a coin enough you'll eventually get the ASCII sequence for
41.
by tbalsam 2y ago
"....and 17 other bus stop conversations you'd never expect to have."
42.
by tbalsam 2y ago
(the OP is referring to one of the foundational concepts relating to the entropy of a model of a distribution of things -- it's not the same terminology that I would use but the "you have to know everything and the model wouldn&#x
43.
by tbalsam 2y ago
Yes that's where the term came from. They're (effectively) the same thing as I understand it.
44.
by tbalsam 2y ago
I'm meaning the term "information entropy". Both of those words are generally used interchangeably to mean the same thing (to include the different forms of entropy, as I understand it. :')))) ) <3 :'))))
45.
by tbalsam 2y ago
Corporate has asked you to find the differences between these two pictures.
46.
by tbalsam 2y ago
grabs water spritzer Stop that, now. Bad cat.
47.
by tbalsam 2y ago
This is very cool but the use of the terms "Information Entropy" together as if they were a separate thing is maybe the furthest that any "ATM-machine"-type phrase has rustled my jimmies. It is a cool article, just, wowz
48.
by tbalsam 3y ago
This is because this is what the tendency has been like in practice for many years. While the possibilities are good, living in the world of what-if for ML is very similar to the world of what-if for blockchain. It is very promising but unf
49.
by tbalsam 3y ago
This is a very interesting idea, with DenseNets there are oftentimes some terrible memory gotchas that have gotten me over the past 7-8 years or so, so a part of me is sorta leaning back waiting for some memory usage shoe to drop not specif
50.
by tbalsam 3y ago
Due to some of my personal experiences over the years w/ model development, I believe that this is more due to a failure of the current mainline version of Transformers (the ++ version I believe) not scaling properly, vs an indicator o
51.
by tbalsam 3y ago
Llama.cpp I think has a ton of clone-and-own boilerplate, presumably from having grown so quickly (I think one of their .cu files is over 10k lines or so, roughly, ATM). While I haven't seen the model storage and distribution format, t
52.
by tbalsam 3y ago
It's not too surprising, honestly! I've poked around with similar in the past and am of a perspective that ternary is a very good thing for a lot of neural networks. Training CIFAR-10 speedily w/ ternary weights on an fp16 in
53.
by tbalsam 3y ago
If it worked like that, that would be great! However, our regulatory frameworks unfortunately seem to be in rather a rather weakened place right now. The medical industry is rife with corruption in a number of places, as best as I understan
54.
by tbalsam 3y ago
I think this is well-said! However, I am very much not a he. :')
55.
by tbalsam 3y ago
Neuralink legitimately terrifies me. Not because "brain implant", but because of the multitudinous factors for failure surrounding it. For example, lots of bio things can take a lifetime to have an effect. One crystal clear exampl
56.
by tbalsam 3y ago
I am rather autistic and this is how I think, toosies. 90-95% of my time working on a project is just sitting, staring into space, completely unaware of the world around me. I think it's because while you can "explore the field&qu
57.
by tbalsam 3y ago
Ah yes, the checks notes ever popular bank account hacking SEO spam line. (Legitimately I am confused but maybe it is a one-two scam or the like, lolz. <3 :')))) ;'PPPP ;'PPPP)
58.
by tbalsam 3y ago
Did you seriously just berk me on HN. What next, is a Walmart cashier going to do that RobloxNite "dab dance" or whatever on me? Discusting. Dusgraseful.
59.
by tbalsam 3y ago
Making a bank account work for you is a hard discipline and requires budgeting and the like. True, not all of us can "hack" it, but that doesn't mean that with some community classes and help you'll be able to use your b
60.
by tbalsam 3y ago
I enjoyed this paper (I share a discord with the author so I read it a bit earlier). It's not entirely clear from the comparison numbers at the end, but I think the big argument here is efficiency for the amount of performance achieved

More ›