jbay808

9 ms·

61.
by jbay808 3y ago
I just can't imagine how a stochastic parrot could repeat back a correctly-sorted list that it hasn't seen in training, without actually implementing a sorting algorithm in the process. It seems (and, by calculation, is) phenomena
62.
by jbay808 3y ago
I would interpret this as showing that matrix multiplication code is carefully engineered to correctly implement... well, matrix multiplication. Stumbling on that specific mapping of 96 input bits to 96 output bits would be hard to pick out
63.
by jbay808 3y ago
I'm glad to see someone express this view, because I think this gets to the heart of the question. How does a stochastic parrot learn to sort lists? Embeddings are part of the compression-by-abstraction that I'm explaining in the
64.
by jbay808 3y ago
That's right, but if you did that compression, it wouldn't be an n-gram anymore. What I'm attempting to get across is that you could model GPT-4 as an equivalent 8000-gram in an abstract sense, but that's not a good ment
65.
by jbay808 3y ago
Author here. Happy to see this discussion. Absolutely, GPT-4 sometimes has trouble reasoning and doesn't reason perfectly. I'm impressed by its successes, but I agree it's not at the human level yet, and I would not make the
66.
Gail Weiss: Thinking like Transformers [video](youtube.com)
1 points by jbay808 3y ago|0 comments
67.
by jbay808 3y ago
I also always checked Digi-Key first and then Mouser second if Digi-Key is out of stock on something I need. (Unless it was a TI part; their direct online ordering process is quite nice). But going forward I'll reconsider Mouser.
68.
by jbay808 3y ago
> Bard isn’t currently supported in your country [Canada]. Stay tuned! Too bad for us...
69.
by jbay808 3y ago
Pre-history usually refers to a time period approximately up to the invention of writing, so some several thousand years. If your time scale is the past 500 million years, there have been some real big mass extinctions to go along with thos
70.
by jbay808 3y ago
It would be nice if more sites offered a "site map" page, which used to be popular, where you could ctrl+f for a link even if it was too large to fit on the display.
71.
by jbay808 3y ago
I'm still not sure I follow. In the article, the uncertainty is not intended to be independently estimated. The distribution described has a single parameter, which is the median completion estimate, and that is the only parameter need
72.
by jbay808 3y ago
I appreciate the feedback but I'm not sure I follow. What changes to the estimation methodology do you mean? And what properties make software projects more erratic than a log-normal (which is already very erratic)?
73.
by jbay808 3y ago
For software estimation, you can get a long way by just assuming that the distribution is lognormal. https://jbconsulting.substack.com/p/task-estimation-conqueri...
74.
by jbay808 3y ago
To echo this, I highly recommend his book "Electromagnetic Compatibility Engineering".
75.
by jbay808 3y ago
That's where the idea of "instrumental convergence" comes in. For almost any end goal, there are intermediate goals that are nearly universal, like: not wanting to be turned off. Because being forcibly shut down is not compat
76.
by jbay808 3y ago
> The real problem is that we simply cannot hope to predict what an entity that is far superior to any human would do, essentially by definition. In some ways. I can't predict Stockfish's next chess move, or else I'd be at
77.
by jbay808 4y ago
Reprap launched when the first FFF patents were expiring, and kicked off a huge burst of creativity and innovation in 3D printing that continues to this day.
78.
by jbay808 4y ago
Yes, this is in accordance with the definition of temperature as d entropy / d energy, which is the more generally-applicable definition. It's easy to see from this that temperature becomes negative if adding more energy into the
79.
by jbay808 4y ago
The most fun part of learning statistical mechanics was un-learning everything I had learned about temperature in high school!
80.
The Technology Behind Sandpaper [video](youtube.com)
2 points by jbay808 4y ago|0 comments
81.
by jbay808 4y ago
This company also makes amazing pliers!
82.
by jbay808 4y ago
A hot air soldering station is an absolute must for SMT work, in my opinion. You can get "all-in-one" stations with a soldering iron, infrared plate, and hot air, very affordably. This is the one I use: https://www.xtro
83.
by jbay808 4y ago
Just to expand on that, usually the etched scale pitch is 20 microns, but digital quadrature detection gives you 4x the resolution of the scale pitch, resulting in a 5 um distance between successive rising / falling edges of the quadra
84.
by jbay808 4y ago
Shout-out to Texas Instruments' line of FRAM processors, which is how I first encountered ferroelectric memories in the field. Here's some of their literature about it: https://www.ti.com/lit/an/slaa526a&
85.
by jbay808 4y ago
This also makes me wonder whether, instead of an entirely toroidal propeller, you could just put a small, appropriately-shaped toroidal loop at the tip of the prop.
86.
by jbay808 4y ago
From that article: > Greg reasoned that if he could reduce or even eliminate these tip vortices, it should lead to a quieter, more efficient drone. His light bulb moment came on a dog walk when the idea of a tipless blade, that loops rou
87.
by jbay808 4y ago
(Addendum: If you're wondering what makes it more rigid than traditional X-shape extrusions, it's partly because the joints are well designed, but mostly because the torsional rigidity of a thin-walled section is proportional to t
88.
by jbay808 4y ago
In Japanese hardware stores last year I spotted a new type of aluminum extrusion called "G-fun" by the "SUS" company, which is vastly superior in terms of rigidity and interconnection options: https://g-fun.jp
89.
by jbay808 4y ago
They are used in these applications, typically very high grade, unless you're buying a legacy product line. In, say, a hybrid stepper the magnet is usually a wide thin round disc, sandwiched between two steel rotor lamination stacks. W
90.
by jbay808 4y ago
It's worth distinguishing between two completely different types of "servos": RC hobby servos, and industrial-type servos which are robustly built like steppers but significantly more fast, accurate, efficient, and powerful.

More ›