jdonaldson

7 ms·

31.
by jdonaldson 1y ago
That is a pretty badly overloaded word for it, and I didn't even pay much attention to the notion of "rank" anyways. I'm mainly interested in how the text is represented with bit vectors. It's very reminiscent of
32.
by jdonaldson 1y ago
I think what's changed since this was posted in 2011 is the emergence of embeddings and the need to take advantage of its higher dimensional space. While embeddings expose more underlying structure that can be used for tensor math, ran
33.
by jdonaldson 1y ago
I remember the concept of the virtual dom had to be explained very carefully so people understood why it led to more efficiency when rendering (e.g.) scrolling content. Is there a technical trick that one takes that can beat a virtual dom u
34.
by jdonaldson 2y ago
Macros give their own kind of power, and it's a tough call to give that up for runtime hot-reloading. Languages like Haxe have macros, but also have hot reloading capabilities that typically are supported in certain game frameworks. Y
35.
by jdonaldson 2y ago
It's true, but one has to ask "who made woke-ism into a mind virus?". I think alt-right media say that BLM/Liberals have, but in reality it went viral when it became a favored perjorative and performative act by the alt
36.
by jdonaldson 2y ago
I would have to refute the notion that wokeness is a mind virus. "Stay Woke" has a much deeper origin in African American culture, and it refers to the fact that one needs to stay vigilant about another's intentions. The imp
37.
by jdonaldson 2y ago
I’d say it is, although it’s not really a document but a stream of tokens. The intuition is that the model is able to build abstractions from that stream. Some of the abstractions are related to goal states of the training metric. Howeve
38.
by jdonaldson 2y ago
Just wanted to point out that the notion of a "document" is also an illusion to the LLM. It's processing a sequence of low dimensional spaces into another sequence of low dimensional spaces. The input spaces preserve aspect
39.
by jdonaldson 2y ago
If that’s the case, why was it a bang instead of a slow leak?
40.
by jdonaldson 2y ago
"Convincing you is more important than informing you" Always a pass from me, gets things off on the wrong foot right away.
41.
by jdonaldson 2y ago
One must imagine Atlas shrugging.
42.
by jdonaldson 2y ago
Are you saying that they cant explain the contents of machine code in human readable format? Are you saying that they can’t be used in a system that iteratively evaluates combinations of inputs and check their results?
43.
by jdonaldson 2y ago
It’s kind of surprising that these haven’t just been reverse engineered yet by language models.
44.
by jdonaldson 2y ago
Curves always flatten when faced with a constraint and/or risk. In this case it's surface area and climate variability.
45.
by jdonaldson 2y ago
Australia's electricity consumption in 2021 was approximately 265 TWh (terawatt-hours) per year. Napkin math works out to: Annual energy production of one 2 MW reactor: 2 MW * 8760 hours/year = 17,520 MWh/year = 17.52 GWh&#x
46.
by jdonaldson 2y ago
Dropping a link/endorsement for quarto : https://quarto.org/ It's a static site/document generator that supports bibliographies, jupyter notebooks, and good old fashioned markdown. It works well for complex
47.
by jdonaldson 2y ago
These work great if you have a seldom used door for your furnace and/or ac : https://a.co/d/0h8uGmLQ
48.
by jdonaldson 2y ago
Wind/solar can’t make the order of magnitude jump we need in power.
49.
by jdonaldson 2y ago
Western Australia and Queensland have a good deal of Monazite sands that one can extract Thorium from. This would greatly reduce the need for more complex safety and disposal regulations necessary with larger fission reactors. A small coll
50.
by jdonaldson 2y ago
PCRE2 is specified through its implementation, which has so many edge cases and special flags that most people can't reason about what kinds of problems it could cause. I really wish more people used PEG parsing. I wrote a library for
51.
by jdonaldson 2y ago
Most of the money there is in hospitals. I don't think it does the economy any good to tax those. Love to hear arguments the other way.
52.
by jdonaldson 2y ago
It's hard watching venerable institutions rot into "just avoid administerial short term blame" death loops. You have to have skin in the game, not just hire a temporary manager for it.
53.
by jdonaldson 3y ago
Emotions let us reason about ourselves, which rationality alone can't do for us. Because, in a purely rational sense, the "self" doesn't really exist.
54.
by jdonaldson 3y ago
I’m finding smaller vector databases can be almost ephemeral if you avoid parsing : https://hushh-labs.github.io/hushh-labs-blog/posts/you_dont_... I can retrieve a query, encode the embedding, load the vector st
55.
by jdonaldson 3y ago
If you can’t undermine someone’s argument, undermine their nationality. American tech culture doesn’t do this as much as it should, perhaps because we know eventually those folks wake up.
56.
by jdonaldson 3y ago
Can you put the colon on the blockchain? I might know a guy.
57.
by jdonaldson 3y ago
Strongly suggest you check out Haxe. Been my favorite open source community to be part of.
58.
by jdonaldson 3y ago
"Uncertainty is an intrinsic aspect of life, a constant element that humans have tirelessly sought to navigate and comprehend." I can appreciate people doing things from the heart, but in that case, it better be more poetic than a
59.
by jdonaldson 3y ago
This paper is a far better argument for psycho-acoustic components of sound : https://www.nature.com/articles/nature04485/
60.
by jdonaldson 3y ago
Data calculations and rendering should be done in the same framework if you wish to optimize interactivity.

More ›