2 ms·
> ...in the realm of bits. Especially as an OG (first author to use the word?): https://people.math.harvard.edu/~ctm/home/text/others/shannon/entropy/entropy.p
by 082349872349872 4y ago
> ...in the realm of bits.
Especially as an OG (first author to use the word?): https://people.math.harvard.edu/~ctm/home/text/others/shannon/entropy/entropy.pdf https://people.math.harvard.edu/~ctm/home/text/others/shanno...
> If the base 2 is used the resulting units may be called binary digits, or more briefly bits, a word suggested by J. W. Tukey.
[Edit: also, consider the section "3. THE SERIES OF APPROXIMATIONS TO ENGLISH" to be an early exploration of MLMs: Microscopic Language Models]
- kkylin 4y agoJohn Tukey also invented FFT and apparently was the first to use "software" in a publication: https://en.wikipedia.org/wiki/John_Tukey https://en.wikipedia.org/wiki/John_Tukey
- yesenadam 4y agoGauss invented FFT, in 1805. And "Between 1805 and 1965, some versions of FFT were published by other authors" https://en.wikipedia.org/wiki/Fast_Fourier_transform#History https://en.wikipedia.org/wiki/Fast_Fourier_transform#History p.s. I started reading Tukey's textbook Exploratory Data Analysis just yesterday. It's wonderful so far, a pleasure to read. "It is important to understand what you CAN DO before you learn to measure how WELL you seem to have DONE it." "The greatest value of a picture is when it forces us to notice what we never expected to see."
- disconcision 4y agoyes but colloquially we take 'inventor' to mean whoever invented it next after guass
- yesenadam 4y ago:-) It seems Cooley and Tukey were the first to realize/state that it's O(N log N), which is something.