Straw

7 ms·

61.
by Straw 1y ago
Adam Smith would be considered a right wing economist today, similar to Milton Friedman, perhaps with more support for certain government functions such as education. However, even on that issue, given the wildly different level of educatio
62.
by Straw 2y ago
See https://ukfoundations.co/ Similar argument to the article, but in much more depth. In a nutshell, the UK has made it legally difficult to construct new housing and many forms of infrastructure- electricity plants, roads
63.
by Straw 2y ago
Current models don't predict the climate overall getting drier with climate change- in fact average rainfall goes up slightly. Some areas will get drier, others (like the Sahara and Sahale for example) have and will get wetter.
64.
by Straw 2y ago
The number of correct digits in the answer grows exponentially with iteration count- "quadratic convergence" means we roughly square the error each time, so after many iterations we raise the error to an exponentially high power.
65.
by Straw 2y ago
I also find there are benefits to spending (on my) education. But if we can't show benefit for a specific kind of public spending, is it justified to take other's money and spend it on "education" in a way which has no m
66.
by Straw 2y ago
Name calling isn't an argument. It might be appropriate to spend a lot on education, if there were a benefit! But as you can see in the first chart, its not at all obvious that all this increased spending has had any measurable positiv
67.
by Straw 2y ago
See https://slatestarcodex.com/2017/02/09/considerations-on-cost... Educational spending per pupil has gone up in real terms, by about 2.5x over 40 years. This is already inflation adjusted so there isn'
68.
by Straw 2y ago
That's federal only!
69.
by Straw 2y ago
Wages don't count benefits, total compensation has risen faster than wages.
70.
by Straw 2y ago
The average of its errors is 0- ie it is not biased. Ofc, the average absolute error, which in English one could very reasonably refer to as "average error" is much greater than 0.
71.
by Straw 2y ago
The average error is in fact 0! The average absolute error is reduced but not 0.
72.
by Straw 2y ago
Only in the sense that anything is a markov chain with some sufficiently large state size. It tells you nothing about the behavior.
73.
by Straw 2y ago
This paper states a completely obvious tautology which is that if you limit the context length, a LLM has a finite state size!
74.
by Straw 2y ago
It's called the generalized mean: https://en.wikipedia.org/wiki/Generalized_mean
75.
by Straw 2y ago
I agree with your sentiment, however its not exactly true. According to his son, Milton Friedman used to say this but stopped because he realized that trade itself is free lunch- because its a win on both sides- consumer and producer surplu
76.
by Straw 2y ago
If the RNG has < 226 bits of state, such as most non cryptographic PRNGs, you cannot reach all shuffles even if you use multiple numbers.
77.
by Straw 2y ago
Was not expecting Touhou music!
78.
by Straw 2y ago
This only looks at wages, not total compensation. Benefits increases have made up much of the difference. When you look at productivity vs total compensation, there may have been a small decoupling but its far less.
79.
by Straw 2y ago
This has very little to do with income or wealth inequality, and everything to do with bad local government policy leading to insanely expensive housing. Anyone on a full time service job in the Bay Area is very rich on a global standard! W
80.
by Straw 2y ago
Japan built two Yamato-class battleships, the Yamato and the Musashi.
81.
by Straw 2y ago
You can implement CLOS with macros, but not the other way round!
82.
by Straw 2y ago
Seems like a big benefit would come from not forking the codebase into two versions!
83.
by Straw 2y ago
[EDIT] long before deep learning!
84.
by Straw 2y ago
People did GPGPU computing long before GPUs. Simply look at the list of tested, supported projects on their docs page!
85.
by Straw 2y ago
My understanding from chatting with them is that tensor core operations aren't supported yet, so FlashAttention likely won't work. I think its on their to-do list though! Nvidia actually has more and more capable matrix multiplica
86.
by Straw 2y ago
I worked for spectral compute a few years ago. Very smart and capable technical team. At the time, not only did they target AMD (with less compatibility than they have now), but also outperformed the default LLVM ptx backend, and even NVCC,
87.
Run CUDA, unmodified, on AMD GPUs(docs.scale-lang.com)
1330 points by Straw 2y ago|399 comments
88.
by Straw 2y ago
Natural gas has about 5% impurities other than methane. There's no need to change standard terminology when discussing energy. Countries who use coal have even more emissions. 20% of US power generation comes from coal even now. More n
89.
by Straw 2y ago
It's funny how the article portrays this as a key driver of climate change, when in fact natural gas displacing coal has significantly _reduced_ US carbon emissions over the last 20 years!
90.
by Straw 3y ago
Its distinct, but not very- its an EMA without assuming uniform time. The stability of EMA has nothing to do with integrators in control theory and neither do these models. These models aren't really RNNs- they have only a linear gate

More ›