why_only_15

9 ms·

61.
by why_only_15 2y ago
If you are making a prediction about the world, why not gamble on it? It shows to others that you have an actual stake as opposed to blathering.
62.
by why_only_15 2y ago
If you are making predictions about the world, you should be willing to put money on those predictions so that you are grounded to making predictions that you actually believe in as opposed to just blathering.
63.
by why_only_15 2y ago
If you believe this article, I would be happy to bet up to $10,000 that OpenAI will not collapse in the next 24 months. We could operationalize this by saying that OpenAI will employ at least as many people (or pay at least as much in salar
64.
Shared Memory Atomic throughput on RTX 4090(girl.surgery)
1 points by why_only_15 2y ago|0 comments
65.
by why_only_15 2y ago
It's not two years after release, but it is two years after it was trained
66.
by why_only_15 2y ago
how often is significant numbers of bit errors a problem, or when does that come up? they also address something similar in the body: "Here are two audio samples at 14 kbps with heavy 30 percent receiver-side packet loss."
67.
by why_only_15 2y ago
Apple has designed their own GPUs since they stopped using PowerVR with A11
68.
by why_only_15 2y ago
what is "mostly irrelevant in 2024" quoting from?
69.
by why_only_15 2y ago
The law has strict standards for fairness, for good reason. It excludes things like rumor, for good reason. But when you as a private person are deciding how to act, you make the best decision available to you with the information you have.
70.
by why_only_15 3y ago
Where are you referring to? In the US railroads were never nationalized (long-term) and private roads were never much of a thing, and the US has a pretty good (freight) railroad system [1]. [1]: https://en.wikipedia.org/wiki
71.
by why_only_15 3y ago
HBM is often, as I recall, $30/GB for comparison
72.
by why_only_15 3y ago
Why did Texas not start building out batteries for ancillary services until recently? Did/do they not need as much ancillary services as PJM? Also -- do you know what happened to ancillary service pricing as batteries became cheaper? D
73.
by why_only_15 3y ago
This isn't really how batteries make money in the US right now, as I understand it. ~80% of battery revenue in ERCOT comes from what are called "ancillary services" [0] which is payment from the grid for being able to very qu
74.
by why_only_15 3y ago
In the US, PV solar capacity factor is about 0.24 (partly because lots of people live near very sunny regions like California and Texas). The National Renewable Energy Laboratory claims that in some parts of the US utility-scale solar capac
75.
by why_only_15 3y ago
I appreciate that his acknowledgements here were to his daughter ("for detailed feedback on the generated fractals") and wife ("for providing feedback on a draft of this post")
76.
by why_only_15 3y ago
I assume a government program for batteries, but not sure.
77.
by why_only_15 3y ago
> As of 2021, about 2 percent of houses of worship in the United States have solar systems, according to Lawrence Berkeley National Laboratory, which the University of California manages for the U.S. Department of Energy. That’s dispropo
78.
by why_only_15 3y ago
no, there are thousands of Blaze build files that each have their own binaries, tests, libraries, etc.
79.
by why_only_15 3y ago
Do you have any thoughts on adding tensor core support? Tensor cores are most of what modern GPUs are used for but are devilishly hard to program well (they totally break most of CUDA's abstractions).
80.
by why_only_15 3y ago
It's interesting that they say skill is about finding good trades -- my perception from playing a few times is that there's a lot of subtlety in how many of what you offer, and how the information that you have those cards changes
81.
by why_only_15 3y ago
It is incorrect to say that the moat is the software. The moat is primarily the compute hardware, which is still incredibly good for the price, plus really good networking equipment. CUDA is not a significant moat for massive LLM training r
82.
by why_only_15 3y ago
Compute shaders are not capable of using modern GPU features like tensor cores or many of the other features needed to feed tensor cores data fast enough (e.g. TMA/cp.async.shared)
83.
by why_only_15 3y ago
I'd be curious to learn more about how it's compute bound and what specifically is compute bound. On modern H100s you need ~600 fp8 operations per byte loaded from memory in order to be compute bound, and that's with full 128
84.
by why_only_15 3y ago
Human explainability/interpretability is terrible -- it takes years to understand a person well enough to model their actions well in novel situations, and there's tons of literature that backs up that people consistently invent b
85.
by why_only_15 3y ago
You can keep around the KV cache from previous generations which lowers the cost of prompts significantly.
86.
by why_only_15 3y ago
gpt3.5 turbo is a new model, not Curie. As others have stated, it probably uses Mixture of Experts which lowers inference cost.
87.
by why_only_15 3y ago
Oh huh I didn't know about that!
88.
by why_only_15 3y ago
NVLink is the most notable (>600GB/s GPU-to-GPU communication) whereas the best case scenario on 30x0/40x0 GPUs is peer-to-peer PCIe (~30GB/s) and average case is routing PCIe through the host (~15GB/s)
89.
by why_only_15 3y ago
The hardware in your flat definitely cannot do 1 billion queries per second -- that requires a massive, global system, which can probably also support a shared system with ~100,000x less queries.
90.
by why_only_15 3y ago
I don't think that's true? Bigtable: https://cloud.google.com/bigtable/docs/replication-overview > When using replication, reads and writes to the same cluster are consistent, and between different cl

More ›