shikon7

8 ms·

61.
by shikon7 2y ago
No, it is to make GPUs more expensive for users with professional use cases in mind.
62.
by shikon7 2y ago
That's exactly the point. The limiting factor to space travel is how to achieve acceleration, and not the acceleration limits of the human body.
63.
by shikon7 2y ago
That's why he works so hard to colonize other planets.
64.
by shikon7 2y ago
You need enough RAM to store the model and the KV-cache depending on context size. Assuming the model has a trillion parameters (there are only rumours how many there actually are) and uses 8 bit per parameter, 16 H100 might be sufficient.
65.
by shikon7 2y ago
On that premise, knowing too much might literally starve you.
66.
by shikon7 2y ago
I would think that scale would actually greatly benefit journalism. Why is there no Netflix or Spotify for journalism? I'm thinking of something that provides affordable, comprehensive, high quality and individually recommended article
67.
by shikon7 2y ago
In a working market, we won't run out of power, but power becomes so expensive that it's no longer viable to use most of the GPUs. The boom shifts to power generation instead, and we will have a similar article "The power inv
68.
by shikon7 2y ago
This was introduced a few years ago in the Swiss retailer chain Migros. The span between the sell-by date and the use-by date (typically around 1/10-1/5 of the entire lifespan of the product) would give the consumer the safety tha
69.
by shikon7 2y ago
From the documentation of the differences with Python: > Strings: Codon currently uses ASCII strings unlike Python's unicode strings. That seems really odd to me. Who would use a framework nowadays that doesn't support unicode?
70.
by shikon7 2y ago
Patents usually run out after 20 years, much faster than copyright, and Monopoly was around for much longer.
71.
by shikon7 2y ago
Considering a ship can carry tens of thousands as much cargo as a car, the comparison isn't even remotely fair.
72.
by shikon7 2y ago
I wonder if at some point they regret restricting Unicode to 1,114,112 code points.
73.
by shikon7 2y ago
Why would you use hydrogen to extract the energy of the iron? Wouldn't it be more efficient to burn the iron directly? Likewise, is there no better way to reduce iron oxide to iron than by creating hydrogen first?
74.
by shikon7 2y ago
Maybe you need it if pointers are 16 bytes?
75.
by shikon7 2y ago
As stated in the GPL: The “source code” for a work means the preferred form of the work for making modifications to it. Arguably having the weights and code to execute the model available is the preferred form to modify a LLM.
76.
by shikon7 2y ago
It’s interesting that night light exposure is so important, but the much brighter day light seems to have almost no effect.
77.
by shikon7 2y ago
Using compiler specific extenions isn’t really C, though. It isn’t portable and there is no specificed ABI. Add enough of them, and it might become a new language “C with Memory Safety”
78.
by shikon7 2y ago
You could try to use plants and a growing lamp for them to do photosynthesis.
79.
by shikon7 2y ago
Yes, it seems the more efficient use we have for compute, the more valuable compute is to us, and the more compute we will be able to afford.
80.
by shikon7 2y ago
> Encourage fairness and kindness, and discourage hate > Don't try to change anyone's mind That seems inherently contradictory to me...
81.
by shikon7 2y ago
If you ban Google from the internet, many people would still use Google, but stop using the internet
82.
by shikon7 2y ago
During the night, there will be 1 lane open in each direction (one on the side of the bridge, and one on the opposite carriageway), so the bridge can be moved.
83.
by shikon7 2y ago
Because Chinese law forbids to convert their coordinates to WGS84, and using the Chinese coordinates for satellite data would give a discontinuity at the border. This is explained in the article.
84.
by shikon7 3y ago
It seems straightforward that finetuning an LLM just for usefulness will reduce alignment (and the other way around).
85.
by shikon7 3y ago
Still it is mentioned in the ABI specification, although as an optional type.
86.
by shikon7 3y ago
It says 34% of adults lacking literacy proficiency were born outside the US, but not how many born outside the US are lacking literacy proficiency, and neither how many born inside the US are. It seems a bit misleading to state two similar
87.
by shikon7 3y ago
I disagree. Surely Redis will take advantage of a solution to a given problem.
88.
by shikon7 3y ago
Rather than assessing whether the LLM has biases, the leaderboard seems to assess whether the LLM affirms the tester’s biases. Not that I blame them, as it’s probably impossible to define what a “no bias” exactly means.
89.
by shikon7 3y ago
But 2 mod 3 should still give the same as -1 mod 3. If the representative for the same equivalence class is allowed to be different depending on the input, you could just as well use the number itself.
90.
by shikon7 3y ago
The RTX 3090 is still one of the best gaming/consumer GPUs, beat only by the 4080 and 4090. And the 5000 series might still be almost a year away.

More ›