_ntka

4 ms·

1.
by _ntka 2y ago
Radiation would perhaps be better pictured with a light blue glow (Cherenkov radiation). The green glow used in pop culture has its origin in the widespread use of radium paint to achieve a glow-in-the-dark effect (e.g. on watch faces) in t
2.
by _ntka 2y ago
Isn't JAX the most widely used framework in the GenAI space? Most companies there use it -- Cohere, Anthropic, CharacterAI, xAI, Midjourney etc.
3.
by _ntka 3y ago
No, I am saying, with JAX you train on G.P.U., with a G, and your training runs are >2x faster, so your training costs are 2x lower, which matters whether your training spend is $1k or $100M. You're not interested in that? That&#x27
4.
by _ntka 3y ago
Or alternatively, do you want faster training runs (and thus lower training costs)? Then JAX is a good choice for you.
5.
by _ntka 3y ago
It's all about cost and performance. If you can train a foundation model 2x faster with JAX on the same hardware, you are effectively slashing your training costs by 2x, which is significant for a multi-million dollar training run.
6.
by _ntka 3y ago
JAX is used by almost every large genAI player (Anthropic, Cohere, DeepMind, Midjourney, Character.ai, XAi, Apple, etc.). Its actual market share in foundation models development is something like 80%. Also JAX is not just for TPU. It'
7.
by _ntka 4y ago
This is not true, the initial Keras port of the model was done by Divam Gupta who is not affiliated with Keras or Google. He works at Meta. The benchmark in the article uses mixed precision (and equivalent generation settings) for both impl
8.
by _ntka 7y ago
7 cubic km of olivine is a staggering amount. Makes you wonder whether the effect of deploying the olivine would even offset the energy cost and CO2 emissions of extracting and moving around all that rock.
9.
Machine Learning Guides(developers.google.com)
708 points by _ntka 8y ago|54 comments
10.
The impossibility of intelligence explosion(medium.com)
114 points by _ntka 9y ago|140 comments
11.
User experience design for APIs(blog.keras.io)
274 points by _ntka 9y ago|42 comments
12.
by _ntka 11y ago
Agreed, isolating the contribution of the "model" itself can be borderline impossible, and the details of model engineering have a considerable impact on performance. That's why I like Kaggle competitions: most approaches tri
13.
John Carmack wants to build a Metaverse of Facebook scale(twitter.com)
3 points by _ntka 13y ago|0 comments
14.
For the Love of Money(nytimes.com)
576 points by _ntka 13y ago|274 comments
15.
Satoshi Nakamoto is probably Nick Szabo?(likeinamirror.wordpress.com)
255 points by _ntka 13y ago|180 comments
16.
ECHELON was used for industrial espionage (European Commission report)(cryptome.org)
151 points by _ntka 13y ago|66 comments
17.
The Singularity is not coming(cognitivesocialweb.com)
72 points by _ntka 14y ago|76 comments