BenoitP

3 ms·

1.
by BenoitP 5d ago
What an eerie feeling reading this, or was it prescient?: """ def fizz_buzz_encode(i): if i % 15 == 0: return np.array([0, 0, 0, 1]) elif i % 5 == 0: return np.array([0, 0, 1, 0]) elif i % 3
2.
by BenoitP 5d ago
Since this is about Geometric Algebra, here are two other (complementary) great intros: * Why can't you multiply vectors? - Freya Holmer - https://www.youtube.com/watch?v=htYh-Tq7ZBI&t * A Swift Introduction to Ge
3.
by BenoitP 16d ago
Compare-and-swap is a hardware instruction, and beyond that a desirable pattern for dealing with concurrent writes. CMPXCHG https://www.felixcloutier.com/x86/cmpxchg https://lwn.net/Articles/847973
4.
by BenoitP 16d ago
There's even a load-bearing in there as well
5.
by BenoitP 18d ago
And GLM local models can eat Anthropic's lunch just like both eat OpenAI's. Mistral's revenue is mostly B2B, and that's much more difficult to move.
6.
by BenoitP 18d ago
Haha :) Well, that was the joke. If you're reading this, hi Ron!
7.
by BenoitP 18d ago
It helps you spend more token, is more expensive, and thus is obviously more AI. Also novelty and more complexity means less scrutiny of the approach. These are necessary and perfectly sufficient for an investment firm thesis I believe.
8.
by BenoitP 19d ago
> That has not been the case, and I no longer think that it will be. People get by with the existing programming languages and models, that seems to be fine. .. as long as the processing they do fits in a map(). I still deeply believe th
9.
by BenoitP 19d ago
> Is my friend a virus for recommending me their favorite book? In that case the book would be a virus, and your friend a host. But it generalizes way wider to ideas. Religions are viruses too for example. With very strong viral mechanis
10.
by BenoitP 22d ago
Another project worth checking would be Quasar (and had virtual threads in 2013): https://docs.paralleluniverse.co/quasar/ But I believe the author moved to a Big Corp which sells databases, working on some big projec
11.
by BenoitP 22d ago
France exports about 60TWh of electricity yearly for about 4B€. Flamanville running at 100% generates 32TWh. It is amortized in 9 years. I'd say it's doing pretty okay even with its ballooning cost.
12.
by BenoitP 22d ago
Took your link, changed de to en, reduced granularity weekly to daily. It looks way more spiky: https://www.energy-charts.info/charts/energy/chart.htm?l=en&... Also, both wind and solar (especially solar) chan
13.
by BenoitP 22d ago
It'd be really great if wind turbines across Germany were producing at uncorrelated times. Let's look at the wind right now: uniform wind across Germany: https://earth.nullschool.net/#2026/09/04/1200
14.
by BenoitP 22d ago
Diesel, or rather energy, is also a way bigger part of every single aspect of our modern world. Let's take drinking a can of coke as an example: First degree: It came into your home from the factory through the shop. 80% product + 20%
15.
by BenoitP 25d ago
What's wrong with https://ann-benchmarks.com/index.html ?
16.
by BenoitP 1mo ago
They had vertical integration and made bank. Then each layer got more complex as computing became mainstream, and IBM got out-competed on everyone of them by specialized companies. And then they sold them off. The only layer that remains is
17.
The Proof Machine (2016)(incredible.pm)
27 points by BenoitP 2mo ago|4 comments
18.
by BenoitP 2mo ago
To the more exercise-inclined, there's this introductory game: https://incredible.pm/
19.
by BenoitP 4mo ago
Same here A potential solution would be to have a reputation system, with some light pageranking in it. People who care about their reputation are bound to rate other likewise people higher. I don't think such loyalty exists between vi
20.
by BenoitP 5mo ago
Not doing retrieval, but one thing I'd love to try would be active learning passes of querying. Here is a paper for large scale active learning https://cdn.aaai.org/ojs/20591/20591-13-24604-1-2-20220628.p...
21.
by BenoitP 6mo ago
Yet another manycore proposal, but I feel each time we're getting closer. Bandwidth is one of the few dimensions still growing, and there's something to unlock by shaping computation by this firehose of bits. However it seems the
22.
Full System Cost of a Resilient and Carbon Neutral Electricity System [pdf](unece.org)
4 points by BenoitP 6mo ago|0 comments
23.
by BenoitP 6mo ago
LCOE is good for marginal cost (eg: one more solar panel), but fails dramatically at evaluating systemic costs. A nuclear reactor moves the entire market down, including the costs to the consumer when he buys solar energy. Here is a UN docu
24.
by BenoitP 6mo ago
JAX is designed from the start to fit well with systolic arrays (TPUs, Nvidia's tensor cores, etc), which are extremely energy-efficient. WebGL won't be the tool that connects it on the web, but the generation after WebGPU will.
25.
by BenoitP 6mo ago
I believe we could get there eventually. For example for collision there is work to make it differentiable (or use a local surrogate at the collision point): https://arxiv.org/abs/2207.00669 The robotics will need to c
26.
by BenoitP 6mo ago
Yeah :) I had a lot of fun writing the article! And it is only half a joke My intuition for so-called world models is that we'll have to plug modules, each responsible for a domain (text, video, sound, robot-haptics, physical modelling
27.
by BenoitP 6mo ago
Damn, I should have spent more time QA-ing that post. I'll try to patch it. You did not miss much though: it just rotates the scene.
28.
Jax's true calling: Ray-Marching renderers on WebGL(benoit.paris)
91 points by BenoitP 6mo ago|14 comments
29.
by BenoitP 6mo ago
It is AI generated. Or was written by someone a bit far from the technical advances IMHO. The Johnson-Lindenstrauss Lemma is a very specific and powerful concept, when in the article the QLJ explanation is vacuous. A knowledgeable human wou
30.
by BenoitP 7mo ago
> the whole process remains differentiable: we can even propagate gradients through the computation itself. That makes this fundamentally different from an external tool. It becomes a trainable computational substrate that can be integra

More ›