cpldcpu

7 ms·

31.
by cpldcpu 9mo ago
Thanks! Would be quite interesting to see how this fares compared to mHC. I noted that LAuReL is cited in the mHC paper, but they refer to it as "expanding the width of the residual stream", which is rather odd.
32.
by cpldcpu 9mo ago
May be worth pointing out, that this is not the first residual connection innovation to be in production. Gemma 3n is also using a low-rank projection of the residual stream called LAuReL. Google did not publicize this too much, I noted it
33.
by cpldcpu 9mo ago
All of them use ASML lithography, including CXMT. They are, of course, a bit slower in EUV adoption. But its already there: https://www.tomshardware.com/pc-components/dram/micron-sampl... https://www.te
34.
by cpldcpu 9mo ago
This lists many transistor patents from oldest to newest. https://patents.google.com/?q=(H03F3%2f16)&sort=old The Matare/Welker Patent is missing though https://patents.google.com/patent/US2673
35.
by cpldcpu 10mo ago
"Zero power" does not include the power needed to translate information between electronic and optical domains and the light source itself.
36.
by cpldcpu 10mo ago
What also cannot be ignored, is that transformer models are a great unifying force. It's basically one architecture that can be used for many purposes. This eliminates the need for more specialized models and the associated engineering
37.
by cpldcpu 10mo ago
I am not a professional software developer but instead more of multi-domain system architect and I have to say it is absolutely magical! The public discourse about LLM assisted coding is often driven by front end developers or rather non-pr
38.
by cpldcpu 11mo ago
Not a big fan of emojis becoming the norm in LLM output. It seems Grok 4.1 uses more emojis than 4. Also GPT5.1 thinking is now using emojis, even in math reasoning. 5 didn't do that.
39.
MODPlayRISCV – Playing tracker Music on ultra-low-end RISC-V MCUs(github.com)
5 points by cpldcpu 11mo ago|0 comments
40.
by cpldcpu 1y ago
At this point in time, the shield headers rather look like a trademark than a useful connecter.
41.
by cpldcpu 1y ago
The dimensions should actually be closer to 12000 * (no of tokens*no of layers / x) (where x is a number dependent on architectural features like MLHA, QGA...) There is this thing called KV cache which holds an enormous latent state.
42.
by cpldcpu 1y ago
These interfaces use serialized binary encoding. SNNs are more similar to pulse density modulation (PDM), if you are looking for an electronic equivalent.
43.
by cpldcpu 1y ago
I believe the argument is that you can also encode information in the time domain. If we just look at spikes as a different numerical representation, then they are clearly inferior. For example, consider that encoding the number 7 will requ
44.
by cpldcpu 1y ago
It was also a question from my side. :) But I understand that they simulate the spikes as integer events in the forward pass (as described here https://github.com/BICLab/Int2Spike ) and calculate a continuous gradient b
45.
by cpldcpu 1y ago
Well, it would still allow to deploy the trained model to SNN hardware, if it existed.
46.
by cpldcpu 1y ago
>The current implementation adopts pseudo-spiking, where activations are approximated as spike-like signals at the tensor level, rather than true asynchronous event-driven spiking on neuromorphic hardware. Isn't that in essence very
47.
by cpldcpu 1y ago
Nice! Thank you for the pointers.
48.
by cpldcpu 1y ago
Thank you for mentioning this! Indeed, a practical application of the flame oscillation research is fire detection and monitoring of combustions processes. I should have mentioned this somewhere.
49.
by cpldcpu 1y ago
Thank you for your comment, indeed! I think the main confusion for analog implementations of chaotic circuits is that they often have an inherent source of noise (e.g. johnson or flicker noise of resistors, transistors) which will be amplif
50.
by cpldcpu 1y ago
Nice, I was not aware of that! Quite interesting. Thank you for the source. It seems to be a corner case. As I learned to know them, chaotic circuits have unpredictable cyclic behavior. Chua's circuit typically follows an oscillatory b
51.
by cpldcpu 1y ago
Chaotic circuits are neat, but they are actually not random (their output distribution is not uniform or gaussian). And candles are not random either :) btw, slightley related: https://cpldcpu.com/2020/06/15/b
52.
by cpldcpu 1y ago
You what is even easier than using Emacs to operare ffmpeg? Just use claude-code (or one of the other CLI code-agents)...
53.
by cpldcpu 1y ago
The self-trimming wick is the trick. Before that was invented, people had to use special scissors to trim the wick and avoid uncontrollable large (and flickering) candle flames. https://en.wikipedia.org/wiki/History_of_
54.
by cpldcpu 1y ago
This was 10-15 years ago. In between they used dedicated ASICS: https://cpldcpu.com/2013/12/08/hacking-a-candleflicker-led/ And more recently simply microcontrollers: https://cpldcpu.com&#x2F
55.
by cpldcpu 1y ago
The third reference from the article provides some pointers (see also references there). https://arxiv.org/pdf/1803.10400 But its not trivial at all, its a complex fluid dynamics problem. I stumbled upon all the "
56.
Candle Flame Oscillations as a Clock(cpldcpu.com)
339 points by cpldcpu 1y ago|77 comments
57.
by cpldcpu 1y ago
I think you misunderstand what this does. It is not only a coding agent. It is an abstraction layer between you and the computer.
58.
by cpldcpu 1y ago
They decided to pivot to innovation that does not require extreme CMOS scaling. For example, they focussed heavily on ultra-low-power SOI at 28nm. Keep in mind that your iphone only has very few chips in <10nm technology. The rest is usi
59.
by cpldcpu 1y ago
I thought the snark was rather the hallmark, but i'll take it... But, yes, they are a search engine. However it seems that all the other frontier LLM companies easily copied this as a feature, so one has to wonder which part is really
60.
by cpldcpu 1y ago
Isn't perplexity rather a "wrapper" company? Wouldn't acquiring a UX focused company bring enormous difficulties in integration, to retain Apples look and feel? What seems to be missing for Apple is access to competitive

More ›