3 ms·
The fact that by hand is emphasized so often and so often (see src/handgpt.h comments as well above backward()) makes me think it's AI. Anyways, it looks like
by porridgeraisin 3mo ago
The fact that by hand is emphasized so often and so often (see src/handgpt.h comments as well above backward()) makes me think it's AI.
Anyways, it looks like gradients derived by hand means they didn't use autograd. They have written out the expression for dL/dW themselves.
- 4gotunameagain 3mo agoI think the readme is clearly LLM generated. The tone, the short sentences, the em dashes, lists, sections.. It all feels like LLM.
- Tiberium 3mo agoThe author is also replying with an LLM on HN: https://news.ycombinator.com/item?id=49180716 https://news.ycombinator.com/item?id=49180716
- wikisailor 3mo agoCorrect. No autograd: the expressions for the gradients are written out explicitly in C. There's a gradient check in tests/ that verifies them against centred finite differences on the published header, worst relative error 1.07e-08.