carlovalenti

4 ms·

1.
Show HN: My lunch-break transformer in C became a book about my toddlers(github.com)
1 points by carlovalenti 3mo ago|0 comments
2.
by carlovalenti 5mo ago
Good question, I hope the answer doesn't disappoint you too much: 1. I made no benchmark comparisons to other existing projects 2. TRiP is CPU-only 3. the matmul kernel is not hand-optimized. I have some experience in this, and made se
3.
by carlovalenti 5mo ago
It's not, except some utilities (json parser and picture handling). Please refer to the readme for full details. The main purpose was to understand the internals of transformer models by coding an engine from the ground up, so using AI
4.
by carlovalenti 5mo ago
Thank you! I hope that's useful for study and understanding
5.
Show HN: TRiP – a complete transformer engine in C built from scratch just by me(github.com)
38 points by carlovalenti 5mo ago|6 comments
6.
by carlovalenti 5mo ago
For sure Opus 4.7 is more chatty and talkative, I had to explicitly state a "be concise" preference in the settings. Is anyone experiencing some (very very rare) glitch in the output? Broken words, I mean. I'm using the WEB i
7.
by carlovalenti 5mo ago
don't miss the (formerly over-hyped) Google Research's Titans+Atlas thread, they are quite inspiring and informative on the subject; even if I don't think they released anything (open, at least) as a follow-up to their resear
8.
by carlovalenti 5mo ago
agree
9.
by carlovalenti 5mo ago
I remember a pic of a shirt, which a former colleague of mine was showing on his monitor ten years ago, and the office splitted half in recognizing the colours, can't remember if they were gold vs black; but we went crazy because nobod