rao-v

3 ms·

1.
by rao-v 9d ago
I'd love a extension setting to only send tabs that were visible for ~4+ seconds. I built myself a little extension last year that tracks what information I was looking at, but focused on generating "new info" recaps for the
2.
by rao-v 9d ago
Hey Victor! Been following you since HVM/Kind, partly because I'm moderately unhappy with the state of out of the box automatic parallelism in modern languages! Do you plan to invest in profile guided optimization or autotuning in
3.
by rao-v 9d ago
I absolutely love that someone is doing this! Why isn’t IBM for Granite or Google for Gemini? If you are going to develop a near frontier model, and you don’t think you have special sauce up your sleeve, why not making training runs and RL
4.
by rao-v 11d ago
Turns out this is more compute intensive than regular backprop. The win (if any) would be in training on future highly distributed architectures where neighbouring parts of the model have accesss to very high bandwidth (to each other) but c
5.
by rao-v 11d ago
I wonder if you could take a traditional backprop trained LLM and apply this approach to finetuning it (presumably needs less memory and compute?). It could be another entry in the spectrum between LORA and full fine tuning.
6.
by rao-v 14d ago
I tried modifying the provided CadQuery skill to work with build123d with an agent (surprisingly gemini pretty good at this) and it produced very good results (possibly better than the reported CadQuery/OpenSCAD results after taking a
7.
by rao-v 14d ago
There is better than even odds I'm older than you, so I'd recommend you rethink using phrases like "possibly longer than you've been alive", it's not ... polite regardless of people's age. The point (and I
8.
by rao-v 14d ago
Threads were historically expensive enough that “just spawn a thread” wasn’t a reasonable thing to do in many situations. Thread pools were sort of a last resort, and we ended up with control flow like objects (futures, await etc.) to multi
9.
by rao-v 14d ago
I remember being so mad years ago, coming from a pure CS background, when it dawned on me that async await was “mere” control flow and not actual parallelism. It’s why I feel go (with go routines being the norm) is one of the few imperative
10.
by rao-v 15d ago
Isn't this the sort of thing Google is supposed to be doing for us?
11.
by rao-v 15d ago
I like the idea of making it trivial to work across multiple machines but I’d really prefer not to have to trust your coordination server and encryption approach etc. Could this (optionally) just run over Tailscale (I suppose ssh is always
12.
by rao-v 16d ago
umm what are you talking about? Basically this crowd (esp. folks like me who run medium models locally) like open stuff and can be a tiny bit unenthused about opaque mysteries handed down from on high. You'll see people delighted with
13.
by rao-v 16d ago
As I also said on Twitter - it really amazes me how fearless Deepseek are. Every single model release is packed with new and crazy clever ideas and somehow, they always commit to training them at near frontier scale. I know everybody wants
14.
by rao-v 16d ago
This is really neat! I'd be tempted to try this again targetting ~1B params and the entire cookbook of "current" small model ideas: gated delta nets (or is ~2K context too short to benefit?), per layer or n-gram embeddings, g
15.
by rao-v 16d ago
Devin … now that’s a name I’ve not hear in a long time
16.
by rao-v 17d ago
It’s reasonable to wonder about what chat usage data gets into models (to be honest probably quite little - carefully curating training data and creating higher quality synth data seems to be the current approach) and the implied risk to pr
17.
by rao-v 17d ago
For what it’s worth rando redditers warns that cannon.js is old. I found the remarkable https://babylonjs.com/lite-demos/ Both the regular and lite demos are pretty amazing for browserware!
18.
by rao-v 18d ago
Does anyone have an efficient, reasonably designed three.js or other web oriented mini game engine? Low poly but modern rendering effects should be a good niche for hobbyist stuff but hard to find.
19.
by rao-v 18d ago
Really appreciate this perspective. It’s tempting to stop at being amazed at what these models can do, but my experience matches yours - they need help with details to do well.
20.
by rao-v 18d ago
As a bandaid solution we probably just need a good base domain for game wikis attached to a somewhat trustworthy foundation (that won’t sellout to Fandom in a week). Agree that wierdgloop.org is not … great
21.
by rao-v 18d ago
It’s really interesting how much little choices make the result better or worse. Astra and one of the GLMs added bright lights, and thus looked so much better to my eye. Genuinely happy with some of the Qwen 3.8 results (especially since I
22.
by rao-v 19d ago
I hear you but point me to one novel formalization right now that is not Lean. It’s really becoming a refacto standard. Which is lovely but terrible for pedegogy
23.
by rao-v 20d ago
Your point is pretty fair. The reason I think the top 100 pro would win is that when I watch pros review they are very quick to catch when someone is playing a non-current or up to date style. I’ve also seen a few middle game situations whe
24.
by rao-v 22d ago
Right? Might be worth another shot
25.
by rao-v 22d ago
An aside on Lean and it's massive library of results: As someone who's put non trivial effort into slowly learning geometric algebra, lie theory and other slightly advanced math topics, I have to say my brain cannot read Lean. It
26.
by rao-v 22d ago
In a march 2026 interview David Wu (lightvector, Katago’s creator at Jane Street) noted that he doesn’t have a systematic solution for the cyclic group problem, but adding examples to the training set mostly ensures Katago during MCT rollou
27.
by rao-v 22d ago
The problem is ambient go knowledge. A top 100 player would easily beat time traveling Lee Changho in his first few matchups. Of course give peak Lee Changho a fortnight to prep with Katago and … well that would be something!
28.
by rao-v 23d ago
Could someone sufficiently motivated invest in training Katago to be able to beat Shin Jinseo with 3 stones of handicap? Unfortunately - probably yes. This in no way detracts from how absurd and remarkable it is that Shin Jinseo can beat Ka
29.
by rao-v 23d ago
It’s worth understanding that Shin Jinse has been significantly stronger than his nearest human opponents for a while now, more so than Magnus was even at his very peak. In go ELO like scoring he’s something like 120 points over the next st
30.
by rao-v 24d ago
DF isn't 2D anymore! Back in the day it was literally dig down and dig left right, no Z axis.

More ›