ifz

3 ms·

1.
Show HN: Replay an AI Coding Session and Inspect Its Requests(ishamf.dev)
1 points by ifz 5d ago|0 comments
2.
by ifz 16d ago
Oh, I actually didn't know about Bertviz before. That looks interesting as well!
3.
by ifz 16d ago
Thanks for trying it out! You can hover / click / tap on any word to focus it. I actually intended for this to be main way to use the visualization, I just added the auto-playback later on so it's more eye-catching on page lo
4.
by ifz 18d ago
Hmm, I might try to add some controls to limit which layers get summed up. It might be able to reveal more patterns. Right now only simple correlations are visible.
5.
by ifz 18d ago
It's really simple, basically just the magnitude of the value vector, weighted by QK dot product, summed across all attention heads and layers. When I started, I expected I'd have to experiment a lot to find something comprehensib
6.
by ifz 18d ago
I don't disagree with that. I did add an entire caveat paragraph there. To me, it's more of a neat visualization, not something that can be used to interpret LLM behavior. Even with a lot of simplification, it can show some intere
7.
Show HN: LLM Attention Visualization(ishamf.dev)
176 points by ifz 18d ago|32 comments
8.
Show HN: Timezone Converter in Map Form(ishamf.dev)
2 points by ifz 1y ago|0 comments
9.
by ifz 3y ago
Nowadays, you can get a free VM from some providers (GCP) and there are lots of sites where you can deploy a static website for free (github pages). I'd argue deploying something for free is easier than ever.