samwho

5 ms·

31.
by samwho 10mo ago
I love this, the end result looks so good. Something you don’t really mention in the post is why do this? Do you have an end goal or utility in mind for the book shelf? Is it literally just to track ownership? What do you do with that infor
32.
by samwho 10mo ago
Thank you <3
33.
by samwho 10mo ago
Thank you! <3 These are all built with React and CSS animations (or the Web Animations API where I needed it). I’m not very good at React so the code is a real mess. 2 of the components also use threejs for the 3D bits. For the stuff on
34.
by samwho 10mo ago
Simon, you’re too kind. Thank you. <3
35.
by samwho 10mo ago
When I was writing this, GPT 5.1 was the latest and it got it right away. It’s the sequence of prime numbers fwiw :)
36.
by samwho 10mo ago
How would information leak, though? There’s no difference in the probability distribution the model outputs when caching vs not caching.
37.
by samwho 10mo ago
The only thing that comes to mind is some kind of timing attack. Send loads of requests specific to a company you’re trying to spy on and if it comes back cached you know someone has sent that prompt recently. Expensive attack, though, with
38.
by samwho 10mo ago
I was wondering about this when I was reading around the topic. I can’t personally think of a reason you would need to segregate, though it wouldn’t surprise me if they do for some sort of compliance reasons. I’m not sure though, would love
39.
by samwho 10mo ago
With KV caching as it’s described there it has to be a prefix match. OpenAI state in their docs they don’t cache anything below 1024 tokens long, and I’m sure I read somewhere that they only cache in 1024 token blocks (so 1024, 2048, 3072,
40.
by samwho 10mo ago
Could you tell me what browser/OS/device you’re using? A few people have said this and I haven’t been able to reproduce it.
41.
by samwho 10mo ago
Another person had this problem as well and we couldn’t figure out what causes it. We suspect something to do with WebGL support. What browser/device are you using? Does it still break if you disable all extensions? I’d love to fix thi
42.
by samwho 10mo ago
It’s funny, I didn’t set out for that to be the case. When I pitched the idea internally, I wanted to scratch my own itch (what on earth is a cached token?) and produce a good post. But then I realised I had to go deeper and deeper to get t
43.
by samwho 10mo ago
Yay, glad I could help! The sampling process is so interesting on its own that I really want to do a piece on it as well.
44.
by samwho 10mo ago
Yeah! It’s planned for sure. It won’t be the direct next one, though. I’m taking a detour into another aspect of LLMs first. I’m really glad you liked it, and seriously the resources I link at the end are fantastic.
45.
by samwho 10mo ago
Huh, when I was writing the article it was GPT-5.1 and I remember it got it no problem.
46.
by samwho 10mo ago
Thank you so much <3
47.
by samwho 10mo ago
It is the same ngrok! The product has grown a lot since the mid 2010s. Still got free localhost tunnelling, but we also have a whole bunch of production-grade API gateway tooling and, as of recently, AI gateway stuff too.
48.
by samwho 10mo ago
Thank you so much <3 Yes, I recently wrote https://github.com/samwho/llmwalk and had a similar experience with cache vs no cache. It’s so impactful.
49.
Prompt caching for cheaper LLM tokens(ngrok.com)
306 points by samwho 10mo ago|72 comments
50.
Show HN: Llmwalk – explore the answer-space of open LLMs(github.com)
4 points by samwho 10mo ago|0 comments
51.
“Are you the one?” is free money(blog.owenlacey.dev)
481 points by samwho 10mo ago|115 comments
52.
by samwho 11mo ago
The one where he does a landscape is one of my favourite videos of all time.
53.
by samwho 1y ago
Someone gave me the advice to use animals, ideally animals of very different sizes or colours. People instantly picture them and remember them.
54.
Why ports <1024 are privileged and require root(utcc.utoronto.ca)
13 points by samwho 1y ago|0 comments
55.
by samwho 1y ago
This is what I use and I’ve been very happy with it for many years. It hasn’t caused me any trouble and as far as I can tell it hasn’t changed in the whole time I’ve used it.
56.
by samwho 1y ago
Hehe, yes, Ned sent me a lovely email the other day about it. Happy to be doing my part.
57.
by samwho 1y ago
Can’t imagine what it might be.
58.
by samwho 1y ago
I’m not sure that’s quite my position. Happy to cede that I lack fluency, and I appreciate your time and the time others have given to help me understand.
59.
by samwho 1y ago
I did push up a rewording that hopefully lands better. Fingers crossed.
60.
by samwho 1y ago
Thank you, I appreciate that a lot.

More ›