shayonj

5 ms·

31.
SFQ: Simple, Stateless, Stochastic Fairness(brooker.co.za)
2 points by shayonj 8mo ago|0 comments
32.
A simple L7 proxy for vLLM that manages LoRA adapter storage via NVMes(github.com)
1 points by shayonj 8mo ago|0 comments
33.
Let's Discuss Sandbox Isolation(shayon.dev)
2 points by shayonj 8mo ago|0 comments
34.
Let's Discuss Sandbox Isolation(shayon.dev)
2 points by shayonj 8mo ago|0 comments
35.
A managed disk adapter storage and routing layer for LoRA adapters on vLLM(github.com)
2 points by shayonj 8mo ago|0 comments
36.
by shayonj 8mo ago
Very cool to see this and something I have been curious about myself and exploring the space as well. I'd be curious what are some parallels and differentiations between this and NVIDIA's stdexec (outside of it being in Rust and u
37.
Simple CUDA-checkpoint wrapper to freeze and restore GPU processes quickly(github.com)
3 points by shayonj 8mo ago|0 comments
38.
Manage, freeze and restore GPU processes quickly(github.com)
2 points by shayonj 8mo ago|0 comments
39.
Understanding How GIL Affects Checkpoint Performance During LLM Training(shayon.dev)
2 points by shayonj 8mo ago|0 comments
40.
Understanding How GIL Affects Checkpoint Performance in PyTorch Training(shayon.dev)
1 points by shayonj 8mo ago|0 comments
41.
by shayonj 8mo ago
Being able to debug and diagnose difficult problems and distributed systems still remains a key skill, at least until Opus or some other model gets better at it. I think being intentional about learning while using AI to be productive is wh
42.
by shayonj 9mo ago
yeah, got confirmation of > Increased API Error Rates in Region: eu-west-1 where s3 Service is affected.
43.
Ask HN: AWS/S3 Outage?
3 points by shayonj 9mo ago|3 comments
44.
Strategies and lessons from partitioning a 17TB table in PostgreSQL(tines.com)
2 points by shayonj 9mo ago|0 comments
45.
by shayonj 9mo ago
This! Only thing worse than your main queue backing off is you dropping items from going into the DLQ because it can’t stay up.
46.
by shayonj 9mo ago
v cool and impressive!
47.
Strategies and lessons from partitioning a 17TB table in PostgreSQL(tines.com)
5 points by shayonj 9mo ago|0 comments
48.
Partitioning a 17TB Table in PostgreSQL(tines.com)
5 points by shayonj 9mo ago|0 comments
49.
What does Software Engineering mean when machine writes the code(shayon.dev)
1 points by shayonj 9mo ago|3 comments
50.
by shayonj 9mo ago
> more to do with the deeply unfussy work of actual context engineering. I agree. There is something to be said about autonomous systems producing valid outcomes within the current constraints of RL
51.
Software engineering when machine writes the code(shayon.dev)
1 points by shayonj 9mo ago|0 comments
52.
A hypothetical search engine on S3 with Tantivy and warm cache on NVMe(shayon.dev)
2 points by shayonj 11mo ago|0 comments
53.
by shayonj 11mo ago
Sadly, its not the first time I have noticed unexpected and odd behaviors from Aurora PostgreSQL offering. I noticed another interesting (and still unconfirmed) bug with Aurora PostgreSQL around their Zero Downtime Patching. During an Auror
54.
Lessons from moving live PostgreSQL database with zero downtime(tines.com)
3 points by shayonj 11mo ago|0 comments
55.
Zero downtime PostgreSQL migration – Lessons from moving live production data(tines.com)
2 points by shayonj 11mo ago|0 comments
56.
A hypothetical search service on S3 with Tantivy and warm cache on NVMe(shayon.dev)
2 points by shayonj 11mo ago|0 comments
57.
by shayonj 11mo ago
"juice wasn't worth the squeeze" - adding that to my vocab
58.
by shayonj 1y ago
I was kinda surprised the lack of CAS on per-endpoint plan version or rejecting stale writes via 2PC or single-writer lease per endpoint like patterns. Definitely a painful one with good learnings and kudos to AWS for being so transparent a
59.
Mutable atomic deletes with Parquet backed columnar tables on S3(shayon.dev)
1 points by shayonj 1y ago|0 comments
60.
by shayonj 1y ago
Here is another take on deletes through by just updating the row groups in Parquet file through multi part upload and UploadPartCopy - https://www.shayon.dev/post/2025/285/mutable-atomic-deletes-...

More ›