shikhar

6 ms·

31.
by shikhar 1y ago
Essentially CacheLib in Rust > foyer draws inspiration from Facebook/CacheLib, a highly-regarded hybrid cache library written in C++, and ben-manes/caffeine, a popular Java caching library, among other projects. https:/&#
32.
by shikhar 1y ago
TIL https://kubernetes.io/blog/2025/03/25/swap-linux-improvement...
33.
by shikhar 1y ago
Foyer is a great open source contribution from RisingWave We built a S3 read-through cache service for s2.dev so that multiple clients could share a Foyer hybrid cache with key affinity, https://github.com/s2-streamstore&#x2
34.
by shikhar 1y ago
Hi mertletee, I'd like to understand the request better, mind dropping me an email? It's in my profile
35.
by shikhar 1y ago
Check out ZeroFS ( https://www.zerofs.net ), which is using SlateDB ( https://slatedb.io/ ) ED: Now I catch your drift, it would indeed be cool. ZeroFS requires a commitment to the SlateDB LSM data format.
36.
by shikhar 1y ago
Yes, that's how we are running it at s2.dev, auto-scaled per-AZ deployments. https://www.reddit.com/r/databasedevelopment/comments/1nh1go...
37.
Read-through cache for object storage(github.com)
3 points by shikhar 1y ago|0 comments
38.
by shikhar 1y ago
Very cool! Maybe you'll consider turning it distributed by using s2.dev for the append-only event logs :) Someone tried this with XTDB, https://github.com/chucklehead-dev/s2-log
39.
by shikhar 1y ago
How we run it: Auto-scaled Kubernetes deployments, one for each availability zone, currently on m*gd instances which give us local NVMe. The pods are able to easily push GiBps with 1-2 CPUs used — network is the bottleneck so we made it a s
40.
Show HN: Cachey, a Read-Through Cache for S3(github.com)
3 points by shikhar 1y ago|2 comments
41.
Reliable(catherinejue.com)
2 points by shikhar 1y ago|1 comments
42.
by shikhar 1y ago
Architecturally, there are a lot of the same considerations. A key difference is that we offer streams as a cloud API, and it does not have WarpStream's BYOC split – where some stuff runs in your environment and metadata lives in the
43.
by shikhar 1y ago
> Jetstream clusters don't scale to many servers (they recommend max 3, I think) Jetstream is even more limited than most Kafkas on number of streams https://github.com/nats-io/nats-server/discussions/
44.
by shikhar 1y ago
You might like what we are building with https://s2.dev :)
45.
by shikhar 1y ago
S2 is a multi-tenant service and we multiplex granular streams for cost efficiency. I believe the Prime Video migration was about compute...
46.
Multi-Player Durable Stream Playground(s2.dev)
9 points by shikhar 1y ago|4 comments
47.
by shikhar 1y ago
Open it in another browser or share the unique URL with someone else for a BBS experience.
48.
Why Agents Need Granular Streams(s2.dev)
1 points by shikhar 1y ago|0 comments
49.
Durable, multi-player pseudo-terminal(github.com)
3 points by shikhar 1y ago|0 comments
50.
Remote log implementation for XTDB using s2.dev(github.com)
3 points by shikhar 1y ago|1 comments
51.
by shikhar 1y ago
XTDB is an open-source bitemporal database S2 is a serverless durable stream API
52.
by shikhar 1y ago
We have a customer using s2.dev for this capability – granular tail-able streams with granular access control (e.g. let an end user of a job tail it with a read-only access token). We'll be shipping an OTel endpoint soon to make it eve
53.
Multi-player, serverless, durable terminals(s2.dev)
2 points by shikhar 1y ago|0 comments
54.
Streams as access-controlled web resources(s2.dev)
1 points by shikhar 1y ago|0 comments
55.
Keeping Time on a Stream(s2.dev)
5 points by shikhar 1y ago|0 comments
56.
Deterministic simulation testing for async Rust(s2.dev)
107 points by shikhar 2y ago|10 comments
57.
Streaming changes from Postgres: the architecture behind Sequin(blog.sequinstream.com)
1 points by shikhar 2y ago|0 comments
58.
by shikhar 2y ago
We have had interest in using our serverless stream API ( https://s2.dev/ ) to power sync engines. Very excited about these kinds of use cases, email in profile if anyone wants to chat.
59.
Serverless primitives for the shared log architecture [video](hytradboi.com)
4 points by shikhar 2y ago|0 comments
60.
by shikhar 2y ago
We were looking at the main branch of the sha2 crate at first, where the 'asm' feature has been removed (but this is unreleased, will be in 0.11.x) https://github.com/RustCrypto/hashes/blob/master&#x

More ›