nijave

22 ms·

511.
by nijave 1y ago
You might be able to use big telemetry vendor libraries for instrumentation. Iirc you can use ddtrace Python library and have it send to otel collector which will convert from DD span format to otel. I haven't tried but it's proba
512.
by nijave 1y ago
Not sure about preferred but Jaeger is pretty simple for tracing only. Hyperdx looks interesting but brings in both Mongo and Clickhouse which imo is pretty heavy Native k8s logs + Prometheus is probably more on the lighter weight side but
513.
by nijave 1y ago
I thought New Relic was pretty good but their per seat license cost is super high They have a SQL like query language that I think can do most of what you're describing
514.
by nijave 1y ago
>slightly increased latency They didn't provide any details on latency. It could have been delayed an hour or a day and no one noticed
515.
by nijave 1y ago
Back when we used Azure the only outcome was them trying to upsell us on Premium Support
516.
by nijave 1y ago
A cap on region size could have helped. Region isolation didn't fail here so splitting us-east-1 into 3,4,5 would have been a smaller impact Having such a gobstoppingly massive singular region seems to be working against AWS
517.
by nijave 1y ago
I was under the impression it's similar to IAM where the control plane is in us-east-1 and the config gets replicated to other regions. In that case, existing stuff would likely continue to work but updates may fail
518.
by nijave 1y ago
Maybe decode was the wrong word. I was thinking more along the lines of "analyze" which would entail understanding what the binary is doing after downloading it I remember tons of "what's this JS/PHP blob do I found
519.
by nijave 1y ago
I was thinking more along the lines of the NLB being in front of DNS servers and dropping resolvers Or an NLB could also be load balancing by managing DNS records--it's not really clear what a NLB means in this context Or there was an
520.
by nijave 1y ago
Was the Dynamo outage separate? My take was the NLB issue was the root cause and Dynamo was a symptom which they flipped some internal switches to mitigate the impact to that dependency
521.
by nijave 1y ago
You can spin up an ssh server on GitHub Actions macOS runner or most cloud providers you can rent a box
522.
by nijave 1y ago
The "old fashioned" way was to post on an internet message board or internet chatroom and let someone else decode it.
523.
by nijave 1y ago
Obligatory: Kafka is a log, not a message queue (although it turns out there's a lot of overlap)
524.
by nijave 1y ago
[09:13 AM PDT] We have taken additional mitigation steps to aid the recovery of the underlying internal subsystem responsible for monitoring the health of our network load balancers and are now seeing connectivity and API recovery for AWS s
525.
by nijave 1y ago
I don't think that's necessarily true. The outage updates later identified failing network load balancers as the cause--I think DNS was just a symptom of the root cause I suppose it's possible DNS broke health checks but it s
526.
by nijave 1y ago
>we come away underwhelmed In fairness, that's been my experience with everyone except OpenAI and Anthropic where I only occasionally come out underwhelmed Really I think AWS does a fairly poor job bringing new services to market an
527.
by nijave 1y ago
For us, we had some minor impacts but most stuff was stable. Our bigger issue was 3rd party SaaS also hosted on us-east-1 (Snowflake and CircleCI) which broke CI and our data pipeline
528.
by nijave 1y ago
Like the other poster said, you need to use a different region. The default region (of course) sends you to us-east-1 e.x. https://us-east-2.console.aws.amazon.com/console/home
529.
by nijave 1y ago
It was certainly suspicious that actual progress on the outage seemed to start right around U.S. west coast start of day. Updates before that were largely generic "we're monitoring and mitigating" with nothing of substance.
530.
by nijave 1y ago
parts of S3 (although maybe that's better after that major outage years ago)
531.
by nijave 1y ago
Have you tried redirecting the bot in a loop? That should allow it to keep making a ton of requests and hopefully generate traffic they'll have to pay for. Another idea is replying with large cookies and seeing if the bot saves them an
532.
by nijave 1y ago
What gets me is when it's faster to build an index and rerun the query from scratch than run the original.
533.
by nijave 1y ago
There's still value in eliminating ways your program can wrong even if you can't eliminate all of them. Using your logic, why bother testing at all.
534.
by nijave 1y ago
Not sure about other languages but I believe the stock test tooling for `go` generates a random sorting seed and has a flag to run tests concurrently. You can also manually pass the seed to simulate a certain ordering. While not perfect, ou
535.
by nijave 1y ago
Zuora (billing and payment SaaS) has a user facing SQL interface backed by Trino that works pretty well
536.
by nijave 1y ago
Gluetun can handle the VPN connection part for a bunch of providers
537.
by nijave 1y ago
>My understanding is that AWS KMS uses AWS designed HSMs That's my take as well reading about how they handle firmware (sounds like they're using their own chips, presumably similar to how they use other hardware acceleration a
538.
by nijave 1y ago
MCP and agents seem like a solutions but as far as I know maintaining sufficient context is still a problem I.e. ability to plug in expert data sources
539.
by nijave 1y ago
I don't know much about it but apparently we've been having success at work with Figma MCP hooked up to Claude in Cursor. Apparently it can pull from our component library and generate useable code (although still needs engineerin
540.
by nijave 1y ago
Maybe AI isn't artificial enough here...

More ›