mikeshi42

8 ms·

61.
by mikeshi42 2y ago
(shameless plug) maybe it was us? https://github.com/hyperdxio/hyperdx
62.
by mikeshi42 2y ago
Surprisingly I did as well, at least for me it looks like I just misread it (some sort of human bias?) Interesting to be n=3.
63.
by mikeshi42 2y ago
I didn’t downvote but s3 does have low latency offerings (express). Which has reasonable latency compared to EFS iirc. I’d be shocked if it was as popular as the other higher latency s3 tiers though.
64.
by mikeshi42 2y ago
Matt Levine recently covered how it's much more lucrative/easy to sue Chipotle for skimping out on their portions from the investor/security fraud angle than it is the customer angle [1] Unfortunate how that's just how t
65.
by mikeshi42 2y ago
wow gmail drive is a walk down memory lane :) really is amazing how far we've come since then!
66.
by mikeshi42 2y ago
Yup! Since we're built on Otel, we suggest you can use the HTTP OTLP endpoint, which is yourdomain:4318/v1/logs, we have a quick blog post on that on how to curl a payload over: https://www.hyperdx.io/blog&#x2
67.
by mikeshi42 2y ago
Yup it'd work if the Clickhouse HTTP interface is preserved, along with the CH-specific functions/settings we leverage. (I'm not sure how deviated your fork is from CH and which version it's based on) Proton looks like a
68.
by mikeshi42 2y ago
Yup! We're agnostic to the storage medium underneath as Clickhouse's interface doesn't change based on the disk layout backing the table. In our hosted version we use S3 as well. They have their docs on that setup here: http
69.
by mikeshi42 2y ago
Thank you, really appreciate feedback like that! :D
70.
by mikeshi42 2y ago
yes! the full stack includes our recommended schema which has the indexes set up - it's a drop in replacement for anything that would ingest Otel-based telemetry! If you already have Promtail setup - you might want to set up a collecto
71.
by mikeshi42 2y ago
thank you! means a lot coming from you ;) Speaking of the system tables - it's awesome how much telemetry is saved in there that helps us build a really powerful preset clickhouse monitoring dashboard (heavily inspired from the built-i
72.
by mikeshi42 2y ago
You'd generally add an index to your logs in Clickhouse to do searching (via ngram or token bloom filters typically: https://clickhouse.com/docs/en/optimize/skipping-indexes#blo... ). There's other w
73.
by mikeshi42 2y ago
Totally fair! Here's a few on the top of my head, they're mostly about Elastic really but of course Kibana is only really useful on ES: 1. At my last job we were running some of the largest elastic clusters of our hyperscaler&#x27
74.
by mikeshi42 2y ago
If you're using the Grafana Clickhouse plugin - a number of things we do differently to them today: - We support Lucene-based search, which means it's a lot easier to find the events you're looking for without needing to brea
75.
by mikeshi42 2y ago
Thank you Max! It's awesome to hear that :)
76.
by mikeshi42 2y ago
Our v1 is completely built on Clickhouse! So v2 is making it more widely compatible to Clickhouse installations that aren't tied to our ingestion pipeline and schema. So if you're already on Clickhouse for obseravbility today, or
77.
by mikeshi42 2y ago
Hrm while we aren't a 1:1 Kibana replacement today (we're not apples to apples since Kibana is locked into Elastic, whereas we're on Clickhouse) - I don't think we're too far off with our UI-based filters, Lucene fi
78.
by mikeshi42 2y ago
Ahh yeah fwiw it wasn't _intended_ to be a dig at the open source status of Kibana - but rather we're open source and building on top of Clickhouse. On the commercial OSS side of things - I suspect the trend there is more nuanced
79.
Show HN: Open-source Kibana alternative for logs and traces in ClickHouse(github.com)
125 points by mikeshi42 2y ago|40 comments
80.
by mikeshi42 2y ago
Do you have any plans to be able to take TypeScript types to do type optimizations? That sounds like a bonus to me to be able to have easier implementation and faster run times.
81.
by mikeshi42 2y ago
In AWS iirc NVMe max out at 2GB/s - I'm not sure why that's the case. I know there were issues with the PCIe controller in the past being the bottleneck, but I suspect there's something more to it than that.
82.
by mikeshi42 2y ago
Agreed. At the end of the day - the end user of the software probably wants something other than technical debt reduction, so it's not surprising impact and LOC can roughly be correlated. Taking the LOC metric too far, in either direct
83.
by mikeshi42 2y ago
> Somewhat hilariously I was a manager during Covid, and as such I saw the metrics which showed that every worker group in the city I was working for was happier and more productive. I'm curious how productivity was measured for tha
84.
by mikeshi42 2y ago
> I can't evaluate the correctness of a choice without either knowing the motivation for it, or by learning the problem domain well enough to identify and make the choice myself - at which point the convenience of the AI solution is
85.
by mikeshi42 2y ago
I'm assuming by bullshitting you mean differentiating between LLM hallucinations and a human with low confidence in their code. I've found that LLMs do sometimes acknowledge hallucinations. But really the check is much easier than
86.
by mikeshi42 2y ago
I've done some porting between Python and JS based on Tensorflow in the past - and I suspect the poor ergonomics in JS for math/lists would probably ruin the experience a good amount. Perhaps something like Pyodide can bridge the
87.
by mikeshi42 2y ago
I read this exact reply N days ago... okay exact is stretching it but you get the point ;) https://news.ycombinator.com/item?id=41683174
88.
by mikeshi42 2y ago
I agree the cat is out of the bag, but GANs do not work like that. One of the common failure modes in training a GAN is that the discriminator gets too powerful too quickly and the generator then can no longer learn. Hard to say anything is
89.
by mikeshi42 2y ago
Curious if https://github.com/hyperdxio/hyperdx passes the bar for looking good! (disclaimer: I'm a maintainer that's done a good chunk of the UI - but I also love candid feedback)
90.
by mikeshi42 2y ago
How are you guys using sqlite in dev instead of clickhouse? (Afaik there's a good bit of difference between the two dialects so I'm surprised it's possible without hurting dx through one compromise or another)

More ›