brancz

10 ms·

91.
by brancz 4y ago
Super interesting! It's interesting to think about what Zanzibar ultimately is: an efficient way to store and traverse graphs to determine an outcome, in this case typically authorization, but ever since I learned of this I keep seeing
92.
by brancz 4y ago
Quick correction, actually Delve uses DWARF unwind information for every code location, including those from Go, even if frame pointers are present.
93.
by brancz 4y ago
That's right, but Delve also needs to use DWARF to walk stacks that involve CGO, where it can't rely on frame pointers being present.
94.
by brancz 4y ago
Having worked with eBPF for a while now, it’s actually interesting how it makes you think about useful limits, that we typically defer thinking about. For example instead of writing code that validates a string and then doesn’t care about t
95.
by brancz 4y ago
Could not agree more! Unfortunately, I don't think we'll realistically be able to convince everyone, and even if we did convince everyone to have frame pointers tomorrow, it would still take years to take effect. So for the forese
96.
by brancz 4y ago
Looks like there is another active submission: https://news.ycombinator.com/item?id=33788883 (maybe they can be merged since they were submitted so close to each other?)
97.
by brancz 4y ago
Thanks for discovering and posting so fast! Would it be possible to merge the two submissions that are currently active? https://news.ycombinator.com/item?id=33788794
98.
DWARF-Based Stack Walking Using eBPF(polarsignals.com)
140 points by brancz 4y ago|64 comments
99.
by brancz 4y ago
I don’t really know either very well, but how does Noria compare to Naiad? Are they comparable at all? I already had Naiad on my reading list, definitely adding Noria as well! Thank you very much for your work!
100.
Improved profile sharing service – pprof.me(polarsignals.com)
4 points by brancz 4y ago|0 comments
101.
Exploring Go's Profile-Guided Optimizations(polarsignals.com)
4 points by brancz 4y ago|0 comments
102.
by brancz 4y ago
I don't know enough about wasm runtimes, but for example JIT runtimes like nodejs (or JVM via perf-map-agent [0]) allow writing out debug infos via the Linux Kernel JIT-Interface [1], which debuggers and profilers can then pick up to s
103.
by brancz 4y ago
I happen to work on a lot of profiling and debugging tools and I’ve been wondering if the wasm spec has included anything about the “debugability” of wasm binaries. After a quick scan of the table of contents I couldn’t find it but I’d be c
104.
by brancz 4y ago
While I think arcticDB could be used for logging, the strategy is quite different. Loki does something more analogous to the time-series approach, but that’s ok because the selection queries are primarily to select the process you want to s
105.
by brancz 4y ago
As it stands, right now the query planner doesn’t look at any of the data (yet) when putting together the plan, but this will inevitably happen.
106.
by brancz 4y ago
ArcticDB has a general purpose dataframe-like query builder that Parca uses to build its queries. The query engine scans parquet row groups and those that may contain interesting data are converted to arrow and go through the query plans th
107.
by brancz 4y ago
Not yet, but we will soon, though we already rotate the in memory state when a certain (configurable) size is reached. The idea is that we’ll put data in parquet format into object storage from where it can be consumed from any parquet comp
108.
by brancz 4y ago
Yes, that's correct! Plus the dynamic column feature, which we think is crucial for Observability-type workloads (from what we know only InfluxDB IOx supports a similar feature).
109.
by brancz 4y ago
You're absolutely right that that's confusing. Short answer: We just wanted to release this as soon as possible and haven't gotten to it yet. Slightly longer answer: We currently build parquet buffers in-memory which we are s
110.
by brancz 4y ago
It's closer to DuckDB rather than Badger/RocksDB/LevelDB, but similar in the sense that it is an embeddable database, not one that is operated standalone. It's not unlike an LSM tree, but the difference is that the leafs
111.
by brancz 4y ago
Great point! It’s important to have the data that we want to separately search and aggregate by laid out in their own column and sorted in order to allow fast processing of that data (query latency) but also achieve better compression since
112.
by brancz 4y ago
I agree, both Parquet and Arrow are super powerful technologies. This Parquet library is an absolute bliss to work with (and contribute to), the APIs are so well designed!
113.
by brancz 4y ago
Thank you so much for the feedback! By front page I assume you mean the project readme? I agree, I think we leaned a bit too far into design documentation in the readme rather than explaining why and how to use it. We'll get that fixed
114.
by brancz 4y ago
This was definitely part of the motivation, but even more importantly (and it's possible that we missed it in the duckdb documentation when we explored doing exactly this) we needed the ability to add columns dynamically when we see a
115.
by brancz 4y ago
Great questions! We're planning on persisting data in parquet format in object storage, potentially with additional metadata to help the query planner optimize queries. In terms of compression, parquet already supports various modern c
116.
by brancz 4y ago
Very good question! While we may add a textual query interface (maybe even SQL) in the future, we very intentionally started with this abstraction, since most Observability projects out there (eg. Prometheus, Grafana Loki, Parca) have speci
117.
by brancz 4y ago
Hey all, one of the creators of ArcticDB here. We're going to be around for a while and answer any questions you might have about it! It's open source so if you just want to check out the repo: https://github.com/p
118.
Introducing ArcticDB: A Database for Observability(polarsignals.com)
126 points by brancz 4y ago|31 comments
119.
Managing monorepos with Lerna and Yarn workspaces(polarsignals.com)
1 points by brancz 5y ago|0 comments
120.
by brancz 5y ago
Polar Signals founder and one of the creators of Parca here. From what I can tell ContainIQ is distinct from Parca and Polar Signals as we only concern ourselves with continuous profiling, which is complementary to metrics, logs and traces.

More ›