francoismassot

12 ms·

91.
by francoismassot 4y ago
Hi HN folks This release marks a turning point in the project as we are adding a developer-facing feature from end to end: a new Jaeger backend to store and search your traces. To play with it, here is the documentation: https://
92.
Show HN: Quickwit 0.5 released, a new distributed tracing backend for Jaeger(github.com)
9 points by francoismassot 4y ago|1 comments
93.
by francoismassot 4y ago
I'm working on such a benchmark. I'm scared of the difficulty to be not biased though. (disclaimer: quickwit cofounder here)
94.
by francoismassot 4y ago
Here it is: http://github.com/quickwit-oss/quickwit Quickwit targets big and append-only data use cases, log search and traces in particular.
95.
by francoismassot 4y ago
One thing that I would want to see in this kind of benchmarks is the performance of these engines when data is stored on an object storage. The main reason for that is that the amount of logs, metrics, traces data can be huge... I think Lok
96.
Quickwit Rust Log Search Engine Hits 0.4(quickwit.io)
13 points by francoismassot 4y ago|0 comments
97.
by francoismassot 4y ago
You can have a look at Quickwit ( https://quickwit.io ), it's a search engine made for logs :). It's still pretty young and... there are way less features than in ES. (disclaimer: I'm one of the cofounder)
98.
by francoismassot 4y ago
You can consider also lnx that is based on tantivy and is performing quite well ( https://lnx.rs/ ).
99.
by francoismassot 4y ago
One of the reasons for not using Quickwit for user facing search is the latency: for example, you pay 70ms of latency when you make a request on AWS S3... and generally you expect latency below that figure. Decoupling compute and storage w
100.
by francoismassot 4y ago
I'm curious also about your use case (disclaimer, I'm one of the cofounder of Quickwit). Do you want simple search with a basic UI? Or some dashboarding with grafana for example? Thanks @qdequelen for pointing out Quickwit :)
101.
by francoismassot 4y ago
Yes Splunk is well known of course, I restricted myself to OSS projects.
102.
by francoismassot 4y ago
(disclaimer: I'm one of the cofounder of Quickwit.io, we are doing log search) (edited to add vector search category and add manticore) When looking at OSS search projects, it's nice to have a rough ideas of the different use case
103.
Understanding the Snowflake Query Optimizer(teej.ghost.io)
2 points by francoismassot 4y ago|0 comments
104.
Filtering a vector with SIMD instructions (AVX-2 and AVX-512)(quickwit.io)
104 points by francoismassot 4y ago|47 comments
105.
by francoismassot 4y ago
A search index is often made of smaller independent pieces often called segments. So you can download & process progressively the data locally and upload it to an object storage. And run queries on it. That's what we did here for
106.
Full-Text Search with Quickwit and ClickHouse in a Cluster-to-Cluster Context(engineering.contentsquare.com)
8 points by francoismassot 4y ago|0 comments
107.
by francoismassot 4y ago
Quickwit | Senior Software Engineer | Remote (Europe, Middle East, Asia) | Full-time Quickwit is the next-gen open-source search engine for logs at petabyte-scale data - https://github.com/quickwit-oss/quickwit . We are
108.
by francoismassot 4y ago
Nice article indeed, we ended up implementing the exact same architecture at Quickwit for... log search! :) https://twitter.com/fulmicoton/status/1526776987553263616 https://github.com/quickwit-oss
109.
by francoismassot 4y ago
Indeed, thanks for spotting that. We are fixing this.
110.
by francoismassot 4y ago
And it's open-source, MIT License. Crate: https://crates.io/crates/chitchat Github: https://github.com/quickwit-oss/chitchat
111.
Using Heaptrack to optimize memory usage(quickwit.io)
3 points by francoismassot 5y ago|0 comments
112.
by francoismassot 5y ago
Received the same email. Here is the GitHub link[0] to report abuse. I send this short text[2]. Generally I'm ok to be contacted by email and I think I'm quite tolerant regarding this as long as I don't receive a spam saying
113.
by francoismassot 5y ago
I founded 3 startups, Quickwit.io is the last one. In my first 2 startups, resentment between founders and burnout made me do poor choices. I wish I could have read this manual before. I strongly encourage founders to do so. Luckily for me,
114.
The User Manual for Founder Psychology(notion.so)
1 points by francoismassot 5y ago|1 comments
115.
by francoismassot 5y ago
broken link
116.
How we scale out our ClickHouse cluster(engineering.contentsquare.com)
4 points by francoismassot 5y ago|0 comments
117.
by francoismassot 5y ago
Quickwit co-founder here :) I pretty much agree with you qdequelen, Quickwit and Meilisearch are targeting 2 very different markets: user facing search for Meilisearch and what I would call "search analytics on large (almost) immutable
118.
by francoismassot 5y ago
Fan of start-history.com here, thanks for your work. One feature is missing: search repository with a nice autocomplete would be very useful.
119.
by francoismassot 5y ago
Yes indeed, love that too, "Click and Drop" is nice.
120.
by francoismassot 5y ago
Not bad but I feel like a hover on the item would be nicer than having to click on the button. I guess the button is only for reordering right?

More ›