francoismassot

7 ms·

31.
by francoismassot 3y ago
I must admit that 'alternative' is always a tricky word... Datadog, Elasticsearch, and Splunk are giant beasts, and the alternative makes sense only on a subset of features (and hopefully, we will successfully execute our 2024 roa
32.
by francoismassot 3y ago
Quickwit supports different data sources: Kafka, Pulsar, Google pubsub, ... and we have our own ingest API (not HA right now, but it will be the case in the next release in 1 month or so). Postgresql is not mandatory; it's also possibl
33.
Paris-based startup Nabla raised $24M for its AI assistant for doctors(techcrunch.com)
2 points by francoismassot 3y ago|0 comments
34.
by francoismassot 3y ago
Good point. Several users are asking us the OpenDashboard/Kibana compatibility, and this is on the 2024 roadmap. That being said, we also hear users complaining about OpenDashboard/Kibana, looking for an alternative different from
35.
by francoismassot 3y ago
So yes, currently we only support infrequent deletes for GDPR reasons mainly. It's possible to add updates/deletes to Quickwit, but this is a lot of work, and for now, we have not prioritized this development. Do you mind sharing
36.
by francoismassot 3y ago
Well, I would say it depends. We have many companies using the AGPL version without buying a license. We also know that some companies have strict policies and will forbid using AGPL software unless taking a commercial license. We're h
37.
by francoismassot 3y ago
So Quickwit is primarily a search engine and thus relies on an inverted index. We also implemented our schemaless columnar storage optimized for object storage. The inverted index and columnar storage are part of tantivy [0], which is the f
38.
by francoismassot 3y ago
We store the indexes on the object storage. We worked on the index data structure to optimize the query path. For use cases where you have a lot of QPS, we recommend using Garage or MinIO or the feature to cache index data on the local disk
39.
Show HN: Quickwit – OSS Alternative to Elasticsearch, Splunk, Datadog(github.com)
145 points by francoismassot 3y ago|51 comments
40.
Warp 10, OSS distributed time-series database for IoT(github.com)
3 points by francoismassot 3y ago|0 comments
41.
by francoismassot 3y ago
thank you! From the beginning, we built Quickwit to work on object storage, so we worked hard to minimize the number of read requests to execute a search query. I wrote a blog post that explains the performance / costs you can obtain w
42.
Show HN: Quickwit – OSS Alternative to Datadog, Elasticsearch(github.com)
8 points by francoismassot 3y ago|2 comments
43.
by francoismassot 3y ago
On the storage part, quickwit, an OSS search engine, can also be an option (disclaimer: I work there).
44.
OSS Autoinstrumentation with eBPF and OpenTelemetry(github.com)
1 points by francoismassot 3y ago|0 comments
45.
by francoismassot 3y ago
Can you give the reasons why you chose the LGPL-3.0? Did you consider the AGPLv3 too?
46.
by francoismassot 3y ago
I can't wait to be there, learn, and meet great people This is my second year there, and here is our recipe at Quickwit: - book an Airbnb for 1 week at Bruxelles, a spacious house is definitely better - submit a few talks to share our
47.
by francoismassot 3y ago
While I really enjoy helm when playing with k8s or kickstarting projects, I never feel "safe" when using it in the long run for updates/upgrades. "values.yaml" files and templating YAML files are too error-prone...
48.
Speculations on how S3 Express works(quickwit.io)
7 points by francoismassot 3y ago|2 comments
49.
by francoismassot 3y ago
We tested S3 Express for our search engine quickwit [0] a couple of weeks ago. While this was really satisfying on the performance side, we were a bit disappointed by the price, and I mostly agree with the article on this matter. I can see
50.
Koyeb raised $7M to simplify app deployment with its global serverless platform(koyeb.com)
2 points by francoismassot 3y ago|0 comments
51.
by francoismassot 3y ago
Yeah, I was only talking about exactly once semantic between Kafka and Quickwit.
52.
by francoismassot 3y ago
Exactly-once semantic between Kafka and the observability engine.
53.
by francoismassot 3y ago
Unfortunately no :/
54.
by francoismassot 3y ago
Good point: first you're right, we do the ack on Kafka but it's not necessary. Second, this is not what I wanted to stress... and I should have not used the verb "acknowledge". What we do is upload the data on S3, then
55.
by francoismassot 3y ago
I really like this idea. And there is an OTEL exporter to AWS S3, still in alpha but I'm gonna test it soon: https://github.com/open-telemetry/opentelemetry-collector-co...
56.
by francoismassot 3y ago
I heard several times that Kafka was put in front of elasticsearch clusters for handling traffic burst. You can also use Redpanda, Pulsar, NATS and other distributed queues. One thing that is also very interesting with Kafka is that you can
57.
Show HN: Quickwit – Cost-Efficient OSS Search Engine for Observability(github.com)
1 points by francoismassot 3y ago|0 comments
58.
Architecture of a distributed search engine on object storage(quickwit.io)
1 points by francoismassot 3y ago|0 comments
59.
by francoismassot 3y ago
Nice! I would be very interested by your benchmark, don't hesitate to jump in the quickwit discord server to talk about the results. https://discord.quickwit.io/
60.
Scaling Search to Terabytes on a Budget(quickwit.io)
4 points by francoismassot 3y ago|0 comments

More ›