5 ms·
OpenObserve: Observability platform for logs, metrics, traces, analytics
- MrDarcy 2y agoAnother one for the sso wall of shame - https://sso.tax/ https://sso.tax/
- prabhatsharma 2y agoYou should read this - https://openobserve.ai/blog/sso-tax https://openobserve.ai/blog/sso-tax
- Eridrus 2y agoI think you don't understand the core argument re the SSO Tax, which is that security is a positive sum good, which is why it should not be the feature used for price discrimination. Not all products have other good features to use for price discrimination, so I have some sympathy for vendors here, but I think it often indicates laziness in thinking about what they can use to do the necessary price discrimination.
- prabhatsharma 2y agoI do understand it's super important for security, and I want large companies who have ample money and spend a lot on security to pay me as well for it. If you are running OpenObserve in your basement or are a small startup you get it for free in OpenObserve and stay secure.
- Eridrus 2y agoI want large companies to pay you too, but SSO is not a purely large company feature. There are plenty of companies with more than 10 developers that are not large companies.
- prabhatsharma 2y agoOpenObserve offers free SSO on our cloud service to anyone and Free SSO for anyone using enterprise version if they ingest under 200 GB/Day (6 TB/Month). This should cover all companies with 10 developers.
- thedevilslawyer 2y agoSo a small company with say 25 dev/employees with say 2 gb of data per day? Edit: People here do get what you're saying - "This is the only way we can force some users to pay". What you're not hearing is "Either don't call out your software as FOSS, or if you do, figure out ways of price discriminating without hurting security for FOSS users."
- magicalhippo 2y agoWe're in that position. We make B2B software and just increased to 12 devs. Due to security demands from customers, SSO is a must for products like this and it frequently forces us into the enterprise bin.
- osigurdson 2y agoHow should companies monetize products? Maybe people should just go back to full commercial models, not sure.
- prabhatsharma 2y agoMost people who talk about SSO Tax don't really care for it's values but rather want free stuff. I have had conversations with multi-billion dollar companies who would avoid paying a single dollar to support open source companies and bring SSO tax into conversation. On our part OpenObserve offers free SSO on our cloud service to anyone and Free SSO for anyone using enterprise version if they ingest under 200 GB/Day (6 TB/Month).
- MajimasEyepatch 2y agoThe problem with not offering SSO on lower tiers is that it can make it hard to test into a new service. I might want to try out a new tool with one team for a couple of months and see how it goes before recommending adoption for a broader group. I don't want to have to sign a year-long six-figure contract just to try something out. Sometimes you can work out a trial period with the sales team, but that's not always easy, and it puts a strict ticking clock on things that doesn't work in all situations.
- yourapostasy 2y ago> ...conversations with multi-billion dollar companies... Slight clarification here. Might not apply in OpenObservability's case but might help others on their journey to enterprise sales with their projects. Those are typically conversations with managers holding $X purchasing authority, typically like $500K for a US director'ish level, within multi-billion dollar companies. These managers usually aren't averse to spending on open source projects. They're averse to cutting a check not tied to a support contract with responsive, polite, helpful support with published support policies at 0300h local time on a break-fix line with 75 other people from other support teams in the company watching. A surprising number of open source projects won't offer that guarantee, and instead only offer the option to "donate" with vague promises of priority support. More projects are getting better at this more recently, but it takes a surprising amount of red tape to onboard as a vendor into these organizations, and a lot of open source teams don't have the appetite for putting up with that. Until kind of recently, the conversation switching to the SSO Tax is really about accessing that level of guaranteed support delivery.
- Groxx 2y agoSSO often costs quite a lot to maintain, given how widely varied the systems are. Seems reasonable to charge for an optional high-complexity and high-maintenance-burden feature.
- terminalbraid 2y agoAre you referring to the development cost or just the "keep SSO wired to other orgs in for our cloud product"? Development-wise, SSO standards don't change much and aren't terribly difficult to get up an running if you stick to oauth and saml. By not offering that in a self-hosted open source version where the maintenance is delegated to the user turns this to a naked cash grab.
- Groxx 2y agoThe constant stream of B2B stuff that tends to come with it is the real cost. 95%+ of stuff is indeed technically quite standard and Solved™, like with all things oauth... but that last 5% will relentlessly bleed your will to live out of you. Oauth is a massive mess that necessitates libraries with custom tweaks for hundreds of providers, SAML exists but only aging or over-sized B2B touches it so you now have obtuse B2B customers demanding you Address and Attest To Compliance With unrelated PHP CVEs for a Linux distro that's a decade older than the ancient long-term-support version your company started under, plus you're a Ruby shop so wtf even, and... Yeah I've been there. If you can tell B2B to fuck off, it's legitimately easy. If you're running a business around it, they're your major sources of income, you're taken along for their ride and it has absolutely no reason to be Ride-able like that but this is the designed-by-committee world we live in now.
- nhumrich 2y agoHow is this on the SSO tax wall of shame? They support it SSO on their free tier.
- ewuhic 2y agoHow does it compare to Grafana suite?
- prabhatsharma 2y agoYou should read this - https://openobserve.ai/blog/openobserve-vs-grafana https://openobserve.ai/blog/openobserve-vs-grafana
- viraptor 2y agoThat's an interesting take for OpenObserve, but for me in an ops role it misses the compatibility. I appreciate that with Grafana I can choose a specific backend and configure it as required in my environment. I know other systems can reach the same database because they have known APIs. I also know I can move to another store with the same front-end if the owners pull an Elastic/Redis. OO integration may save me a couple of days of setup, but long-term it's a dangerously limiting idea / lock-in.
- prabhatsharma 2y agoYou are in the same danger with Grafana (Front end, Elasic/Redis fate and lock in) as you are with OpenObserve. No difference there.
- viraptor 2y agoThe risk is more spread out between the projects though so the replacements required would be smaller.
- 1oooqooq 2y agojust forwarding the hosts logs from journald to a openobserve running in a vm on that host requires using an agent that will cause you more reasons to have to observe a log than anything else. And syslog/syslogng are also problematic to ingest.
- prabhatsharma 2y agoOpenObserve is built for centralized logging - Not really for installing it on every linux host. If that is your use case, I would recommend you to look for other tools.
- 1oooqooq 2y agowho said about installing it on every host? i mean that the collection of the host running it is already a pain. yeah, the frontend is nice, but log collection is the most important part and openobserve is awful for it as it was designed by people just caring for k8s clusters and app metrics.
- deleted 2y ago[deleted]
- hijinks 2y agodoes anyone use this? I'm really starting to get sick of companies that claim they operate at petabyte at scale and find you need to spend 400k a month to support that scale.
- prabhatsharma 2y agoThousands of active deployments globally. How many open source log systems work at PB scale given any number of resources? Also FWIW, OpenObserve can ingest data at 28 MB/Sec/Core (We are working on optimizing it even more) and ingesting 1 PB of data would cost just $435 based on on-demand prices (AWS m7g family).
- terminalbraid 2y agoThat doesn't answer the question of who? A (rightly) cynical reading of what you posted could just be "thousands of active deployments" you did for yourself to prove benchmarks.
- prabhatsharma 2y agoMachines I would use for benchmarking would go down after some time and won't be active.
- djbusby 2y agoStill didn't answer the "who" part.
- prabhatsharma 2y agoWe will publish many names on our website soon.
- Veserv 2y agoWhy is it only 28 MB/core-second? Is that production rate, inbound bandwidth, rate to persistence, rate to processed, or rate to display?
- niux 2y agoHad a pretty bad experience with this. The web app is very buggy and frustrating.
- prabhatsharma 2y agoWhat bugs? Care to file a GitHub issue?
- wiradikusuma 2y agoHow is it compared to Signoz?
- mdaniel 2y agoAGPLv3 versus MIT Expat + open core for one thing https://github.com/openobserve/openobserve/blob/v0.12.1/LICENSE https://github.com/openobserve/openobserve/blob/v0.12.1/LICE... https://github.com/SigNoz/signoz/blob/v0.56.0/LICENSE https://github.com/SigNoz/signoz/blob/v0.56.0/LICENSE
- prabhatsharma 2y agoFor one thing - From their website - Our powerful ingestion engine has a proven track record of handling 10TB+ data ingestion per day. OpenObserve clusters can ingest PBs of data every day. While more can be discussed - I would rather focus on what are your needs when it comes to observability. Let's talk about them. I will be more excited to answer those questions.
- prabhatsharma 2y agoThanks @thunderbong for the post. We have spent over 2 years building OpenObserve into a simple, highly usable and efficient observability tool. You could run it using a single binary that provides all the functionality of logs, metrics, traces, front end monitoring, dashboards (18 different chart types), alerts and pipelines. OpenObserve is being used by startups, mid tier enterprises and fortune 100 companies. There are thousands of active installations of OpenObserve globally. Folks have replaced Elasticsearch, Splunk, Graylog, Datadog , Newrelic and more for OpenObserve. Comment from a user - We moved from 5 node OpenSearch cluster to single node OpenObserve and measured using our actual everyday queries, which are reasonably complex queries (1 to 5 conditions applied) over our real logging data. We see that typically they complete in about the same time. OpenObserve costs us 10 times less though (instances + storage) Also, we are currently working on replacing one of the world's largest splunk installations. p.s. I am one of the maintainers of OpenObserve. Feel free to ask questions. I will be happy to answer them. You can also visit our slack workspace at https://short.openobserve.ai/community https://short.openobserve.ai/community for discussions.
- ethanwillis 2y agoHow does the storage cost for 3 nodes stay exactly the same as for 1 node for openobserve?
- prabhatsharma 2y agoBy using object storage (Think s3 and similar) and not replicating data for HA (Not needed if using s3) which is done by legacy systems like Elasticsearch and Splunk.
- gclawes 2y agoNo SSO in open-source, pass. I'll stick w/ Grafana
- prabhatsharma 2y agoYou should read - https://openobserve.ai/blog/sso-tax https://openobserve.ai/blog/sso-tax and https://openobserve.ai/blog/openobserve-vs-grafana https://openobserve.ai/blog/openobserve-vs-grafana
- NewJazz 2y agoI've read articles like that time and time again. Doesn't change my requirements.
- prabhatsharma 2y agoGod bless you my friend. Thanks for the comment.
- apitman 2y agoI'm curious what are your requirements? Their SSO tax appears to be structured in such a way that only large enterprises would have to pay.
- Volundr 2y agoHow so? This chart [1] has SAML under enterprise with no price tag other than "get in touch" [1] https://openobserve.ai/pricing https://openobserve.ai/pricing
- apitman 2y agoI'm going off the article linked above: https://openobserve.ai/blog/sso-tax https://openobserve.ai/blog/sso-tax
- 2y ago
- cshark007 2y agoused this on self-hosted and ingested 150GiB daily and absolutely no issues, fancy UI and more buttons are not needed if you get the value from ingestion speed.
- max_streese 2y agoHow are you folks related to Anguilla? Couldn’t really find anything AI specific about OpenObserve so I am guessing the domain is for other reasons?
- _fat_santa 2y agoFunny I was actually shopping around for an logging platform yesterday and ended up going with Grafana. The thing that sold it (for now) is their generous free tier, though if I had to self-host (which I intend to do eventually), this seems like a much easier thing to self host (and I really really like that it's just one binary)
- __turbobrew__ 2y agoHow does this better than grafana? Loki -> logs Tempo -> traces Prometheus/mimir -> metrics I know personally of several companies which use this stack with tens of thousands of nodes. Everything runs on object storage which means it is easy to scale up, and you can move between storage providers as long as they implement the S3 API. The grafana ecosystem is very sticky as well. If I download some random helm chart it most likely will come with a grafana dashboard which I can easily import and instantly have dashboards and alerts for the helm chart.
- __turbobrew__ 2y agoI see you address this in a blog post: “You will also hear of LGTM stack (Loki, Grafana, Tempo, Mimir) which is a pretty good stack for observability. Each of these components are separate open source tools built by grafana labs.” Not very convincing why I wouldn’t go for the LGTM stack which has been proven to be effective.
- prabhatsharma 2y agoBy all means, if LGTM works for you stay with it. For those looking at much more simplicity, and much higher performance OpenObserve is the way to go. Many folks have moved from Loki to OpenObserve due to performance issues with Loki. Many have moved from LGTM stack completely to OpenObserve. Many have chosen to use Grafana as a front end for OpenObserve too. Take a look at how easy it can be to build dashboards in OpenObserve. It takes time for community and ecosystem to build for great products. Grafana started in 2014. OpenObserve started in 2022.
- __turbobrew__ 2y agoWhat would convince me is if you show benchmarks between large LTGM deployments and OpenObserve. Show me OpenObserve ingesting a few billion metrics streams and show me how query times are faster than mimir.
- prabhatsharma 2y ago