valyala

22 ms·

271.
by valyala 2y ago
- Loki doesn't allow queries without stream filters. This may be very inconvenient. For example, try selecting all the logs with the 'error' word in Loki. In LogsQL you just type 'error' and that's it! - As I k
272.
by valyala 2y ago
I actively use grep, cat, uniq, sort, less and other Unix commands every day. That's why I added good integration with Unix pipes into VictoriaLogs, since it may cover missing functionality [1]. [1] https://docs.victoriametr
273.
by valyala 2y ago
VictoriaLogs could fit your use case: - It natively supports 'stream' concept [1] - this is basically logs received from a single application instance. - It allows efficiently querying all the logs, which belong to a single stream
274.
Show HN: LogsQL – opinionated query language for logs(docs.victoriametrics.com)
61 points by valyala 2y ago|29 comments
275.
by valyala 2y ago
Could you also include VictoriaMetrics into the comparison?
276.
by valyala 2y ago
Did you try ClickHouse? It should provide data ingestion and querying performance comparable to Google BigQuery, while it should cost less, since you can run it on your hardware.
277.
by valyala 2y ago
Very well written article! I remember the time when I was tuning Postgresql for achieving the maximum possible ingestion speed for ad analytics data. I end up with the following recommendations - https://gist.github.com/valy
278.
by valyala 3y ago
Take a look at VictoriaLogs then [1]. It is ready to accept and query big amounts of logs without the need to configure anything for achieving high efficiency (e.g. low RAM usage and low disk space usage). See how does it compare to ClickHo
279.
by valyala 3y ago
VictoriaMetrics CTO here. The referred library is the official OpenTelemetry package for reading metrics in Go language [1] - more details are available at [2]. Note that we at VictoriaMetrics like the idea of unified observability standard
280.
by valyala 3y ago
Try using cgo-based zstd package https://github.com/valyala/gozstd . It is usually faster than pure-Go package https://github.com/klauspost/compress/tree/master/zstd
281.
Comparing Resource Usage: Grafana Agent, Prometheus Agent Mode and Vmagent(victoriametrics.com)
3 points by valyala 3y ago|0 comments
282.
ClickHouse and the One Trillion Row Challenge(clickhouse.com)
4 points by valyala 3y ago|0 comments
283.
CoreDNS is going to fail you scale K8s(medium.com)
2 points by valyala 3y ago|2 comments
284.
by valyala 3y ago
A few of interesting real-world large-scale migrations are highlighted at https://docs.victoriametrics.com/casestudies/
285.
by valyala 3y ago
While Grafana Agent uses less resources than Prometheus, there is more optimized Prometheus-compatible scraper and router exists - vmagent [1]. I'd recommend you giving Grafana Agent and vmagent the same workload and comparing their re
286.
What I think goes wrong periodically with our Grafana Loki on restarts(utcc.utoronto.ca)
1 points by valyala 3y ago|0 comments
287.
by valyala 3y ago
FYI, VictoriaMetrics converts resource attributes to ordinary labels before storing metrics received via OoenTelemetry protocol - https://docs.victoriametrics.com/#sending-data-via-opentelem... . This simplifies filtering a
288.
Anomaly Detection for Time Series Data: An Introduction(victoriametrics.com)
11 points by valyala 3y ago|3 comments
289.
by valyala 3y ago
Go lost its simplicity and became yet another mediocre programming language after adding generics :( All these non-trivial type inference rules are needed only for serving useless generics in Go. And these rules do not cover many edge cases
290.
by valyala 3y ago
Remote-controlled microphone is embedded into every smartphone. This doesn't prevent billions of people to buy and use them :)
291.
by valyala 3y ago
I prefer storing the source code of third-party dependencies directly in the monorepo. Treat third-party code as your code, since it is used in your project in the same way as your code. It may contain bugs and security issues, which is eas
292.
by valyala 3y ago
The blog post contains very valuable advices! I'd recommend also shrinking the number of repositories - this can significantly reduce the amounts of efforts needed to sync changes, which span multiple repositories. Ideally there should
293.
by valyala 3y ago
Did you try VictoriaMetrics [1] and vmagent [2]? It is a single self-contained binary without external dependencies. It requires relatively low amounts of CPU, RAM, disk space and disk IO, and it runs on ARM. [1] https://github.c
294.
by valyala 3y ago
If you want easy to install, maintain and use system for logs, then take a look at VictoriaLogs [1] I'm working on. It is just a single relatively small binary (around 10MB) without external dependencies. It supports both structured an
295.
by valyala 3y ago
Grafana Mimir is a great product, but it also has some rough edges - https://victoriametrics.com/blog/mimir-benchmark/
296.
CERN swaps out databases to feed its petabyte-a-day habit(theregister.com)
164 points by valyala 3y ago|52 comments
297.
by valyala 3y ago
As I know, Grammarly migrated to Graphite implementation built into VictoriaMetrics [1] [1] https://docs.victoriametrics.com/#graphite-api-usage
298.
by valyala 3y ago
Yeah, including the official Opentelemetry parser for metrics just increases sophisticated Go binary size by 10MB - from 19MB to 29MB [1] [1] https://github.com/VictoriaMetrics/VictoriaMetrics/pull/2570...
299.
by valyala 3y ago
Prometheus text exposition format is de-facto standard used in monitoring. It would be great building an official observability standard on top of it. This format is much easier to debug and understand than OpenTelemetry for metrics. It is
300.
by valyala 3y ago
Prometheus was known as a monitoring system, which promotes pull model over push model for metrics' collection. E.g. it is configured to discover scrape targets and then to scrape metrics from them at regular intervals - https:/&

More ›