3 ms·
I case you’re stuck with Celery for a while: I was hit with this same problem, and solved it by adding a sidecar HTTP server thread to the Python workers that w
by 9dev 3y ago
I case you’re stuck with Celery for a while: I was hit with this same problem, and solved it by adding a sidecar HTTP server thread to the Python workers that would expose metrics written by the workers into a multithreaded registry. This has been working amazingly well in production for over two years now, and makes it really straightforward to get custom metrics out of a distributed Celery app.
- kamikaz1k 3y agoAny chance you could share more specifics about your solution?
- 9dev 3y agoHere you go: https://stackoverflow.com/questions/75652326/celery-spawn-sidecar-webserver-process/75799358#75799358 https://stackoverflow.com/questions/75652326/celery-spawn-si... Plus some adjacent discussion on GitHub: https://github.com/prometheus/client_python/issues/902 https://github.com/prometheus/client_python/issues/902 Hope that helps!