4 ms·
We use Pgbouncer in in our Apache Airflow cluster. During busy time, Apache Airflow can launch hundreds of workers, each of them need at least 1 connection to
by dikei 5y ago
We use Pgbouncer in in our Apache Airflow cluster.
During busy time, Apache Airflow can launch hundreds of workers, each of them need at least 1 connection to Postgresql to save its result. Because each worker run in its own process due to Python's lack of support for threading, client-side connection pool cannot be use effectively.