3 ms·
Don't re-invent the wheel, use AirFlow :)
by osigurdson 1y ago
Don't re-invent the wheel, use AirFlow :)
- Aeolos 1y agoNot the grandparent, but Airflow is painfully slow and inefficient. Our reinvented wheel using posgresql, rabbitmq and EC2 runners has ~10x better throughput and scales linearly with the number of pending tasks, whereas the airflow falls apart and fails to keep the runners fully occupied the moment you out any real load on it.
- sroussey 1y agoDoes Airflow run in a browser?
- osigurdson 1y agoIf you mean it has an html based UI, yes.