No reason you cant still use airflow for the orchestration/depenendecy management/scheduling. And for the processing and storage - Pandas and sqlite. Also woul

No reason you cant still use airflow for the orchestration/depenendecy management/scheduling. And for the processing and storage - Pandas and sqlite. Also would highly highly recommend looking into kedro (which has airflow integration, or you could just run your pipelines with crontab)