4 ms·
This is exactly what we do, but with Spark instead. We develop the functions locally in a package and call necessary functions for the job notebooks, and the jo
by csunbird 2y ago
This is exactly what we do, but with Spark instead. We develop the functions locally in a package and call necessary functions for the job notebooks, and the job notebooks are very minimalistic because of this
- appplication 2y agoSpark-via-Airflow is also the context we use this, glad of see the pattern also works for you.