3 ms·
how would I go about calling python code as a step, say if I wanted to explore a grid of parameters and fit models accordingly?
by Pucilowski 3y ago
how would I go about calling python code as a step, say if I wanted to explore a grid of parameters and fit models accordingly?
- necubi 3y agoCurrently only Rust UDFs are supported (https://doc.arroyo.dev/sql/udfs https://doc.arroyo.dev/sql/udfs) but one of the things that Arrow should enable is performant Python integration, as Arrow has a standardized in-memory format that's portable across languages. So it's possible to take in-memory data constructed Arroyo's Rust implementation and pass it to a Python interpreter without serialization or possibly copying.