Y
HN Search
Hacker News Search
new
|
comments
|
top
|
jobs
matthewphsmith
searching PlanetScale…
1.
▲
2.
▲
3.
▲
4.
▲
5.
▲
6.
▲
3 ms
·
1.
▲
by
matthewphsmith
7y ago
Thanks for the link! Looking at Prefect's comparison to Airflow ( https://docs.prefect.io/core/welcome/why_not_airflow.html#wh... ), I think it sums up a lot of the same areas we tried to address with Flyte! Pa
2.
▲
by
matthewphsmith
7y ago
It is definitely possible to leverage Flyte's features here for sharing partial outputs. It does, however, require formatting your pipelines in a particular manner for this to be supported natively (i.e. create a task which computes a
3.
▲
by
matthewphsmith
7y ago
That is something to which the SDK was designed to be extended--in fact, the SDK was designed specifically to be extended to different programming models besides the rudimentary one we provide out-of-box. However, we have not had the time t