91dylwyn

4 ms·

1.
by 91dylwyn 4y ago
Is there a better way than Airflow? After giving it much thought and having many lunch time conversations with my coworkers I became convinced that all my issues with Airflow stemmed from the same root cause: task isolation. What in theory
2.
Why Typhoon Instead of Airflow?(typhoondata.io)
3 points by 91dylwyn 4y ago|1 comments
3.
Ask HN: Delta Lake vs. others (e.g. Iceberg etc.)
2 points by 91dylwyn 4y ago|0 comments
4.
by 91dylwyn 4y ago
Maybe you could you make it so people can add a place. I guess upload to youtube, geo-tag it. It would be fun to get to add your place to the game. I would like to try with a VR headset
5.
by 91dylwyn 4y ago
This is pretty fascinating!!
6.
by 91dylwyn 4y ago
AI is the best at chess but you would not pay to see two AI play chess while its still interesting to watch Magnus win or lose. So, likely just because you can make AI works of art, it doesn't mean people will value them equally.
7.
by 91dylwyn 5y ago
Somebody made money... its now $ 1,040 Did someone win?
8.
by 91dylwyn 5y ago
If no ads and no member fee...where is the money from? I don't quite get it. Nice graphic tho.
9.
by 91dylwyn 5y ago
Fun end picture of the city when opacity is set- nice!
10.
Show HN: UI to allow your team to easily create Airflow DAGs with no code(typhoon-data-org.github.io)
10 points by 91dylwyn 5y ago|3 comments
11.
by 91dylwyn 5y ago
Love it! theuselessweb found me http://eelslap.com/ My fav from back of the day http://www.davesweboflies.com/
12.
by 91dylwyn 5y ago
This seems much more sensible than extra money to those already comfortably off.
13.
by 91dylwyn 5y ago
Are you finding any pain points? How did you manage the 15 minute window in case of large amounts of data running over time? How do you manage the DAGs on it? For example creating dependencies between tasks and monitoring and rerunning tas
14.
Ask HN: Is it a good idea to use AWS Lambda for ETL Pipelines?
4 points by 91dylwyn 5y ago|3 comments