> This is all going to have to be re-invented if you try and replace the DAG front end and just use spark's execution back end. Again, I don't know enough abou

> This is all going to have to be re-invented if you try and replace the DAG front end and just use spark's execution back end. Again, I don't know enough about Hamilton, but I don't think it's a matter of replacing anything Spark does, or any other data execution runtime for that matter. It's just another layer, another abstraction. Hamilton -> Spark SQL/API -> Spark artifact -> Spark execution Hamilton -> Snowflake SQL -> Snowflake execution etc...