$25 for cleaning a relatively small dataset does sound a bit high but not outrageous.. given the process abstracts out all the infra tweaking and setting up var

$25 for cleaning a relatively small dataset does sound a bit high but not outrageous.. given the process abstracts out all the infra tweaking and setting up various systems. $25 an hour is probably a good estimate of how much a data warehouse like snowflake costs for a reasonable cluster as well, so unless you spin up your own spot ec2 instances and set up a spark cluster and perform the operations the cost savings are going to be marginal at best? Do you need to run this pipeline more than once a day? Is it sufficiently important for your business case? I feel like 25 is a very small sum if any of them are remotely true. On a related note, how practically reliable is the DataPrep->DataFlow workflow? Could a reasonably smart analyst with zero programming experience set them up and run them? Feel like that's who this workflow is built for, but I've not had the best of experiences with Trifacta demos in AWS with reliability.