3 ms·
As billed, this is good stuff. I have a client who has millions of rows of data in production—and we have to run our test suite against production because they
by lukeqsee 6y ago
As billed, this is good stuff.
I have a client who has millions of rows of data in production—and we have to run our test suite against production because they have no curated staging data set. This would allow us to save multiple minutes every dev pipeline and local test run (which are typically too slow to even run locally).
Looking forward to see you growing!
- lukeqsee 6y agoThis same client is a bit of a penny-pincher. Are there any plans to open this up so we could host the infrastructure and then pull a SQL import dump or something along those lines after running the CLI part? This would reduce your ongoing costs to reduce our monthly fee? ($130 would be a very tough sell, even though I think the business value is there.)
- openquery 6y agoHey! So we are soon introducing the Firehose API. Basically this allows you to point at an arbitrary database and fill it up with as much data as you need from the model. The Firehose should work for use-case and be much more cost effective. A more hacky solution for right now, you can spin up a database and run a `select * ...`.
- lukeqsee 6y agoThat's perfect! I'll keep an eye out for that.
- openquery 6y agoIf you can't wait, you can always run `synth model sample <model-id> --ouput <some-directory> --sample-size <number-of-rows>` which will generate synthetic data directly into your directory as CSV files. You can then ETL that into your database. Hope this helps :)