3 ms·
This looks really cool! I've worked with large data sets before and one of the most annoying things was when they were split up into multiple files. Do you curr
by aripickar 7y ago
This looks really cool! I've worked with large data sets before and one of the most annoying things was when they were split up into multiple files. Do you currently support statistics across multiple datasets?
Also, how did you come up with the pricing? 500 and call us seems like a lot per month
- stevepike 7y agoThanks! We can definitely combine multiple files into one dataset so long as they share the same fields. We've got one customer that keeps their data in an S3 bucket as one JSON file per record, so for them we're scanning ~480K files to construct the stats. If you've got multiple different datasets we've got a concept of "collections" for organization. We came up with the pricing strategy based on conversations with early customers. We want to be able to say yes to integrations with whatever system they're using to store their data so we need flexibility at the early stage.