memset

20 ms·

211.
by memset 3y ago
Feel free to create a gh issue - really interested in what the right solution would be here!
212.
by memset 3y ago
Agree. (What if the original users key has the double underscore?) maybe this can be defined as a param?
213.
by memset 3y ago
Currently no, but I’m open to the idea of being able to set this. Perhaps the ability to set it on the fly (or better yet, inform the user of which type of compression to use based on their actual data!) would be useful. Happy to discuss in
214.
by memset 3y ago
Probably an error! Should create a ticket for that. What would we want the behavior to be? (This hasn't come up with existing customers because theoretically it could and we should handle it.)
215.
by memset 3y ago
It is not a cheap operation, I basically create a new table and then "INSERT INTO SELECT..." Then again, it isn't something you typically need to do a lot.
216.
by memset 3y ago
Great question. Each new table is given a __row_id column which ScratchDB populates and that is the default primary key. Then, as data is added, I look at the cardinality of each column and set an ORDER BY appropriately. The goal (implement
217.
by memset 3y ago
This is a really good question. My snarky answer is "the way we ingest JSON doesn't require 50 pages and n configuration settings to explain." Here's a more factual one: - We don't use tuples for nested JSON. We jus
218.
by memset 3y ago
I haven't calculated the break-even point for bigquery vs scratchdb. It would be impossible to do so, as I'd need to know the number of rows bigquery will scan in order to do an estimation in advance. Also what is a "slot-hou
219.
by memset 3y ago
This is good feedback on writing a clear message - I appreciate it. The goal of this project is to build a superb developer experience around analytical databases. I think that is one of Snowflake's (many) value propositions. It is als
220.
by memset 3y ago
Thank you - really excited about what you're building too!
221.
by memset 3y ago
I don't bill separately for the compute vs storage the way bigtable does. The pricing per GB of data is inclusive of compute. The goal is for pricing to be modeled similarly to DynamoDB - just pay for what you use. The other way I char
222.
by memset 3y ago
I haven't seen TiDB before - thanks for sharing. I honestly haven't spent tons of much time analyzing other databases (there are so many!) but I haven't seen much out there which tries to be "Firebase for OLAP" - th
223.
by memset 3y ago
Good to meet you! I hadn't seen graphjson before, I'll check that out. I'm also a fan of tinybird, and I think we have similar goals of wanting to make it easier for people to adopt OLAP. On the technical side, I've made
224.
by memset 3y ago
You can use it for logs. I have a basic example here: https://scratchdb.com/blog/fly-logs-to-clickhouse/ It's just storing data in a database so it persists as long as you want. For the hosted version you jus
225.
Show HN: ScratchDB – Open-Source Snowflake on ClickHouse(github.com)
261 points by memset 3y ago|56 comments
226.
Pocketful of Dough (2000)(gourmet.com.s3-website-us-east-1.amazonaws.com)
2 points by memset 3y ago|0 comments
227.
Flattening and Denormalizing JSON(scratchdb.com)
2 points by memset 3y ago|1 comments
228.
Analyze Stripe Data with SQL(scratchdb.com)
2 points by memset 3y ago|0 comments
229.
Analyze Shopify Data with SQL(scratchdb.com)
2 points by memset 3y ago|0 comments
230.
by memset 3y ago
I am running my own Clickhouse server on Hetzner, yes. That is the product I'm offering: managed OLAP with a better developer experience on top.
231.
Browser Screen Recording with Rrweb(scratchdb.com)
2 points by memset 3y ago|0 comments
232.
by memset 3y ago
Interesting! So you'd provision a new VM, deploy and add it to the LB, and then destroy the old node? I think that's where a docker-based deployment would shine, it would be way faster.
233.
by memset 3y ago
Didn't expect to see this on the front page! Basically, I'm working on building the kind of company that I've always wanted to: simple technology (not k8s!) to do cool things (ingest tons of data into a database.) I can run t
234.
by memset 3y ago
I am building https://scratchdb.com/ to address this. It's an HTTP wrapper around Clickhouse, and uses pay-as-you-go pricing. It's also open source and easy to host yourself (single go binary.) Currently have user
235.
Zero-Downtime Hetzner Deploys with Ansible(scratchdb.com)
164 points by memset 3y ago|30 comments
236.
Show HN: Take a recipe website URL and remove the cruft(plainoldrecipe.com)
4 points by memset 3y ago|1 comments
237.
Capture Form Responses to ClickHouse and Google Sheets(scratchdb.com)
3 points by memset 3y ago|0 comments
238.
by memset 3y ago
It is a database specifically designed for analytical queries (think: GROUP BYs against hundreds of millions of rows.) These are queries that are untenable in Postgres. It stores data on disk in a structure which is optimized in two ways: a
239.
Forwarding Fly.io Logs to ClickHouse(scratchdb.com)
4 points by memset 3y ago|2 comments
240.
by memset 3y ago
This article is riveting. I’d never appreciated that there was such a history of society, in so many ways, teaching and training each other to be members of a society. The article argues that this rapidly fell alert after WW II as people t

More ›