timsehn

11 ms·

61.
by timsehn 7y ago
We compared DVC and a bunch of other Git for data" tools here: https://www.dolthub.com/blog/2020-03-06-so-you-want-git-for-...
62.
by timsehn 7y ago
We're working on building performance benchmarks right now. We started with correctness. You can read about our correctness journey here: https://www.dolthub.com/blog/2019-12-17-one-nine-of-sql-corr... We think ov
63.
by timsehn 7y ago
Very cool. Have not heard of this one. Will check it out.
64.
by timsehn 7y ago
Like "as of" queries or history queries? We have both of those. AS OF: https://www.dolthub.com/blog/2020-03-20-querying-historical-... HISTORY SYSTEM TABLE: https://www.dolthub.com/blog/2
65.
by timsehn 7y ago
You can make a solid case and I tried: https://www.dolthub.com/blog/2020-03-06-so-you-want-git-for-... But there are some limitations for large tables. Diffs only work if you order the file in the same order. Plus, you
66.
by timsehn 7y ago
Dolt is and always will be open source. Feel free to fork a copy and make it your own.
67.
by timsehn 7y ago
See the comment down below from a cofounder of Pachyderm :-)
68.
by timsehn 7y ago
We wrote a couple blog post on data licensing. We're not lawyers but we did a bit of research: https://www.dolthub.com/blog/2020-02-24-data-licenses/ https://www.dolthub.com/blog/2020-02-
69.
by timsehn 7y ago
No data diffs is the data is binary. But diffs are cell-wise like so: https://www.dolthub.com/repositories/Liquidata/corona-virus/... git-lfs lets you put store large files on GitHub. With Dolt, we offer a si
70.
by timsehn 7y ago
I'll check it out. We think the world is a little more ready for this now, given how widely Git is adopted and the advances in other data tooling (like ML). But, as we're all aware, starting a business is hard :-)
71.
by timsehn 7y ago
We use AWS but will switch over to Google or multi-cloud when we exhaust our credits. The system is still pretty simple. The main cost is the storage for the blobs in the Dolt repos pushed to DoltHub. We use S3 for that. There is an API tha
72.
by timsehn 7y ago
The storage system we use only stores the rows that change. We have a blog post we're publishing on Wednesday explaining how.
73.
by timsehn 7y ago
You can export to whatever you like. In our imagination, data versioning would sit upstream of production just like source code versioning. You take the data out and do what you need with it in a "compile" step.
74.
by timsehn 7y ago
This blog compares us to Quilt and others: https://www.dolthub.com/blog/2020-03-06-so-you-want-git-for-...
75.
by timsehn 7y ago
You can spin up a MySQL compatible server using `dolt sql-server`. It does not implement everything right now but we'll get there.
76.
by timsehn 7y ago
We think this is the assumption (that data does not change) but we don't think it holds and data diffs help show you when something you did not expect did change.
77.
by timsehn 7y ago
You are correct. It is an homage to Git. We needed a word that meant "idiot" or similar, that started with D for data that was short enough to type on the command line.
78.
by timsehn 7y ago
Dat is more of a distributed data sharing protocol. It does not do branch/merge which Dolt does.
79.
by timsehn 7y ago
Here is an earlier blog we published on comparison's to Pachyderm: https://www.dolthub.com/blog/2020-03-06-so-you-want-git-for-... We got a blog on the storage system coming on Wednesday. It's a mashup of a M
80.
Dolt is Git for data(dolthub.com)
358 points by timsehn 7y ago|191 comments
81.
Testing Dolt using BATS (Bash Automated Testing System)(dolthub.com)
47 points by timsehn 7y ago|15 comments
82.
54,443 individual Coronavirus case details. Multiple sources, updating hourly(dolthub.com)
1 points by timsehn 7y ago|2 comments
83.
Scraping a Website with Infinite Scroll(dolthub.com)
1 points by timsehn 7y ago|0 comments
84.
Assembled the most comprehensive open individual Novel Coronavirus case dataset(dolthub.com)
1 points by timsehn 7y ago|0 comments
85.
Store, version, and share SQL queries with your database(dolthub.com)
3 points by timsehn 7y ago|1 comments
86.
SQL Version of Novel Coronavirus Dataset
7 points by timsehn 7y ago|0 comments
87.
by timsehn 7y ago
It still cool when people know we exist. Thanks for the shout out. Git for data to us means a SQL database with Git semantics, backed by a content addressed graph of rows. That's what we built. Plus, we own http://www.gitfor
88.
Open MLB dataset used for HR to Salary correlation analysis
5 points by timsehn 7y ago|0 comments
89.
by timsehn 7y ago
With this dataset, you can do Zip, not county :-)
90.
by timsehn 7y ago
The dataset used to create this map: https://www.dolthub.com/repositories/Liquidata/irs-soi/ Has tax data aggregated by zip. You can get the median zip code in a state from it because it only has totals so yo

More ›