mattewong

14 ms·

61.
“How DBT Fails”(benn.substack.com)
2 points by mattewong 4y ago|1 comments
62.
by mattewong 4y ago
A bit weird that suddenly there a lot of sentiment around "how [MDS company here] fails" when 12 months ago it was "MDS is the only future"...
63.
by mattewong 4y ago
I'm having a hard time clearly seeing what the problems were with other approaches that ASDF is intended to solve. Are the other solutions not fast enough? If so what is the performance delta using ASDF? Are the other solutions not sca
64.
by mattewong 4y ago
another shameless plug: https://github.com/liquidaty/zsv
65.
Ask HN: Best way to find help creating technical doc (open- or closed-source)?
1 points by mattewong 4y ago|1 comments
66.
by mattewong 4y ago
Ah, got it, thank you! Just one minor suggestions/feedback point, in case you find helpful, which is that I had to also add the `-d` flag with a comma value. Otherwise with just -H, I get the error "Bad header row" even thoug
67.
by mattewong 4y ago
Nice work! I am a fan of tools like this. However, in my first attempted query (version 3.1.6 on MacOS), I ran into significant performance limitations and more importantly, it did not give correct output. In particular, running on a narrow
68.
by mattewong 4y ago
Second the support for vectorscan. And FWIW, I have posted issues in both hyperscan and vectorscan repos, and the only responses came from vectorscan (and quite quickly).
69.
How Fivetran Fails(benn.substack.com)
3 points by mattewong 4y ago|0 comments
70.
by mattewong 4y ago
All this banter arguing over CSV, JSON, sqlite seems unnecessary when you can just push format X through a pipe and get whichever format Y you want back out: https://github.com/liquidaty/zsv/blob/main/doc
71.
by mattewong 4y ago
There is only upside to using foreign keys. When enabled, the benefits are obvious, so I won't discuss, and as for the drawbacks, the only drawback is performance. But if that's a concern, then guess what, on most databases, you c
72.
"How Snowflake Fails"(benn.substack.com)
1 points by mattewong 4y ago|0 comments
73.
The powder keg of the modern data stack(benn.substack.com)
2 points by mattewong 4y ago|0 comments
74.
by mattewong 4y ago
You might have seen my post for https://hub.liquidaty.com/playground/ (make sure to include the trailing slash), which I posted a couple months ago with temporary public access (I am one of its founders). I'm not
75.
by mattewong 4y ago
Good luck. For me it was good to get at least a few yrs of tech experience before pivoting. it definitely was helpful later, some for the technical experience and maybe more for understanding the dynamics of how decisions get made by techni
76.
by mattewong 4y ago
Glad to hear it was helpful!
77.
by mattewong 4y ago
Yes. I was a CS major. My resume wasn't too different from yours. I got tired of being narrowly focused. Went back to b-school for various reasons, among them, to get a "clean slate" in terms of job opportunities-- ie to avoi
78.
by mattewong 4y ago
Why would "no-code" be worse for the part where a non-admin user is just assembling together some actions and triggers? Will check out Temporal. Thank you!
79.
by mattewong 4y ago
Having sort of done this myself (self-funded for 18 months, then raised some friends-n-family and now cashflow positive), I would recommend: - stay with your job (like others have said) as long as you can. I probably could have done this lo
80.
Ask HN: Do we need a better workflow solution exist, or is it already out there?
2 points by mattewong 4y ago|2 comments
81.
Why do people want to be analytics engineers?(benn.substack.com)
4 points by mattewong 4y ago|0 comments
82.
by mattewong 4y ago
"I don't want to be beholden to Gmail [...] controlling a record of all of my conversations". Replacing Gmail: now THAT sounds interesting
83.
by mattewong 4y ago
While you're mentioning single-byte assumptions, add some more: - All space, dash and underscore characters are single-byte I might disagree with some on your list, such as the below: - Excel can losslessly save CSVs it opens This is n
84.
by mattewong 4y ago
OK thanks, I get that now. I suppose there could be at least two alternatives: 1. use "un-integrated" python code e.g. run a subprocess independently that just runs an external binary / shared lib / etc 2. avoid solution
85.
by mattewong 4y ago
(re "data product", say for example, Cockroach DB which I have no affiliation with and already has a python integration) With platforms like DataBricks and Airflow that are heavily inclined towards python, it feels somewhat unavoi
86.
by mattewong 4y ago
This is a sincere question and I have no idea what you mean by 'treated like children with half-baked "integrations"'? The intended context of the question, which admittedly could be more clear-- is for a data product th
87.
Ask HN: Is Python integration necessary for a commercially-viable data product?
1 points by mattewong 4y ago|6 comments
88.
by mattewong 4y ago
It's nice that q has caching.... then again, it kind of needs it to solve its performance inefficiency. Running "select *" on a 1mm-row worldcitiespop_mil file, q takes 27 seconds compared to `zsv sql` which takes 1.7 seconds
89.
by mattewong 4y ago
Not sure what you mean by csvw. But, zsvlib is a CSV parser, and zsv is a CLI that uses zsvlib. zsv also uses the sqlite3 vtable based on the example in the original sqlite3 code, but it modifies it to use the zsvlib parser instead of the o
90.
by mattewong 4y ago
https://github.com/liquidaty/zsv/blob/main/app/external/sqli... modifies the sqlite3 virtual table engine to use the faster zsv parser. have not quantified the difference, but in all tests I ha

More ›