sa46

31 ms·

271.
by sa46 5y ago
Is the idea something like a scheduled: INSERT INTO bq_table SELECT * FROM EXTERNAL_QUERY(''); I'm guessing you're on the hook for keeping the schema up to date with the Postgres schema.
272.
by sa46 5y ago
Funny timing, I've just written most of a TypeScript generator for protobufs. I learned about some fun corners of protobufs I didn't expect trying to pass the protouf conformance tests [1] (which this one passes, that's no me
273.
by sa46 5y ago
8 extra bytes per row and per foreign key reference relative to an int64 can add up quickly especially if the row is small. I agree it’s not typically the right trade off but it’s not as absolute as you claim.
274.
by sa46 5y ago
It’s distributed Postgres. The same reasons you would use Cockroach or Citus instead of stock Postgres also justify using polar. Given that there’s multiple companies that exist to scale out Postgres, someone sees business value.
275.
by sa46 5y ago
I've used emacs for about 10 years (written plugins, declared emacs.d bankruptcy, gone all-in on org-mode), so I'm familiar with the pros of configurable editors. Here's a list of more advanced functionality built into Intell
276.
by sa46 5y ago
Reverse dependencies, meaning find all sources that depend on a given file. Likely inspired by the Bazel query function by the same name. https://docs.bazel.build/versions/master/query.html#rdeps
277.
by sa46 5y ago
This seems like an instance where BPF could shine. If I had a large magic wand, I’d love to have distributed traces of database query execution with spans or events for significant events like the GIN pending list cleanup described in the a
278.
by sa46 5y ago
Seems a bit counter-intuitive to brand Plaid's behavior as unethical and then argue that users should have agency to share their own passwords. At a meta-level, using unethical as a qualifier seems like an attempt to bolster an argumen
279.
by sa46 5y ago
Might be a similar situation to the IntelliJ Bazel extension by Google which is consistently 6-12 months behind the latest release. That extension just jumped to 2020.2 as well. My guess is that the lag is a consequence of the single versio
280.
by sa46 5y ago
> huge, enormous, gargantuan benefits Would you mind enumerating them? I have an idea of what they are but curious about other perspectives. My sense is that code sharing is not that common between a Typescript frontend and backend. You
281.
by sa46 6y ago
My initial motivation for my (small) projects was always to scratch my own itch. Beyond that, it feels really good when someone else uses the code. For my current side-project, I keep up maintenance because it's interesting work and be
282.
by sa46 6y ago
I adore gRPC but figuring out how to use it from browser JavaScript is painful. The official grpc-web [1] client requires envoy on the server which I don't want. The improbable-eng grpc-web [2] implementation has a native Go proxy you
283.
by sa46 6y ago
The old Army test, the APFT, used the same scale for sit-ups for both men and women. Maybe number of air squats in 2 min?
284.
by sa46 6y ago
> decentralization; it's the only real way to deal with increasing complexity and sprawl Decentralization can help with sprawl (aka scale) but it makes software more complex so it’s not a way to tackle complexity. Decentralization i
285.
by sa46 6y ago
Sure, off the top of my head: - Explain plans for slow queries, via auto_explain in Postgres. You could get really fancy here and convert the pieces of an explain plan (Aggregate, ModifyTable, FullTableScan) into proper distributed traces.
286.
by sa46 6y ago
You might like the approach I took with pggen[1] which was inspired by sqlc[2]. You write a SQL query in regular SQL and the tool generates a type-safe Go querier struct with a method for each query. The primary benefit of pggen and sqlc is
287.
by sa46 6y ago
I've used Datadog but if you need per query tracing from the database logs, I think the only way is to embed a trace ID in a SQL comment (or in an no-op column) like the grandparent showed. Datadog is tracing the request from the appli
288.
by sa46 6y ago
Also related from Coding Horror in 2004: https://blog.codinghorror.com/commandos-infantry-and-police/
289.
by sa46 6y ago
> They're honestly not that different from taxis… Strong disagree. Uber is better in pretty much every way over taxis. It's hard to overstate how much better Uber is compared to taxis. It's (generally) cheaper, cleaner, mo
290.
by sa46 6y ago
I figured the characterization is Firebase is a PaaS (similar to Heroku) where Google Cloud is IaaS.
291.
by sa46 6y ago
SimpleCircle | Founding Engineer | San Francisco | Full-time Join us as the founding engineer at our two-person, fully funded startup. We're looking for a senior frontend engineer well-versed with the intricacies of building large Reac
292.
by sa46 6y ago
I hear this refrain consistently on HN but of the options I've tried, GKE is the most pleasant for my single person app. - App Engine has a bunch of weird limitations and slow deploy times. Qualitatively, it feels like the spotlight ha
293.
by sa46 6y ago
> Switch to using private IP addresses. Huge speed increase. Interesting. I'm looking Cloud SQL right now and the advice seems to lean in the opposite direction: use public IPs for ease of connecting. Can you quantify the decrease
294.
by sa46 6y ago
> Incredible delay between postgres versions To be fair, it looks like GCP supported Postgres 13 (Nov 5, 2020) before AWS did (Nov 27, 2020) and AWS currently marks Postgres 13 as a preview. Maybe GCP had a large initial engineer-cost to
295.
by sa46 6y ago
I also switched from Lastpass to 1Password. I did a mildly deep technical investigation into why Lastpass is slow on the browser. I found LastPass delays all page rendering by about 70ms. https://joe.schafer.dev/passing-last
296.
by sa46 6y ago
We tried pg_upgrade going from Postgres 10 to Postgres 12 and it didn't work. An individual instance was about 8 TiB in size. We left it running for over a day to see if it would complete. Instead, we used an approach similar to logica
297.
by sa46 6y ago
If there's even a rough order to the underlying data, I'll buy their claim. On ordered data, a Postgres block-range index (BRIN) is often several orders of magnitude smaller than a B-tree index. If the data is random, I suspect yo
298.
by sa46 6y ago
I agree with most of the list. It's a good distillation of software development principles. In the spirit of HN, here's what I disagree with: > Designing scalable systems when you don't need to makes you a bad engineer. Cr
299.
by sa46 6y ago
GPL2 doesn't prevent a closed fork of Linux. It requires that if you distribute your closed fork outside of your organization, you must also distribute the modified source under the GPL2 license. Large tech companies run their own fork
300.
by sa46 6y ago
I’m with you in trying to avoid shell scripts. That said, shell scripts are especially convenient for simple glue scripts. No external dependencies and shell will run basically anywhere. Long isn’t necessarily bad for pipelines but anything

More ›