billythemaniam

10 ms·

61.
by billythemaniam 4y ago
My experience as well. ORMs are really nice in the beginning, they save a lot of boilerplate code. But they become the enemy once scale and/or performance become an issue.
62.
by billythemaniam 4y ago
I think the cloud can reduce the operations team even at their scale if serverless is used on GCP. Many of the serverless offerings on GCP just get it right. I have never had to think about machine sizes, clusters, etc when using BigQuery.
63.
by billythemaniam 4y ago
Animation is the hardest and will be the long pole of visual realism in games. I've seen better water than that, but it's still hard to make Pixar-quality water in video games. Paradoxically, the more realistic the graphics, the e
64.
by billythemaniam 4y ago
Recall referring to precision and recall [1]. Recall search meaning the use case primarily cares about finding all the results and less about ranking them correctly (precision). So find all the records containing an email address regardless
65.
by billythemaniam 4y ago
In practice, it depends on the dataset size and use case. For web search? Mostly worthless, but can be a valuable signal to train ML. For small corpus of documents? BM25 alone does a pretty good job in general.
66.
by billythemaniam 4y ago
Yep. PG FTS works fine for a recall-based problem. If your data has a high cardinality then recall search works great. But with low cardinality data, you start needing BM25, ML, etc. The larger the dataset, the lower the cardinality in gene
67.
by billythemaniam 4y ago
There is a third type: those of us that work with frameworks and build our own with libraries when needed. The right tool for the job essentially. The "right" framework is absolutely a net benefit, even in academia, but it can be
68.
by billythemaniam 4y ago
The counterpoint to that point is that a significant percentage of scientific computing doesn't care about any of that. They are unlikely to have enough hardware to cause a fire and they don't care about outages or even data loss
69.
by billythemaniam 4y ago
If their AWS spend is $1M/year, it is not as simple as "docker compose up" on bare metal.
70.
by billythemaniam 4y ago
Bold, wild claims require evidence for the rest of us to believe you. Got any?
71.
by billythemaniam 4y ago
I don't know, but I recommend reaching out. Sounds like a cool project!
72.
by billythemaniam 4y ago
GAF Energy in the last year came out with nailable solar shingles so the installation process is similar to a normal roof. I think that's the future because it only adds a relatively small cost to the cost of replacing a roof or new on
73.
by billythemaniam 4y ago
I didn't say public transportation is inconvenient. I said it is hard to make it convenient in the US for the majority of the population. And if it is not convenient, it won't be used.
74.
by billythemaniam 4y ago
Fighting against human nature is the hardest. You know what is next hardest? Fighting culture. Even if culture can be changed, it takes a least one generation or ~30 years and often longer. I'm really not that interested in what the pr
75.
by billythemaniam 4y ago
Public transportation alone cannot solve the problem in the US. It can't even make a large enough dent to really make a difference. Most of those other countries are like a small US state, but the US is much, much larger. Even a medium
76.
by billythemaniam 4y ago
Abstinence has never worked at a societal level for alcohol, drugs, sex, nor environmental issues so far either. Why do we keep thinking that is going to start working any day now? Why do we keep thinking that fighting human nature head-on
77.
by billythemaniam 4y ago
Oh geez. I think you are conflating disagreement with gaslighting. The simplest definition is trying to make someone question their own reality, often for malevolent ends. A debate, what this actually is, is about trying to convince someone
78.
by billythemaniam 4y ago
Your bullet points just show that you think I made a bad argument. That is totally fine, but that isn't gaslighting. "You keep using that word. I do not think it means what you think it means.” -Inigo Montoya, The Princess Bride
79.
by billythemaniam 4y ago
Hospitals have always checked for vaccines in public health crises when relevant. That is part of the playbook. They have also required staff to be vaccinated for decades. Schools at all levels have required proof for decades. Those other b
80.
by billythemaniam 4y ago
Just like every other vaccine... Nothing special about the COVID vaccine in this regard.
81.
by billythemaniam 4y ago
Yeah I agree overall. BigQuery, Spanner, Cloud Run, Pub/Sub, Vertex AI. Like all clouds, some of the services suck, like Data Fusion, but overall the services work well and work well together. In particular, the way Google Cloud makes
82.
by billythemaniam 4y ago
If you are thinking of SQL injection when you say "security", yes you need to sanitize the input before querying the database. But that is different than validating the sanitized data is correct. The database is generally a better
83.
by billythemaniam 4y ago
All this does is make writing a CHECK constraint for a JSON blob relatively straightforward. And yes you should use CHECKs in the database. In practice, it is very easy for application code to either not check or screw it up. It is much har
84.
by billythemaniam 4y ago
There is usually a reason those mega corporations became mega corporations. GitHub, in particular, is the easiest way to collaborate for most developers and they were the first one to get most things right. Absolutely vote with your wallet.
85.
by billythemaniam 4y ago
Yeah CockroachDB suffers from the same problem as PG: the defaults kinda suck for certain workloads. CockroachDB has an additional problem that their documentation isn't as detailed as PG so it can be hard to know what to tune. TiDB an
86.
by billythemaniam 4y ago
Spanner can delete >100k rows if partitioned DML is used. TiDB is already what Vitess is trying to be. I think you would be surprised the number of companies who touted Vitess publicly that either went to TiDB or back to vanilla MySQL.