penciltwirler

5 ms·

1.
by penciltwirler 19d ago
I think it's useful for implementing Sagas https://temporal.io/blog/saga-pattern-made-easy Basically, a multi-step event handling system, where the data could be spread across multiple databases/systems, so t
2.
by penciltwirler 1mo ago
Hugging Face's internal storage system is more sophisticated now after they acquired XetHub. They have a clever way to chunk and content dedupe the data that makes it a lot more efficient to version control large files.
3.
by penciltwirler 2mo ago
Dumb question, but how do they know if a codebase is actually written by an LLM? I know that sometimes code agents write "Co-authored by" in the commit messages, but this is something you can over-write.
4.
by penciltwirler 4mo ago
The premise is that Git-LFS sucks, so we need to build a new data versioning system (in Rust, from scratch). While I mostly agree with this premise, but there are already lots of existing (mature) data versioning systems with the same trick
5.
by penciltwirler 4mo ago
blatant copyright infringement of https://rosalind.info/problems/locations/
6.
by penciltwirler 5mo ago
"Chromebook" had a better ring to it.
7.
by penciltwirler 3y ago
I think in Picasa's case, they learned from that and turned it into Google Photos. I don't think there's any shared code, but at least they learned from it from a product perspective. I would say Google Photos turned out grea
8.
by penciltwirler 3y ago
There's lots of tools built on top of K8s to accomplish this tho. For example, Argo, Tekton, Flyte etc.
9.
by penciltwirler 3y ago
Does this affect Hacker News?
10.
by penciltwirler 3y ago
Have a look at ULIDs
11.
by penciltwirler 3y ago
Lots of comments about Avro Arrow here lool. As a Canadian, I'm both proud and saddened by the fact that although we have elite engineering talent, that talent tends to be drained to the US. Side note, just a couple decades after the A
12.
by penciltwirler 3y ago
just use dbdiagram.io
13.
by penciltwirler 3y ago
Haha a lot of funny comments here. I think overall it's neither here nor there. You should be proud that the "elites" at Google copied your code ;)
14.
by penciltwirler 3y ago
Just read the original paper "Attention Is All You Need". Cohere's founder was the guy who wrote that paper in the first place.
15.
by penciltwirler 3y ago
Hold on... aren't there a bunch of incredily successful "open source" / "source available" companies? Databricks, Cockroach Labs, Hashicorp, MongoDB, Elasticsearch etc?
16.
by penciltwirler 4y ago
I switched out of data engineering, and became a software engineer instead. I work on building the data infrastrue tools that I used to use. Maybe this only applies to me, but building the tools that I used to use is somehow incredibly sati
17.
by penciltwirler 4y ago
Why is NASA pumping money into Boeing? Isn't NASA's money mostly from public funding? Boeing on the other hand is a dying company.
18.
by penciltwirler 4y ago
What's everyone's opinion on youtube music? You pay $11.99/month for YouTube Premium, you get both ad-free youtube (important on mobile), as well as music. Whereas Spotify is $9.99/month, but you only get music and podca
19.
by penciltwirler 4y ago
I think it’s a mix of “execs are the top dogs so they can decide to splurge a little on themselves”, the key is “a little”, I have no idea how much a private concert costs but anything less than $1M is probably considered “acceptable amount
20.
by penciltwirler 4y ago
One can easily self host a bitwarden server on digitalocean. https://bitwarden.com/blog/digitalocean-marketplace/ However, I'm curious what y'all think about the cost. A digitalocean droplet for the reco
21.
by penciltwirler 4y ago
Just do what Go did.
22.
by penciltwirler 4y ago
This is old news already.
23.
by penciltwirler 4y ago
Why does every game have to be zero-sum? Why can't chatgpt live alongside search engines as just another category for results? Like "Images" and "Maps"? In fact, I look forward to Bing integrating with chatgpt.
24.
by penciltwirler 4y ago
Everyone already knows Google is tightening up, but no actual mass layoffs yet. There's no new information here.
25.
by penciltwirler 4y ago
Dex is also an interesting project in this space. It can act as an OIDC provider, but can be extended with other providers via "connectors". https://dexidp.io/
26.
by penciltwirler 4y ago
Nicee, but I feel like really the only thing you need to know as an eng is DNA -> RNA -> Protein. Sometimes RNA -> DNA via reverse transcriptase. Everything else is just normal Python scripting.
27.
by penciltwirler 4y ago
Wait until our particle accelerators suddenly start saying "you are but bugs"...
28.
by penciltwirler 4y ago
Reminds me of Minority Report.
29.
by penciltwirler 5y ago
I feel ya, I was a data engineer at my previous job, and I hated it. In the end, it boils down to the fact that data scientists simply use the tools, while the SWEs build them. Trust your instincts, and follow what you are passionate about,
30.
by penciltwirler 5y ago
I think Zendesk has taken over the CRM part of Salesforce.

More ›