munchbunny

7 ms·

31.
by munchbunny 10mo ago
As a data engineer in big tech, the two hardest problems I deal with are: * Conway's law causing multiple different data science toolchains, different philosophies on model training, data handling, schema and protocol, data retention p
32.
by munchbunny 10mo ago
Some fairly simple examples where accommodations make the test more fair: * You have a disability that hinders your ability to type on a keyboard, so you need extra time to type the essay based exam through vocal transcription. * You broke
33.
by munchbunny 10mo ago
You do need to expose your team to some of the shit that's getting flung or else your team gets used to operating under clean conditions and loses its tolerance. For better or for worse, politics and randomization is just a thing in
34.
by munchbunny 11mo ago
The chance of exactly 100 heads from 200 fair coin flips is approximately 5-6%. Qualitatively, that's not particularly strong evidence for an unfair coin if you did only one trial. You could also argue that 100 out of 200 on a fair coi
35.
by munchbunny 11mo ago
> I don't want to disparage the author as this is a personal journey piece and I appreciate them sharing it. However this did leave me slightly uneasy, almost calling back to earlier days of the internet when advice about "soci
36.
by munchbunny 11mo ago
An agent is more like a web service in your metaphor. Yes, building a web server is instructive, but almost nobody has a reason to do it instead of using an out of the box implementation once it’s time to build a production web service .
37.
by munchbunny 11mo ago
> that asymmetry is weirdly powerful for specific problems. 100% agree when it works in your favor. We use it for exactly that situation where a non-zero false positive rate is fine and you can choose how much memory to devote to getting
38.
by munchbunny 1y ago
An internal data lake at a FAANG company. I don't really want to go into more detail for my own privacy, but it was definitely the kind of problem you only have when you have a FAANG-sized footprint.
39.
by munchbunny 1y ago
> There aren't really "listeners" in the sense of a pub-sub? They are still "listeners", it's that events aren't pushed to the listener. Instead the API is designed for sheer throughput.
40.
by munchbunny 1y ago
Yup, that's a fair and important distinction, Kafka comes with very little of the ergonomics that make MQ good at what it does. In exchange you get blistering scale, for when blistering scale is the main problem.
41.
by munchbunny 1y ago
> I had assumed that Kafka would give me things like decoupling, retry, dead-lettering, logging, schema validation, schema versioning, exactly once processing. If you don't need a lot of perf but you place a premium on ergonomics an
42.
by munchbunny 1y ago
I have this problem in the system I work on - the short nuance-less answer from my experience is that, once your scale gets large enough, you can't prevent ordering issues entirely and you have to build the resilience into the architec
43.
by munchbunny 1y ago
> I want to rewrite some of my setup, we're doing IoT, and I was planning on Is this some scripting to automate your home, or are you trying to build some multi-tenant thing that you can sell? If it's just scripting to automate
44.
by munchbunny 1y ago
> Is there something about load balancing REST requests to different DB nodes that is less complicated than Kafka? To be clear I wasn't talking about DB nodes, I was talking about skipping an explicit queue altogether. But let'
45.
by munchbunny 1y ago
My general opinion, off the cuff, from having worked at both small (hundreds of events per hour) and large (trillions of events per hour) scales for these sorts of problems: 1. Do you really need a queue? (Alternative: periodic polling of a
46.
by munchbunny 1y ago
Fortunately for food allergies, oral immunotherapy seems to be very effective if you can catch the allergy early (before 2 years old). We did for our oldest and the results are miraculous. It's a ton of work though, and I had more than
47.
by munchbunny 1y ago
I haven't searched through the literature, but these days pediatrician advice is to try to do early and regular exposure to all of the common food allergens as soon as they are ready to start solid foods (~6 month mark), if not even a
48.
by munchbunny 1y ago
My oldest is allergic and spent plenty of time in the sand and dirt. They were exposed to nuts pretty regularly, and fed small amounts from basically as soon as they were taking solid foods. The hygiene hypothesis is widely accepted, includ
49.
by munchbunny 1y ago
It's a very colorful way to describe the phenomenon, but it is a real problem with the "Y" part of the B.
50.
by munchbunny 1y ago
> I try to interview promising resumes even if they don't have the perfect experience match. Something that becomes obvious when doing this is that many developers have only operated on relatively simple projects. They would repeat
51.
by munchbunny 1y ago
> often just translating between things, people and software, or people and people, or software and software. But it's almost always communicating. How true this is. How much of our code, how much compute power, and how much human e
52.
by munchbunny 1y ago
The point about how the expected decision timeline is often a small part of the total decision timeline really resonates with me. Often (in my big tech experience) we say we can get a design done in a week, and then we spend three more week
53.
by munchbunny 1y ago
In practice, at the scale I work at, it's barely feasible to scan one week of logs, let alone two months, because you'll be waiting hours for the result. So you learn strategies to only need to scan a subset of the logs at a time.
54.
by munchbunny 1y ago
> Can you search log data in this volume? (Context: I work at this scale) Yes. However, as you can imagine, the processing costs can be potentially enormous. If your indexing/ordering/clustering strategy isn't set up well,
55.
by munchbunny 2y ago
Reminds me of this piece of motorsports history: https://fordauthority.com/2017/12/how-ford-cheated-the-rules... Take, for instance, Ford’s car from the 2003 FIA World Rally Championship. Through a knowledgeable
56.
by munchbunny 2y ago
In this structure, “were” is used in cases where you are entertaining a hypothetical, and “was” is for something that was true. English grammar is often confusing in cases like this because verbs mostly don’t have distinct spellings/pr
57.
by munchbunny 2y ago
Ha. Got me.
58.
by munchbunny 2y ago
Yes, you can (I submit myself as the example), but I'm not sure that the article/author is talking about fluency . Anecdotally, I lost fluency in my native tongue during my teens, though I don't carry a non-native accent whe
59.
by munchbunny 2y ago
I think the concept you're dancing around the edges of is the nature of what parts of "intelligence" are driven by: 1. Language and how interrelated it is to our ability to transfer knowledge and experience, as well as its ro
60.
by munchbunny 2y ago
That's why I also finally went from 1920x1200 to 4k about half a year ago. It was mostly for reading text and programming, not gaming. I can tell the difference in games if I go looking for it, but in the middle of a tense shootout I h

More ›