mochomocha

6 ms·

1.
by mochomocha 5mo ago
Every physical model has its strengths and weaknesses. In this case you're correct that no emphasis has been put on the human-instrument coupling, but they've worked harder than usual on the air/instrument coupling which make
2.
by mochomocha 6mo ago
It makes me think of this parallel: often in combinatorial optimization ,estimating if it is hard to find a solution to a problem costs you as much as solving it. With a small bounded compute budget, you're going to sometimes make mist
3.
by mochomocha 10mo ago
> I suspect they just push what they want you to watch, like their own content. Having worked close to the recsys folks at Netflix, I can tell you that this statement couldn't be further from the truth.
4.
by mochomocha 11mo ago
I know nothing about photography, but I'll just comment on this point: > (I'm guessing this is a CM4/CM5) is a disaster for a camera board. Nobody wants a 20s boot every time you want to take a picture, cameras need to be
5.
by mochomocha 1y ago
The article started really well, and I was looking forward to the empirical argument. Truly mind-boggling times where "here is the empirical proof" means "here is what chatGPT says" to some people.
6.
by mochomocha 1y ago
On the other hand, Groq seems pretty successful.
7.
by mochomocha 1y ago
Ha! I have spent the last 2 years on this idea as a pet research project and have recently found a way of learning the wiring in a scalable fashion (arbitrary number of input bits, arbitray number of output bits). Would love to chat with so
8.
by mochomocha 1y ago
What is so bad about free trade? Isn't competition in free markets something Republicans believe in anymore? Because forcing Americans to buy inferior locally-made products at a premium through artificial restrictions surely isn't
9.
by mochomocha 2y ago
Nothing substantive to add to the discussion, but to praise Min's blog posts which I have found very well written and instructive.
10.
by mochomocha 2y ago
11. notice that there's a unicode rendering error ("'" for apostrophe) on kernel_initializer and bias_initializer default arguments in the documentation, and wonder why on earth for such a high-level API one would wa
11.
by mochomocha 2y ago
Yep in Netflix case they pack bare-metal instances with a very large amount of containers and oversubscribe them (similar to what Borg reports: hundreds of containers per VM is common), so there are always more runnable threads than CPUs an
12.
by mochomocha 2y ago
Yep. In Netflix case each Titus host can run hundreds of containers per bare-metal instance at any given time. One advantage of running a multi-tenant platform like this is that you get better observability on multi-tenancy issues since you
13.
LLM-based sentiment analysis of Hacker News posts between Jan 2020 and June 2023(outerbounds.com)
126 points by mochomocha 2y ago|72 comments
14.
by mochomocha 2y ago
> Government is controlled by the highest bidder. While this might be true for the governments you have personally experienced, this is far from being an aphorism.
15.
by mochomocha 2y ago
According to [1] Fargate is actually not using Firecracker, but probably something closer to a single container running in a single-tenant ec2 VM. If true, this makes VM boot-time optimizations and warm pooling even more important for such
16.
by mochomocha 2y ago
(I'm the author of the blog post) Beyond "kernel programming is hard", there are a few other reasons why it made sense for us: - observability & maintenance: much easier to implement and ship this type of changes in users
17.
by mochomocha 3y ago
It's a MoE model, so it offers a different memory/compute latency trade-off than standard dense models. Quoting the blog post: > DBRX uses only 36 billion parameters at any given time. But the model itself is 132 billion parame
18.
by mochomocha 3y ago
> Do list the names of famous bureaucrats that got famous because they fined rich companies. Thierry Breton is another name that comes to mind.
19.
Bpftop: Streamlining eBPF performance optimization(netflixtechblog.com)
133 points by mochomocha 3y ago|21 comments
20.
by mochomocha 3y ago
The technical report (linked in the 2nd paragraph of the blog post) mentions it, and compares against it: https://storage.googleapis.com/deepmind-media/gemma/gemma-re...
21.
by mochomocha 3y ago
Yes, that's part of the AV1 specs actually. See https://norkin.org/pdf/DCC_2018_AV1_film_grain.pdf Andrey (who works for Netflix) drove the effort. Chatted with him about it.
22.
by mochomocha 3y ago
Where can I find benchmarks of EEVDF vs CFS that were 1) not run by Zijlstra and 2) not synthetic? ie AB tested on a large fleet of computers running heterogeneous processes. I have nothing against the EEVDF algorithm itself (in fact I like
23.
by mochomocha 3y ago
This is technically true but practically irrelevant. Case in point, I deployed at Netflix a real-time combinatorial solver specifically for CPU scheduling [1]. Most real-world combinatorial problems can be solved relatively well. This is wh
24.
by mochomocha 3y ago
Having experimented with a lot of CFS knobs, my high-level conclusion is that every single non-default behavior is broken to various degrees, and default behavior isn't immune to pathological edge cases either.
25.
by mochomocha 3y ago
I'd like to wager that EEVDF has been tested less methodologically than how this paper investigates CFS. The primary author of EEVDF and maintainer of the subsystem has been dismissing alternative approaches and plethora of robustly te
26.
by mochomocha 3y ago
If you know anything about Ilya, it's definitely not out of character.
27.
by mochomocha 3y ago
Well, from my first account (I worked there) this is wrong. Also, there's never been stack ranking.
28.
by mochomocha 3y ago
> Netflix pays well because they don't believe in work-life balance, at all. I'm surprised you've made a general statement out of a company you've never actually worked for. For engineering roles, work life balance at
29.
by mochomocha 3y ago
Was true until 2022. Unfortunately levels rolled out for both ICs and managers.
30.
by mochomocha 3y ago
It's apt in Yoshua's case though, as he hasn't made any significant contribution himself. I'd argue his brother during his tenure at Google has had a much bigger impact.

More ›