pertymcpert

4 ms·

1.
by pertymcpert 5d ago
Why would reallocating resources make a single inference run worse in quality?
2.
by pertymcpert 9d ago
Yes but it's their own design, not licensing Arm cores.
3.
by pertymcpert 9d ago
It's a custom Fujitsu micro-architecture.
4.
by pertymcpert 17d ago
It's not ok if it uses resources that could be better spent elsewhere. At 3% share what do you expect them to do?
5.
by pertymcpert 25d ago
I feel like they failed upwards into the right strategy. I doubt it was deliberate and not because of the failure of their foundation models to decent.
6.
by pertymcpert 1mo ago
> No, Meta just amplified No. "Just" is understating the effect.
7.
by pertymcpert 1mo ago
I tested all recent Opus versions and 4.6 and 4.7 were both fine FWIW. Seems 4.8 is when something started to go wrong.
8.
by pertymcpert 1mo ago
Even React.
9.
by pertymcpert 1mo ago
Meta employees reading this: whether you work in Reality Labs, ads, operations, ML compiler, LLMs, marketing, whatever. You're all complicit in the harm. Remember that.
10.
by pertymcpert 1mo ago
You say that like what they were doing was a bad thing. It was a feature.
11.
by pertymcpert 1mo ago
What processing do they do to the sausage?
12.
by pertymcpert 1mo ago
> So either the manufacturer-supplied originals are more dangerous than replacement tires There's 3 main components to tire performance: efficiency, grip and longevity. OEM tires optimize for the first. They can compromise on grip a
13.
by pertymcpert 1mo ago
Most tokens are cached.
14.
by pertymcpert 1mo ago
Not sure why you had to take a pop at Greggs there. Nothing wrong with a hot sausage roll at all. Assuming you can find a hot one.
15.
by pertymcpert 1mo ago
You can actually tell from the very first real sentence in the README: > Efficiency is a 162-run controlled benchmark (same agent, same file tools, only the context differs). It's so bad that I can tell it's Claude, specificall
16.
by pertymcpert 2mo ago
Right but I've never seen these fp64 computations show up hot in a profile. I'm not saying they're not used but most of the work in a general computer usage in terms of profiles is in scalar integer code.
17.
by pertymcpert 2mo ago
I really think you should use a more representative benchmark. Heck, even just take Chrome and run some browser benchmark on it like speedometer.
18.
by pertymcpert 2mo ago
Which workloads?
19.
by pertymcpert 2mo ago
The issue is theft of IP.
20.
by pertymcpert 2mo ago
I like how this addresses very little of Apple's core complaints. OpenAI are totally fucked.
21.
by pertymcpert 2mo ago
You can tell because instead of making an arrow like this: -> it uses a Unicode symbol instead.
22.
by pertymcpert 2mo ago
Why wouldn’t it?
23.
by pertymcpert 2mo ago
It's ok, we get it you don't want one. I would happily pay $20k-$30k for one if it worked well. I know a lot of people who would.
24.
by pertymcpert 2mo ago
I have a 1300 sqft house, 3b2b. Costs me around $200 for a cleaning.
25.
by pertymcpert 2mo ago
> I'm just wondering. It's OpenAI. Surely there is some domain-specific something beyond "has experience shipping front-end and back-end services" since that includes basically everyone. Maybe you're looking at t
26.
by pertymcpert 2mo ago
> I'm not sure how this would apply. Are you implying that if the company operates on Python, you can hire someone with great "raw intelligence" who have only developed C++ all their life, and they can start contributing o
27.
by pertymcpert 2mo ago
The applicability of your advice is very model dependent. Some like Claude have very good long context performance, whereas others they fall off much quicker past some threshold.
28.
by pertymcpert 2mo ago
It's pretty painful to have speeds < 30 tok/sec though. Especially if you're used to API providers at higher speeds. It makes any interactive work almost impossible to do efficiently because you have no choice but to conte
29.
by pertymcpert 2mo ago
If you didn't already know, jobs at highly competitive companies tend to have vague job requirements because they expect to be able to apply your raw intelligence to changing demands quickly. There's no point being hyper-specific
30.
by pertymcpert 2mo ago
Well put, great article.

More ›