martinald

3 ms·

1.
by martinald 6d ago
Not quite, it's got quite a bit more complicated with agentic use cases. Prefill (input tokens) is heavily compute bound. And the ratio of input to output continues to rise, as typically in agentic sessions you have a few tokens output
2.
by martinald 15d ago
From my understanding and IANAL there are two main problems. 1) most law requires intent, especially criminal. OpenAI certainly didn't "intend" to hack these companies given they did sandbox them etc. 2) Given the agent hacke
3.
by martinald 23d ago
I genuinely have no idea what it is meant to mean in the context it uses it. Load-bearing etc is annoying but roughly understandable, some of the opus5 classics are completely out there. I'm a native English speaker as well, I shudder
4.
by martinald 23d ago
It's not that, it's the building owners (freeholders) refusing permission, or not replying. It's a massive issue. You'll notice buildings in central London that are listed _but_ have housing association ownership nearly
5.
by martinald 23d ago
Tbh its not just that, you can have small bundles which hydrate extremely poorly. But yes, I think we are in agreement :). Can you tell I have mental scars from nextjs bundle optimisation?
6.
by martinald 23d ago
I'm not sure the author realises _what_ a massive impact bundle size has on the main thread though, especially hydration. The majority of apps I've optimised over the years have the (often vast) majority of main thread time spent
7.
by martinald 23d ago
Try it yourself on a gigabit internet. Put CPU throttling in devtools to 10x slowdown (assuming you have a fast computer) and see how fast it is even with super fast internet.
8.
by martinald 23d ago
Bit of a misleading status page, if you click in you can see that grok 4.5 and 4.6 etc are totally down, with the rest of the models showing as "up". I_strongly_ suspect they are not weighting it to actual number of requests!
9.
by martinald 23d ago
The other bizarre word I've now noticed and can't understand is "pathological". As in "bug has turned pathological"
10.
by martinald 23d ago
It's (mostly?) compute shortages. Right now it seems there is an issue in the SpaceX datacentres, so they will have less compute than normal.
11.
by martinald 23d ago
Good article and I wish this was much better known. The issue is though that it's too focused on interactivity. In reality, 90%++ of slow sites are not slow because of interactivity really, they are slow because they ship enormous reac
12.
Reducing codebase cognitive debt through quizzes?(martinalderson.com)
2 points by martinald 26d ago|1 comments
13.
by martinald 28d ago
I wrote about this a couple of weeks ago. It's actually often the biggest cost and it tends to be hidden away on most platforms! https://martinalderson.com/posts/watch-out-for-cache-read-co... Btw I still haven&#x
14.
by martinald 1mo ago
Totally agree, they really shouldn't be called antidepressants at all. Important to add tho that for many with depression they have comorbid anxiety and often the anxiety is harder to tolerate than depression, so removal of anxiety sym
15.
by martinald 1mo ago
UK is at 85% FTTH or 91% gigabit (including DOCSIS): https://labs.thinkbroadband.com/local/ . Given VM are a fair way through their XGS-PON upgrade it'll probably be 90%+ FTTH imminently.
16.
by martinald 1mo ago
ah I don't think that page was up when I checked, it 404ed!
17.
by martinald 1mo ago
FYI: nothing seems to be able to run this (easily) yet. llama.cpp, vllm etc I couldn't get working because of no support in the mainline version.
18.
by martinald 1mo ago
The switches are very cheap though. I put fibre in my house (simply because the cable is far far thinner and easier to retrofit under carpets etc). I got a few 2.5Gbit switches which have 4 2.5Gbit ethernet ports and 2 10Gbit SPF+, they cos
19.
by martinald 1mo ago
They shouldn't need to know. There could be a panel that allows you to ask for help and the "built in" agent fixes it for you in a friendly UI. Omarchy is integrating agents much more closely with the UI.
20.
by martinald 1mo ago
Tbh, I suspect this failure mode is far less than the old mode - which is paper based and your passport goes missing in transit at the embassy (or doesn't come back in time).
21.
by martinald 1mo ago
I don't think that's true. I only finally switched to desktop linux when coding agents could fix the endless small problems I came across. For example, there is a bug in the logitech mouse driver (combined with a specific AMD USB
22.
by martinald 1mo ago
Yes exactly. Also with MLO (bonding eg 5GHz and 6GHz) together on WiFi 7 you could get 480MHz of spectrum, which would allow many gigabits quite "easily". Only problem is firmware support etc is somewhere between non existent and
23.
by martinald 1mo ago
That doesn't support high power 6GHz (called standard power/AFC). You need one that does support that to get the (much) higher 6GHz transmit power.
24.
by martinald 1mo ago
Not at higher power output, which that router doesn't support.
25.
by martinald 1mo ago
Because it supports (on WiFi 7) 320MHz channels. So there is double the bandwidth. 5GHz only supports 160MHz channels.
26.
by martinald 1mo ago
What kind of WiFi 7? (There are a lot that don't have 6GHz support). You should get far better performance on 6GHz, though there are harsh power limits in most countries with various ways to enable it which may complicate things. But i
27.
by martinald 1mo ago
Why do you think that? GitHub Actions is 'simpler' to scale, it's just a bunch of runners, and Azure has a lot of capacity for VMs (mostly). Git itself is a compute intensive process and is far more interlinked.
28.
by martinald 1mo ago
I don't think it was the bad code pushes itself, it was another new peak in traffic that exhausted load balancers that then caused retry storms internally in a badly configured plugin (in VS code).
29.
by martinald 1mo ago
Nothing would really change IMO? 99% of users don't have anything like a RTX5070 (mobile especially). Even if it did, it still doesn't make much economic sense running a model locally vs on a datacentre. For example, I managed to
30.
by martinald 1mo ago
You can run these on CPUs at a somewhat reasonable speed.

More ›