gchadwick

8 ms·

31.
by gchadwick 1y ago
Potentially it happened so quickly the pilot had no way to respond before they lost control of the aircraft and had to hit the eject? Still you'd hope transitions between major operation modes could have some manual confirmation. Is th
32.
by gchadwick 1y ago
> Any recommendations on how to start a life as a digital hoarder Stop worrying about a well collated archive and just dump everything in a suitable storage medium. I've got years of random side projects and pretty much every photo
33.
by gchadwick 1y ago
I'd disagree as the K, Q and V have distinct functions within the attention calculation. In particular when you're considering decode (next token calculation during inference which follows the initial prefill stage that processes
34.
by gchadwick 1y ago
A real issue here is lack of training data (at least for LLMs). There's lots of high quality (and plenty more poor quality) open source software that can be used to train on. There's significantly less open source hardware and oft
35.
by gchadwick 1y ago
This whole series is fantastic! Does an excellent job of explaining the theoretical limits to running modern AI workloads and explains the architecture and techniques (in particular methods of parallelism) you can use. Yes it's all TPU
36.
by gchadwick 1y ago
> It's really hard to describe how bad the general vibe is here. Eh, think that depends upon your social circles, sure it's not perfect but the vibes just fine from my perspective. There seems to be a massive swelling of online
37.
by gchadwick 1y ago
This certainly rings true with my own experiences (worked on both GPUs and CPUs and now doing AI inference at UK startup Fractile). > If there were a hypothetical high-level CPU language that somehow encoded all the information the micro
38.
by gchadwick 1y ago
Yeah it's a bit odd. I can get a sense of what they might be doing and perhaps it's a compelling product but no where near enough info to go on, let alone reserve one for $99 and later buy at $1999.
39.
by gchadwick 1y ago
I'd argue the last one looks better as well, at least if you're considering what looks more 'real'. The ChatGPT one looks like it could have been a shot from a film, the Krea one looks like a photo someone took off their
40.
by gchadwick 1y ago
Immobilizers (which lock out the engine until there's been some authorization from another device, i.e. from a chip in the key) have been mandatory in cars in the UK at least (and I would presume Europe on similar time scales) for almo
41.
by gchadwick 1y ago
> The interconnect between tiles is also statically routed and bufferless, decided at compile time. As there's no flow control or retry logic, if two data paths would normally collide, the compiler has to resolve it at compile time.
42.
by gchadwick 1y ago
Both? Theoretically amazing hardware that just needs the magic compiler to work well is a well worn path in the hardware world (The itanium being a notable example). A design can be impossible to compile well for and very hard to program ma
43.
by gchadwick 1y ago
An excellent example I really should have been able to think of myself!
44.
by gchadwick 1y ago
I do wonder why they decided to have have separate shell size and pin designations given there appears to be a 1:1 correlation between shell sizes and pins (i.e. the 'B' shell is always 25 pins, the 'E' shell is always 9
45.
by gchadwick 1y ago
The real bottleneck is the memory, optimize your matmul architecture all you like whilst you still have it connected to a big chunk of HBM memory (or whatever your chosen high bandwidth memory is) you can only do so much. So really GPU v no
46.
by gchadwick 1y ago
Very glad to see this. There is (understandably) much excitement and focus on training models in publicly available material. Running them well is very important too. As we get to grips with everything models can do and look to deploy them
47.
Codasip board initiates an expedited process to sell the company(codasip.com)
3 points by gchadwick 1y ago|0 comments
48.
by gchadwick 1y ago
> It has two layers Where did you get that from? Pretty sure it's a single planar set of transistors. Those transistors are manufactured using multiple layers of mask. FinFET transistors are described as 3D or non-planar but crucial
49.
by gchadwick 1y ago
The wires sit on top of the transistors. Many layers of them in a modern process. However you can't always pack the transistors as dense as you would like because you can't fit the wiring for them in above at the same density. Plu
50.
by gchadwick 1y ago
I wonder if they ever taped this out and did some device characterization? The devil really is in the details with things like this. 1 in 10 million events which may be hard to trigger in a detailed analogue simulation can occur many times
51.
by gchadwick 2y ago
It's even worse when paired with the ability for a local authority to go bankrupt when it can't cover the bills and be forced to sell off major capital assets (e.g. buildings, sometimes of significant public interest like concerts
52.
by gchadwick 2y ago
I think a key part of the 'poor' feeling in day to day experience comes from councils' inability to do maintenance, things like pot holes, children's play equipment, public toilet, general upkeep on public spaces and ser
53.
by gchadwick 2y ago
> ChatGPT can just send you something that is completely wrong, and you have no way of knowing. This is true, if you decide to take a ChatGPT answer at face value without any further work. Personally I find it useful sometimes to ask an
54.
by gchadwick 2y ago
A dupe of my comment from another post on this (relating to the US arbiter ruling that she may not promote the book https://news.ycombinator.com/item?id=43351949 ) People may be interested in the interview with Wynn-Williams
55.
by gchadwick 2y ago
People may be interested in the interview with Wynn-Williams (the whistleblower) on the News Agents podcast: https://www.globalplayer.com/podcasts/episodes/7DrpKCA/ (it's a UK news/political podcast
56.
by gchadwick 2y ago
Very sad to see Efabless go. They really did offer something unique with their chipIgnite programme. It provided a simple way to get a chip made at very low cost ($10k) with no barriers. Thanks to the open source toolchain and PDK you just
57.
by gchadwick 2y ago
Personally I find value in toy examples like this as it helps me check I actually understand the core architecture. You can look at a diagram or an equation explaining a transformer block but how do you make the jump from that to actually i
58.
by gchadwick 2y ago
Worth noting that production silicon is on the way for OpenTitan ( https://opensource.googleblog.com/2025/02/fabrication-begins... ). An OpenTitan chip in a future TKey can give both strong hardware security (you&#x
59.
by gchadwick 2y ago
Only given it a skim read so far but this looks like a really nice write up and it's a fantastic piece of work. Laser fault injection is a very powerful attack so great to see it becoming more accessible through work like this (or terr
60.
by gchadwick 2y ago
I do find HN threads about R-Pi products weigh heavily negative. Yet despite the apparent many major issues that keep getting pointed out R-Pi seems to keep going from strength to strength. Maybe they understand their own customers and thei

More ›