rhdunn

3 ms·

1.
by rhdunn 2mo ago
So... distribute a LoRA (or equivalent) that modifies the base weights with the abliteration vectors. That makes sense as it would be possible to try different abliterations and keep the storage space down.
2.
by rhdunn 2mo ago
I've not written a language server but have written a language plugin for IntelliJ. I started with writing a correct recursive descent parser. I then extended it to detect, report, and recover from common syntax errors as I encountered
3.
by rhdunn 2mo ago
I find AI autocomplete and chat (asking specific questions, getting general code I can adapt, etc.) to be useful. I'm not sold on agents and agentic workflow. When I tried using agents for something as a test it immediately started doi
4.
by rhdunn 2mo ago
5) multithreading 4) database synchronization
5.
by rhdunn 2mo ago
One of the biggest limitations right now is memory capacity (storing large models/contexts in memory) and bandwidth (transferring the relevant data/weights to the silicon that is performing the operations on that data). This would
6.
by rhdunn 2mo ago
1. It's kind of like humming or singing, just internally. 2. Only via memory recall and even then its not stable and I don't "see it" with what my eyes are seeing/processing but more with the memory/recollectio
7.
by rhdunn 2mo ago
My internal thoughts are verbal and don't see pictures as a normal part of my inner though process. When someone says "imagine a pink elephant in the room" I don't see a pink elephant, but instead have an inner dialogue
8.
by rhdunn 2mo ago
It depends on how the model is evaluated/scored during training. If you don't have those laws encoded in the evaluation step (without any errors or ambiguities) then the model isn't going to learn to follow those laws. For mo
9.
by rhdunn 2mo ago
I'm not sure if this is true any more but the reason for this is that negative indicators ("not", "don't", "do not", etc.) occur frequently in the underlying text such that the model learns to weight
10.
by rhdunn 2mo ago
Part of software development is architectural design, database design, etc. That goes hand-in-hand with coding -- you come up with the design then implement that design. Part of software development is structuring the code to make it readab
11.
by rhdunn 2mo ago
It depends on whether you are using the LLM as a) an advanced autocomplete; b) a chatbot/query interface; or c) an agent. Only the latter goes and does things for you. It's also confusing that the term AI has become synonymous wit
12.
by rhdunn 2mo ago
These models aren't really LLMs -- they don't just operate on text tokens. They often include vision models and in some cases audio models. That means that they can better associate the meaning of images and words together so that
13.
by rhdunn 2mo ago
You're comparing a company (Shopify) to an application (Google Chrome). A better comparison would be the number of engineers at Google (90,000 [1]) vs Shopify, or the number of developers actually working on the mobile application inst
14.
by rhdunn 2mo ago
I'm not an AI critic (I use it for autocompletions and asking some questions) but still write my own code. I'm not sold on the agentic workflows that AI labs are pushing and haven't yet figured out if/when/how to in
15.
by rhdunn 2mo ago
So this would suggest that the Goidelic languages (Irish Gaelic, Scottish Gaelic, Manx) are derived from the Brittonic languages (Welsh, Breton, Cornish). [1] I wonder how this affects the different proto-Celtic to modern Celtic languages h
16.
by rhdunn 2mo ago
Ruby tags apply to other scripts as well like Japanese and Korean. See https://www.w3.org/TR/css-ruby-1/ .
17.
by rhdunn 2mo ago
It only makes sense to train a frontier model if you are trying a different architecture to one that is available from an existing frontier model. This is because the different model architecture will learn the weights differently. It may m
18.
by rhdunn 2mo ago
My understanding is that 1) SR doesn't consider acceleration (it's an extension of Galilean/uniform motion), and that 2) when Einstein considered acceleration as well as gravity via the equivalence principle which lead to GR
19.
by rhdunn 2mo ago
The article says that this proves that Einstein's equivalence principle (resulting in relativity) holds in this test of a falling quantum particle (where gravity results in a phase shift in the quantum state). It doesn't show&#x2F
20.
by rhdunn 2mo ago
Welch Labs on YouTube has a great collection of videos on how AI models learn. His recent video [1] covers how image models can learn to encode reasoning in the image processing layers when not given an out of band reasoning set of weights
21.
by rhdunn 2mo ago
1. Does the implementation fit in the architecture/style of the project? 2. Are there potential security, accessibility, performance, etc. issues? 3. Domain specific knowledge (SQL, ASP.NET, XQuery, etc.) where there are better ways of
22.
by rhdunn 2mo ago
My theory behind this is that when you encounter something new/novel it is distinct enough to remember -- where you were when you learned of 9/11; the days around the start of covid/lockdowns; being in a car accident; getting
23.
by rhdunn 2mo ago
It is clever, but makes comparing versions of the WordNet database a lot harder as the byte offsets change as entries are added and removed.
24.
by rhdunn 2mo ago
"Secret Hitler" is a social deduction game ( https://en.wikipedia.org/wiki/Secret_Hitler ). You can find various games of it on YouTube.
25.
by rhdunn 2mo ago
The reasoning is that 600 is 60x10 which is conflating base 60 and base 10 numbering systems. You would expect something like 3600 (60x60), or even (given things like our units of time) 720 (60x12). The latter is because 12 is a factor of 6
26.
by rhdunn 2mo ago
Keyboard shortcuts for those menu items are what most people will learn -- save, print, cut, copy, and paste will be the common ones that a lot of people will know. I'd be willing to bet that professional typists and people who spend t
27.
by rhdunn 2mo ago
In some cases you may need the keyboard accessibility. - Your mouse/trackpad breaks or isn't recognized? - The right mouse button for your trackpad isn't working for some reason (e.g. you spilled a drink on it). It should sti
28.
by rhdunn 2mo ago
My go to when implementing custom controls that can't be achieved in native HTML is the ARIA Patterns ( https://www.w3.org/WAI/ARIA/apg/patterns/ ) site. That has clear documentation on the roles, sta
29.
by rhdunn 2mo ago
That's why you don't just use colour for identification. E.g. include a warning icon next to a button/element in addition to using a warning colour.
30.
by rhdunn 3mo ago
It would be more flexible for a compiler to reuse the range analysis logic used in optimizations for statically verifiable divide by zeros. That way you could extend it to other things like statically verifiable overflows.

More ›