jononor

10 ms·

181.
by jononor 1y ago
Yeah many have their favorite gripes with $TheOthers, and hoping that the AI will solve them. It won't - not because AI isn't good, but because the people involved will quickly adapt. Likely making new annoying behaviors, and prob
182.
by jononor 1y ago
Forced I don't know... But of course the financial incentives are very strong, as in many categories the Chinese brands have remarkable and sometimes astonishing value-for-money. But for a small business, the cost of these tools might
183.
by jononor 1y ago
It would be good if the difficulty of getting patents would go up by a factor of 10. To get less of them in volume, and less bullshit ones. Should also throw out a bunch of the existing bad ones.
184.
by jononor 1y ago
The TinyML niche, doing ML on microcontroller grade hardware (usually for sensor data analysis), is close in terms of constraints. Models measuring in kilobytes of RAM/FLASH. But usually missing the flair and showmanship of demoscene,
185.
by jononor 1y ago
GDDR6 8Gb spot (DRAMExchange) is now around 2.6 USD, down from 3.5 USD in summer 2023, and 6 USD in summer 2022? Last year has been pretty flat though!
186.
by jononor 1y ago
How long is foreseeable future? In 10 years I think LLM accelerator (GPU/NPU/etc) with 100 GB VRAM will cost under 2000 USD.
187.
by jononor 1y ago
Automation can be useful and valuable (economically) even if not intelligent. Heck from a big picture view of solving a problem (say to manufacture something), then a solution/process/workflow etc that requires less intelligence
188.
by jononor 1y ago
This was a very important realization for me. That many times when I felt small cravings, the main thing I needed was not something sweet but water. Before I would drink milk, lemonade etc. But now I just drink water. Helped to regulate blo
189.
by jononor 1y ago
GPU compute per dollar has been on a pretty steady curve of around 10x per decade. In ML for computer vision we were also able to make models around 10x as efficient per 10 years. I think with these two factors combined, mapped to LLMs, we
190.
by jononor 1y ago
"LLM" as well, because coding agents are already more than just an LLM. There is very useful context management around it, and tool calling, and ability to run tests/programs, etc. Though they are LLM-based systems, they are
191.
by jononor 1y ago
Yeah, if we are lucky it might happen that fast!
192.
by jononor 1y ago
Seems like we may get local, open, workstation-grade models that are useful for coding in a few years. By workstation-grade I mean a computer around 2000 USD, and by useful for coding I mean around Sonnet 4 level. Current cloud based models
193.
by jononor 1y ago
No, the open source code I make is there to be used freely and for all. LLMs do not change this for me. I think that open source libraries (but maybe not applications) may be even more relevant now than ever. More application code will be w
194.
by jononor 1y ago
On the practical side there are many good options. Using the voice effectively is a key skill in many professions, such as singing, public speaking, education, religious, management. So there are many practitioners, and lots of learning mat
195.
by jononor 1y ago
The world models are not really useful yet. So they are starting lower, compared to LLM. So they probably have some decent gains to make still, before it gets really hard (diminishing returns).
196.
by jononor 1y ago
Why is it like that, currently? There is no information added by a vector index compared to the original text. And the text is highly redundant and compressible with even lossless functions. Furthermore a vector index is already lossy and a
197.
by jononor 1y ago
Hypothetically that might ne true. But current systems do not do online learning. Several recent models have cutoff points that are over 6 months ago. It is unclear to which extent user data is trained on. And it is is not clear whether one
198.
by jononor 1y ago
Logging everyones network data/metadata would likely be illegal under employment law in Norways. Other European countries may have same/similar rules. GDPR may also apply. So be careful with how broadly you apply that default.
199.
by jononor 1y ago
It has not learned anything. It just looks in its context window for your answer. For a fresh conversation it will make the same mistake again. Most likely, there is some randomness and also some context is stashed and shared between conver
200.
by jononor 1y ago
I for one am quite surprised. Sometimes impressed. But also often frustrated. And occasionally disappointed. Sometimes worried about the negative follow-on effects. Working with current LLMs spans the whole gamut... But for coding we are a
201.
by jononor 1y ago
A decent training pipeline will be able to reproduce models with equivalent aggregate performance (as measured by the evaluation metrics). And a high degree of similarity in behavior on specific inputs - but not identical. It will not be th
202.
by jononor 1y ago
Probably a fair bit of hubris, sure. But right now it is not possible or legal to operate a company without a CEO, in Norway. And I suspect that is the case in basically all jurisdictions. And I do not see any reason why this would change i
203.
by jononor 1y ago
Some of their core skill is taking credit and responsibility for the work others do. So they probably assume they can take do the same for an AI workforce. And they might be right. They also take do the same already for what the machines in
204.
by jononor 1y ago
No the preferred way of making modifications is the weights _together_ with training (or fine tuning) scripts, and the entire evaluation pipeline to measure performance. And the data required to support all of this. When someone joins your
205.
by jononor 1y ago
If everyone else had stayed silent as well, then I would agree. But as it is right now they are juuust about managing to match the current pace of the other contenders. Which actually is fine, but they have previously set quite high expect
206.
by jononor 1y ago
There are so many people on-board with this idea, hypemen collaborators, that I think they might be safe for a year or two more. The hypers will shout about how miraculous it is, and tell everyone that does not get the promised value that &
207.
by jononor 1y ago
The modern Microsoft with Azure, Office360, etc is not much threatened by open source software. Especially with Azure, open source is a fantastic compliment which they would like the world to produce as much of as possible. The same with AI
208.
by jononor 1y ago
You made me think of the role of mental effort/exercise. In parts of the western world, we are already experiencing a large increase in dementia/alzheimer and related. Most of it is because we are doing better with other killers l
209.
by jononor 1y ago
The "numpy" Sobel code is not that good, unfortunately - all the iteration is done in Python, so there is not much benefit from involving numpy. If one would use say scipy.convolve2d on a numpy.array, it would be much faster.
210.
by jononor 1y ago
There are several datastructures for numeric data that do not need marshalling, and are suitable for very efficient interoperetion between Python and C/C++/Rust etc. Examples include array.array (in standard library), numpy.array,

More ›