matusp

12 ms·

211.
by matusp 1y ago
AI generated reviews are a huge problem even at the most prestigious ML conferences. It is hard to argue against them, since the weaknesses they identify are usually in well formulated, and it is hard to argue that subjectively they are not
212.
by matusp 1y ago
Observe what the AI companies are doing, not what they are saying. If they would expect to achieve AGI soon, their behaviour would be completely different. Why bother developing chatbots or doing sales, when you will be operating AGI in a f
213.
by matusp 1y ago
Is there any other field where they give you random brain teasers for an interview? My friends outside of IT were laughing their heads off when they hears about the usual interview process.
214.
by matusp 1y ago
Yeah, Wikipedia, but also many news sites use this style. It is mostly not a call to action, but additional optional information you can check out. That's why it feels wrong to use it in these cases. I think that some of the examples a
215.
by matusp 1y ago
To be honest, I expected the punchline to be about how randomly drawing lines is the same nonsense as using simplistic mathematical modeling without considering the underlying phenomenon. But the punchline never came. Predicting AI is more
216.
by matusp 1y ago
Tracing the fiber back is possible only in extremely favorable conditions. The light must hit the cable just right and there cannot be too many cables from previous runs on the battlefield.
217.
by matusp 1y ago
Agreed completely. There is a ton of research into how to represent text, and these simple tokenizers are consistently performing on SOTA levels. The bitter lesson is that you should not worry about it that much.
218.
by matusp 1y ago
I actually think that their main problem is the belief that they can learn everything about the world by reading stuff on the Web. You can't understand everything by reading blogs and books, in the end, some things are best understood
219.
by matusp 1y ago
The problem with your argument is that what you call agent is nothing like what Minsky envisioned. The agents in Minsky's world are very simple rule based entities ("nothing more than a few switches") that are composed in vas
220.
by matusp 1y ago
I completely agree with you and I am surprised by the praise in this thread. The entire research program that this books represents is dead for decades already.
221.
by matusp 1y ago
I wonder to what extent this is caused by the writing style LLMs have. They just love beating around the bush, repeat themselves, use fillers, etc. I often find it hard to find the signal in the noise, but I guess that it is inevitable with
222.
by matusp 1y ago
Obviously it can't handle heavy impasto. With heavy impasto, people usually literally sculp the surface using some material to math the rest of the painting and then paint on top of this. Even with minimal impasto, they will often try
223.
by matusp 1y ago
Two differences. (1) You can do more targeted attacks. The furthest IRA got was usually to park a van in front of a building. With drones, you can target individuals, cars, planes, etc, even when they are physically separated from public sp
224.
by matusp 1y ago
I like to observe how organization affects how a company operates. As soon as you create a department, that department will start to generate reasons why it should remain being a department, as a sort of self preservation instinct. If you e
225.
by matusp 1y ago
I agree that AI is an extreme example, but similar pressures exist in other popular fields and subfields, especially in STEM. Peter Higgs famously said that he would probably not be able to do a PhD nowadays.
226.
by matusp 1y ago
In my experience, the publication pressure in today's science is to large extent inhibiting innovation. How can you innovate when you need to have X papers every year, otherwise you will not get that position of funding. To fulfill the
227.
by matusp 1y ago
One thing that is making them cheap is the lack of moats. If anybody can provide the same service, the market will push the prices down eventuallt, as this is a model demand-supply situation. OpenAI has the advantage due to brand awareness,
228.
by matusp 1y ago
> LLMs are human culture compiled into code. They will strongly tend to follow patterns of human behavior, to the point of that being their main (only?) feature. Perhaps, but this already disproves the idea of superhuman PhD+ level AI ag
229.
by matusp 1y ago
There is a genre of articles that list similar non-intuitive facts about various domains (people's names, music, etc). The relation to programmers is that they are often creating software systems where some of these facts come into pla
230.
by matusp 1y ago
My hot take on meta prompting is that it is mostly not needed. Most workflows people want to build have only one or two trivial steps. You can usually get pretty close with just playing around with the prompt for a bit.
231.
by matusp 1y ago
Completely agree. Ironically, by focusing on Jobs' presentations, people are admiring the type of presentation that they will probably never do, and they do not consider that it probably cost 100s of man-hours to prepare it. I think it
232.
by matusp 1y ago
In some mixture-of-experts approaches, samples or tokens are being distributed among experts. The experts are selected by trying to predict what is a good expert-sample match. Depending on your neighbors in the batch, you might be assigned
233.
by matusp 1y ago
We will see more and more AI startups running out of money soon. I know of a handful of similar 100m+ raised companies that have no product to speak of and are just cruising towards their end.
234.
by matusp 1y ago
Nice writeup, but regarding title -- I find it fascinating how powerful attention really is. There were some tweaks developedz sure, but if I open Llama 4 code on HugginFace, it is more or less the same code that I've seen there 5 year
235.
by matusp 1y ago
Customer is willing to pay 10k. Supplier will charge 10k. Customer is willing to pay 10k, state is willing to pay 5k. Supplier will charge 15k.
236.
by matusp 1y ago
I think that level of transparency is the new norm. Everybody has mobile phones and you can have a new satelite imaginery every few hours. It's pretty difficult to hide a jet loss, unless it happens at sea.
237.
by matusp 1y ago
> pre-modern military command at a tactical level is almost completely nonexistent I think you mean strategic level. Tactically, they were able to hold formation, rotate, do all kinds of maneuver. Just look at how many "NCOs" a
238.
by matusp 1y ago
I think the most obvious context is visual art. There are thousands of depictions of medieval battles. Would really nobody think of depicting a volley of arrows in any of them? That would be a pretty spectacular sight with supposedly devast
239.
by matusp 1y ago
Ironically, AI research canonically uses arithmetic mean for averaging basically everything. Whatever suite of experiments you are running, somebody will sooner or later ask you to average them.
240.
by matusp 1y ago
It's actually Roman: Magni minores saepe fures puniunt

More ›