matusp

8 ms·

91.
by matusp 9mo ago
ChatGPT - 5.8b visits - -5.2% MoM Gemini - 1.4b visits - +14.4% MoM Yeah, ChatGPT is still more popular, but this does not show Gemini struggling exactly.
92.
by matusp 9mo ago
Do we have a better estimate? I don't think it's particularly difficult to get information from the occupied territories, the people there seem to freely use Internet. It's my understanding that this war is really not particu
93.
by matusp 9mo ago
My skills are alright, nothing too crazy. I've had messages that were more spammy/scammy, but the volume was not crazy high, they were usually fairly obvious, and I resolved by simply ignoring them. I would say that the random cha
94.
by matusp 9mo ago
My current job cold contacted me via LinkedIn. I use LI minimally, basically only to establish connections with my network, and it already gave me huge value back.
95.
by matusp 9mo ago
Working as ML engineer/researcher: - LLMs are absolutely abysmal at PyTorch. They can basic MLP workflows, but that's it more or less. 0% efficiency gained. - LLMs are great at short autocompletes, especially when the code is pred
96.
by matusp 9mo ago
The interesting question is how much more software we actually need. Will software be done one day, all built up, similar to railway networks? With LLMs, software engineering might get cheaper, but it can also lead to increased demand. Re
97.
by matusp 10mo ago
So if we could set it up in a way where there is no slippery slope, you would be okay with it?
98.
by matusp 10mo ago
AI alignment is not a solved problem by any means. As long as LLMs hallucinate, they cannot be considered aligned. You can only be aligned if you have a zero probability of generating hallucinations. The two problems, alignment and hallucin
99.
by matusp 10mo ago
Just to play devil's advocate, you're okay with forcing a criminal to sit in a room for the rest of their life, but you're not okay if they also have to work for society during that timeframe. What is the main argument why th
100.
by matusp 10mo ago
1. Go out every morning to work in your field. 2. When the Sun rises, make a note on the same fixed piece of wood, e.g., a fence. 3. Observe the leftmost and rightmost positions, these are your solstices. 4 You can now use your fence to ide
101.
by matusp 10mo ago
The AI hate is unreasonably strong right now. People are acting like adding one feature they don't like or need to a browser is a borderline critical offense because it is an AI feature. I find it shocking how quickly the public in the
102.
by matusp 10mo ago
Does cooling destroy H20 molecules somehow?
103.
by matusp 10mo ago
They don't have any more juice left to squeeze at that front. The lack of new ideas in LMs is pretty palpable by now. There is a bunch of companies with billions invested in them that are all just looking at each other, trying to figur
104.
by matusp 10mo ago
I don't really buy this post. LLMs are still pretty weak at long contexts and asking them to find some patterns in data usually leads to very superficial results.
105.
by matusp 10mo ago
> Less than half of current AI projects had generated more in returns than they had cost, respondents said. Compares to non-AI software, is this a bad number?
106.
by matusp 10mo ago
In general, I find it not convincing to use patent-based metrics as the only argument. The parent writing culture might have changed in various ways that are not related to the quality of the ideas. This undermines the entire argument...
107.
by matusp 10mo ago
I would say it was discovered, not invented. People were messing around with some algorithms, intruiged by their results. Eventually researchers discovered that with using certain training algorithm with certain data can lead to really wond
108.
by matusp 10mo ago
What do you mean? I can only input k tokens into my LLM to calculate the probs. That is the definition of my state. In the exact way that N-gram LMs use N tokens, but instead of using ML models, they calculate the probabilities based on
109.
by matusp 10mo ago
LLMs definitely also have finite context length. And if we consider padding, it is also constant. The k is huge compared to most Markov chains used historically, but it doesn't make it less finite.
110.
by matusp 10mo ago
What do you mean? The states are fully observable (current array of tokens), and using an LLM we calculate the probabilities of moving between them. What is not MC about this?
111.
by matusp 10mo ago
LLMs are indeed Markov chains. The breakthrough is that we are able to efficiently compute well performing probabilities for many states using ML.
112.
by matusp 10mo ago
You can achieve medieval peasent level of life quality by not working at all these days.
113.
by matusp 10mo ago
This was common even in 2015. You can still see people removing stop words from text, even when they feed it to LLMs. It's of course terrible for performance, but old habits die hard I guess.
114.
by matusp 10mo ago
Consider using structured output. You can define a JSON with specific fields, and LLMs are only used to fill in the values. https://ai.google.dev/gemini-api/docs/structured-output
115.
by matusp 10mo ago
Same, I have one living document that is constantly being updated with TODOs, questions, notes, but once they are done or irrelevant, I delete them. I am actually surprised how many people here use append-only approaches.
116.
by matusp 10mo ago
FYI, what you said is one meaning. But it is also, surprisingly, defined as brief trivial fact.
117.
by matusp 10mo ago
I don't think the author meant that you have to be the world leading expert at any topic. You can be pretty average, but you need to give it your personal twist. He is warning against very generic abstract talks that can be replaced by
118.
by matusp 10mo ago
Agreed, compare that to Quit Safari and Force Quit Safari below. One is X in a square, the other is X in a circle. Very confusing.
119.
by matusp 10mo ago
Simple illustration of what you are explaining in 1D. Imagine a simplified Earth: Water -- Ground -- Water Now let's add a Moon with gravitational pull. The pull stretches the system, because gravity is stronger the closer you are to t
120.
by matusp 10mo ago
There is none. Filevine is not even an "AI" company. They are a pretty standard SaaS that has some AI features nowadays. But the hive mind needs its food, and AI bad as we all know.

More ›