matusp

10 ms·

121.
by matusp 10mo ago
:|
122.
by matusp 10mo ago
I think it's cultural. Managers today do daily stand-ups, one-on-ones, retrospectives, syncs, and all kinds of meetings. They are heavily invested in the day-to-day operations of the team. The societal expectation for this role is that
123.
by matusp 11mo ago
Another reason why social media matters is that people actually spend their free time in all those feeds. On the other hand, using LLMs is much more oriented towards specific utilities. Having 1B users who visit you once a day to ask for an
124.
by matusp 11mo ago
https://chatgpt.com/merchants/
125.
by matusp 11mo ago
I can see both perspectives. If you are a skilled hiree, this seems like a waste of time. But if you are hiring online, you will inevitably get a lot of terrible candidates and you need to filter them out. If you are a small team, you can&#
126.
by matusp 11mo ago
Where can I find these LLM features in Firefox?
127.
by matusp 11mo ago
If I would get a cent every time I solved a difficult problem in a project by pulling out difflib and shocking the team with it, I would have two cents. It's not a lot, but it's amusing that it happened two times already.
128.
by matusp 11mo ago
What is often missing from the discussion is the expected lifecycle of the product. Using Electron for a simple app might be a good idea, if it is a proof-of-concept, or an app that will be used sparsely by few people. But if you use it for
129.
by matusp 11mo ago
The number of runs you can afford are not enough to perform Bayesian optimization. Count how many different options they explored in the text and take a guess how many samples you need to start modeling the hyperparameter space.
130.
by matusp 11mo ago
Really impressive writeup. In your opinion, how long will this stay up to date? The field is constantly evolving, do you plan to keep updating this document?
131.
by matusp 1y ago
There is this homogenization happening in AI. No matter what their original mission was, all the AI companies are now building AI-powered gimmicks hoping to stumble upon something profitable. The investors are waiting...
132.
by matusp 1y ago
I don't think AI has anything to do with this. For a while, investors were using headcount as a metric for growth, even though startups often showed very poor utilization of their new hires. Hiring was done for the sake of hiring. Tryi
133.
by matusp 1y ago
I think that z-order is used to increase speed of loading texture from RAM. But this is not an issue in ML. You usually have all your model weights directly loaded into your GPU memory and you do not need caching for your inputs. At the sam
134.
by matusp 1y ago
I wonder how many people will use it unironically despute the writing. It's probably going to be a nonzero number, right?
135.
by matusp 1y ago
They raised billions of dollars, and they're obviously spending it to develop just about anything they can think of. What's rather concerning for them is that the core AI seems to have pretty much stagnated by now.
136.
by matusp 1y ago
What about the fact that it has 45 pages with exactly one comparison with transformer architecture (Figure 7)? This is just a fluff piece for a company trying to raise funding.
137.
by matusp 1y ago
If you want peace, prepare for war.
138.
by matusp 1y ago
Fine-tuning is a good technique to have in a toolbox, but in reality, it is feasible only in some use cases. On one hand, many NLP tasks are already easy enough for LLMs to have near perfect accuracy and fine tuning is not needed. On the ot
139.
by matusp 1y ago
We should completely strip all this talk from AI as a field (and get rid of that name as well). It just causes endless confusion, especially for general audience. In the end, the whole shtick with LLMs is that we train matrices to predict n
140.
by matusp 1y ago
Fully agreed. The author also can't decide whether AI is a Ponzi scheme, a bubble, or a cargo cult; so let’s just use them all! It's just buzzwords without any real analysis beyond what is generally known about the field.
141.
by matusp 1y ago
My exact reaction. I noticed the repetitiveness. Count how many times they reiterate the point that this was a shock for the US Navy.
142.
by matusp 1y ago
> The way I think of these transformations, but happy to be corrected, is more a matter of adding information rather than modifying This is very much the case considering the residual connections within the model. The final representatio
143.
by matusp 1y ago
What a great write-up, kudos to the author! I’ve been in the field since 2014, so this really feels like reliving my career. I think one paradigm shift that isn’t fully represented in the article is what we now call “genAI.” Sure, we had al
144.
by matusp 1y ago
> I think it is already profitable and people are more than willing to pay for the actual costs. If people are willing to pay for the costs, where are the profitable AI companies?
145.
by matusp 1y ago
It becomes feasible when people are willing to pay more than it costs to run it. But I think this will be a pretty uphill battle, as many use cases are hard to monetize (eg proofreading) and for many use cases you will feel pressure from sm
146.
by matusp 1y ago
The question is if it is economically feasible. People can enjoy generating funny AI images to share with their friends, but it might not be economically feasible to invest $100B to give them this toy. There is a question of how much value
147.
by matusp 1y ago
I am not sure how terrible that number is. They probably have many users with only very limited activity or users that simply do not need AI for the workflows they are doing. Intuitively, I would expect the number of users that actually hav
148.
by matusp 1y ago
Many research organizations use formal conference/journal rankings. These are usually calculated by following h-index values for papers published there. A new conference would start as unclassified for a few years and could not be used
149.
by matusp 1y ago
The problem is that external environment (namely hiring) creates pressure to publish in a handful of prestigious venues. Nobody wants to be the odd one out that has their papers in some less well known conferences.
150.
by matusp 1y ago
The post suggests why review quality suffers. Because of the system, there is too much reviewing going on. People get tired and produce worse reviews. Those receiving these low-quality reviews become less motivated, and in turn put less eff

More ›