Mentlo

7 ms·

31.
by Mentlo 1y ago
“This is not philosophy, this text is following in the footsteps of Alan Turing” (paraphrasing) is both incredibly humble (/s) and incredibly dismissive of philosophy as a structured form of generating knowledge. Putting that to the si
32.
by Mentlo 1y ago
The overextension is too complex for most people, same as the 2008 overextension…
33.
by Mentlo 1y ago
How this is not more examined is beyond me….
34.
by Mentlo 1y ago
Except google and facebook have locked in numbers at times of virtually no competition before they started scaling up ads. If Open AI starts scaling ads next year they will churn people at a rate that will not be offset by growth and will e
35.
What's the Role of Trust in AI?(algorithmictradeoff.substack.com)
2 points by Mentlo 1y ago|0 comments
36.
by Mentlo 1y ago
Yes, difference being that LLM’s are information compressors that provide an illusion of wide distribution evaluation. If through poisoning you can make an LLM appear to be pulling from a wide base but are instead biasing from a small sampl
37.
by Mentlo 1y ago
RAG still needs model training, if the models were to go stale and the context drifts sufficiently, the RAG mechanism collapses. Sure, those models are cheaper, but we also don’t really know how an ecosystem with a stale LLM and up to date
38.
by Mentlo 1y ago
I find this take naive. First, to have a zero sum game or indeed a positive sum game you have to be playing with perfect information with rationally behaving actors. Given most organisations have high levels of uncertainty and are resource
39.
by Mentlo 1y ago
If your c-suite is idiotic or nepotistic you can absolutely still influence them with good politics, you just need to understand their incentives and frame your arguments that way. You need to understand that you’re not playing meritocracy
40.
by Mentlo 1y ago
Great post. I’d just take it a step further and point out that this doesn’t stop at software or work. A person can not “not be in politics”. You can only choose to have politics that affect you happen without your input. That’s how you end
41.
by Mentlo 1y ago
I came here to write the same comment you did. What I’d suspect (I don’t work in self driving but I do in AI) is the issue is that this mode of operation would happen more often than not as the sensors disagree in critical ways more often t
42.
by Mentlo 1y ago
Ironically you’re now replicating the reddified response to this paper by attacking the sample size. The sample size is fine. It’s small, yes, but normal for psychological research which is hard to do at scale. And the difference between gr
43.
by Mentlo 1y ago
Where does this stop? Should i be able to run any code i want on my robot vacuum cleaner hardware? How about my washing machine? I am not disagreeing with the wider point but for a policy suggestion “hardware” should be clearly defined.
44.
by Mentlo 1y ago
Comments are full of people saying it’s a service thing and not a price thing. I feel like that’s a bit disingenuous. You can rent anything on Prime for a couple £ (I focus on rent as the “buy” has the deletion problem) in multiple video qu
45.
by Mentlo 1y ago
This is a valid hypothesis, and had this software been something you could update in the background, a valid experiment to run and see whether users like it. But when it's embedded software on physical devices where the business will h
46.
by Mentlo 1y ago
Reading your two comments in conjunction - I find your take reasonable, so I apologise for jumping the gun and going knee first in my previous comment. It was early where I was, but should be no excuse. I feel like if you're going to g
47.
Should you be coding with agents?(algorithmictradeoff.substack.com)
2 points by Mentlo 1y ago|0 comments
48.
by Mentlo 1y ago
It is absolutely impossible that human assistants being given those tasks would use even remotely within the same order of magnitude the power that LLM’s use. I am not an anti-LLM’er here but having models that are this power hungry and thi
49.
by Mentlo 1y ago
It is almost as if there’s a documented limit in how much you can squeeze out of autoregressive transformers by throwing compute at it
50.
by Mentlo 1y ago
Move fast and break investor confidence
51.
by Mentlo 1y ago
Most people are not, in fact, wise
52.
by Mentlo 1y ago
There’s software domains where there’s very little work past solving the business problem. And there’s software domains where once you’ve architected the solution, there isn’t much problem solving to continue, there’s just a long slog of st
53.
by Mentlo 1y ago
I love the assumption that an ubiquitous feature used by the most scaled e-mail app in the world uses the same expensive state of the art model that the author of the blog uses. My money would be that the gmail model is heavily distilled to
54.
by Mentlo 2y ago
Ah yes, the Civil War, a famous conflict where attacks behind the frontline were common due to airplanes and ballistic missiles. /s
55.
by Mentlo 2y ago
Fair and I agree with you, but do you agree that the only ways out of stalemate are ceasefire or west entering the conflict? Are you advocating for the west to enter the conflict?
56.
by Mentlo 2y ago
HSBC is a British company, what do you mean it's exiting the west?
57.
by Mentlo 3y ago
For this to work you'd need both a high coverage of users providing feedback signal (not happening in real cases), a low penalty of initial no-moderation to allow the system to find equilibrium, and relatively high time-invariance of s
58.
by Mentlo 3y ago
This wasn’t a result of product genius in this case - OAI just didn’t have the regulatory and PR oversight that big tech has - I know for a fact Meta and Google had CGPT equivalent models ready but couldn’t launch them as they’d get rightfu
59.
by Mentlo 3y ago
MS/G/A didn’t put this into voice assistants not because they don’t have it, but because it doesn’t scale to fit the commercials at the moment. Google invented transformers and Deepmind had GPT scale LLM’s at least a year before C
60.
by Mentlo 3y ago
Agreed, but this will probably be limited to domains where there’s better products

More ›