aabhay

9 ms·

151.
by aabhay 1y ago
Agreed. Effectiveness would imply that some algorithms are more likely to sort the list correctly than others, or they sort a higher percentage of elements. Efficiency is about factors external to the correctness
152.
by aabhay 1y ago
Is it cheap? It adds up really quickly. One shot at trying to build an iteration of a simple python app (<1000 LOC tops) can cost between $1 and $5. And that’s a single attempt. And this is just the tip of the tip of the iceberg of what
153.
by aabhay 1y ago
But at least you clicked
154.
by aabhay 1y ago
I wish there were some actual stories here about tricky migrations and how they were handled, rather than defaulting to the naturally turf war framing here. If my experience, writing code that is “future migration friendly” is one of the ha
155.
by aabhay 1y ago
First heard about this when docker started rate limiting
156.
by aabhay 1y ago
Many fast food places now have tablet based ordering, so turns out AI wasn’t needed for software to take away jobs. That said, AI could do that job perfectly well. The reason we still have human to human interaction when you order is that i
157.
by aabhay 1y ago
I don’t get why so many people are resistant to the concept that AI can prove new mathematical theorems. The entire field of math is fractal-like. There are many, many low hanging fruits everywhere. Much of it is rote and not life changing.
158.
by aabhay 1y ago
SAT scores are taken into account by many schools for that very reason that it can change how you read the application of a candidate. SAT is almost always read in terms of the deviation from the school or community average. So its not the
159.
by aabhay 1y ago
Colleges are a “marketplace” as much as any other marketplace. Just how Stanford disrupted the traditional Ivy League monopoly, other schools can disrupt the status quo by consistent churning out leaders, great thinkers, entrepreneurs, and
160.
by aabhay 1y ago
Demanding 15% of H20, causing China to retaliate and ban it, causing Nvidia to halt production. In terms of net effect, it’s atrocious regardless.
161.
by aabhay 1y ago
He told me 2 (fuck off)
162.
by aabhay 1y ago
Seems a bit drastic to compare Ghibli style transfer to revenge porn, but you do you I guess.
163.
by aabhay 1y ago
I’m skeptical of the method but excited for the direction. Giving models different personalities is adjacent to giving models different values / morals. Having a diversity of model personalities is a step in the right direction. Unfort
164.
by aabhay 1y ago
My guess is the todo list is carried across “compress” points where the agent summarizes and restarts with fresh context + the summary
165.
by aabhay 1y ago
Isn’t this what “GPTs” was supposed to be? Why not just use that if this is essentially just a system prompt?
166.
by aabhay 1y ago
Based on the Google presented answers, its possible that the report is generated post-hoc as a summarization of the prior thoughts. One could also presume that this summarization step is part of the mechanism for running the Tree of Thought
167.
by aabhay 1y ago
Transfer learning isn’t about “exhausting” all available un-curated data, its simply that the systems are large enough to support it. There’s not that much of a reason to train on all available data. And its not all, there’s still a very si
168.
by aabhay 1y ago
The main problem with the “Bitter Lesson” is that there’s something even bitter-er behind it — the “Harsh Reality” that while we may scale models on compute and data, that simply broadly inserting tons of data without any sort of curation y
169.
by aabhay 1y ago
I am deeply skeptical of the author’s conclusions to the point of being skeptical of their motive. These HALO type acquisitions are awful for the tech industry and this trend is deeply concerning to me. 1. The author fails to consider the i
170.
by aabhay 1y ago
You will get at 20gb model. Distillation is so compute efficient that it’s all but inevitable that if not OpenAI, numerous other companies will do it. I would rather have an open weights model that’s the best possible one I can run and fine
171.
by aabhay 1y ago
Very standard yep. Sales folks are sort of trained /indoctrinated into telling white lies like that in order to get in the door. There are loads of examples of using fake momentum to close deals. If its a senior person it’s “My CEO ask
172.
by aabhay 1y ago
As Albert mentioned, the benchmarks and data we use today heavily prioritize recall. Transformers are really really good at remembering parts of the context. Additionally, we just don’t have training data at the size and scope that exceeds
173.
by aabhay 1y ago
The point is not that tokenization is irrelevant, its that the transformer model _requires_ information dense inputs, which is derived by compressing the input space from raw characters to subwords. Give it something like raw audio or video
174.
by aabhay 1y ago
Tbh it would be really cool for there to be a TLD dedicated to extremely cheap names, on the order of 0.1-10c. This could enable all kinds of fun use cases, including automated ones. Lets say the domain is .anything, and your domain had to
175.
by aabhay 1y ago
Post industrial era, there’s been a consistent migration of jobs through what I might call the “automation lifecycle”. Programming is indeed one of these job types and the lifecycle will be similar here. Stage 0: The trade is a craft. There
176.
by aabhay 1y ago
It makes no sense design-wise, but clicking on the number links to the GitHub discussion.
177.
by aabhay 1y ago
Eagerness to tool call is an interesting observation. Certainly an MCP ecosystem would require a tool biased model. However, after having pretty deep experience with writing book (or novella) length system prompts, what you mentioned doesn’
178.
by aabhay 1y ago
That’s an odd way to defend the decision. “It doesn’t make sense because nothing has to make sense”. Sure, but it would be more interesting if you had any evidence that they decided to simply do away with any logical premise for the 4 monik
179.
by aabhay 1y ago
Given the cited stats here and elsewhere as well as in everyday experience, does anyone else feel that this model isn’t significantly different, at least to justify the full version increment? The one statistic mentioned in this overview wh
180.
by aabhay 1y ago
Easier rule is just to exclude two letter words, or make two letter words zero points (so you can get rid of your Qs and Zs if you wish

More ›