3 ms·
> maybe GPT5 had seen this or a similar construction somewhere in its training data I'm disappointed that he didn't spend a little time checking if this was th
by burkaman 1y ago
> maybe GPT5 had seen this or a similar construction somewhere in its training data
I'm disappointed that he didn't spend a little time checking if this was the case before publishing the blog post. Without GPT, would it really have taken "a week or two to try out ideas and search the literature", or would it just have taken an hour or so to find a paper that used this function? Just saying "I spent some time searching and couldn't find this exact function published anywhere" would have added a lot to the post.
Sharing the conversation would be cool too, I'm curious if Scott just said "no that won't work" 10 times until it did, or if he was constructively working with the LLM to get to an answer.
- vzaliva 1y agoHe could have asked GPT to find prior mentions or inspirations for this idea...
- HappyPanacea 1y ago> or would it just have taken an hour or so to find a paper that used this function? It is pretty hard to find something like this perhaps if you had math aware search engine enhanced with AI and access to all math papers you could find if this was used in the past. I tried using approach0 (math aware search engine) but it isn't good enough and I didn't found anything.
- xyzzyz 1y agoYeah, if you don't know the name of the thing you're looking for, you can spend weeks looking for it. If you just search for generic like "eigenvalue bound estimate", you'll find thousands of papers and hundreds of textbooks, and it will take substantial amount of time to decide whether each is actually relevant to what you're looking for.
- SmartestUnknown 1y agoThe expression f(z) = \sum_i 1/(z-\lambda_i) is called Stieltjes transform and is heavily used in random matrix theory and similar expressions are used in other works such as Batson, Spielman and Srivastava. This is all to analyze the behavior of eigenvalues which is exactly what they were trying to understand. I'd be very surprised if Aaronson doesn't know about this.
- deleted 1y ago[deleted]