3 ms·

If you've experienced this life altering change and it's reproducible, you could show up a lot of AI critics with specifics. How have LLMs expanded your ability

If you've experienced this life altering change and it's reproducible, you could show up a lot of AI critics with specifics. How have LLMs expanded your ability to reason, for example?

soulofmischief 2y ago
At the risk of sounding negative... The thing is I have tried interfacing with skeptics, and most of them are just run-of-the-mill closeminded, have their minds made up before you even begin and will just argue in circles until it simply isn't worth it. Meanwhile, a decent portion of my own peers echo my sentiment, mainly programmers. I don't have to argue with them. Instead I can analyze and improve methodologies with them, collaborate, and generally have positive, stimulating and thought-provoking conversations. You can imagine which of the two kinds of people I typically choose to engage with. Especially on a forum like HN, where meandering circular arguments are discouraged. Maybe the happy medium is just blogging about it. I really do want to blog and I'm trying to learn about it and make more time to write, but HN does already scratch a lot of that itch for me. All in all... the only self-proclaimed AI critics left at this point are people who have either chosen to be deliberately ignorant about the benefits of this technology, or who lack the depth of skill or interest to find useful things for these models to do for them. I've taken on increasingly ambitious projects because I now have little programmable assistants embedded into the UX of various tools that I work with. They're not perfect, sometimes we argue, sometimes I just have to turn them off for a few hours, roll up my sleeves and work through the muck. But at a high level, the benefits are huge. Modern adequately-trained LLMs are amazing at project scaffolding, architecture, design, documentation and generally being a backboard for my thoughts when I have no one else around to converse with. My typical day is highly varied and while I have specialist friends, none of them match the generalist abilities of some LLMs. I am generally skilled enough with informatics to know when I need to corroborate or discard information (basic research skills learned independently of LLMS) and so "what if it's wrong / how will you know?" has always been an irrelevant, false paradox parroted by people lacking those basic skills which should have been taught in school. These same people already struggle with finding accurate information with search engines or libraries, it's no wonder they struggle with something like an LLM which can be very confidently wrong. With programming, it's easier. You can keep the model focused, break down tasks into tiny pieces, solve and write tests for them one by one. It encourages you to write clean, modular, self-documenting code. With other topics like science, art and mathematics, I'm still consistently impressed by 4o and o1's capabilities, despite glaring shortcomings. I know you want very specific instances but I'm really ADHD and so I am not exaggerating when I say my conversations with LLMs are highly multidisciplinary and before a just a couple years ago, I had a hard time organizing some of these more esoteric and complex systems in my head. My typical conversations would probably be of little use to someone. I'm now working in parallel on several scientific and mathematical inquiries, as well as a few ambitious engineering projects. My time spent researching has greatly reduced, as I can get up to speed very quickly by dumping some articles into an LLM conversation and asking it detailed questions, asking it to provide thought models, etc., getting maximal value out of the information by immediately dialing into areas of interest. Essentially... I've always felt naked without a phone or computer around to google the random questions and ideas I have throughout the day, and I consider the internet and search engines integral to who I am and the knowledge and skill I've attained. Now, instead of a search engine, I feel naked if I don't have a well-trained chat model around. I have developed a similar dependence as I have to search engines (I panic when I have a question, slap my leg and realize my phone isn't on my person) but the tradeoff is that I feel my thinking and doing has been augmented. And even if transformers/LLMs hit a dead end in our lifetime... after all, many of these techniques are rooted in ideas from the 60s-90s which simply "didn't work" at the time, only to become relevant again after sufficient compute is accessible... I am eager to see what the next 40-odd years of technology brings us. Regarding reproducibility, I think it would be extremely beneficial for people to be shown how AI can help them with day-to-day things, but I have a hard time recommending LLMs to people who I know aren't equipped with enough research skill to avoid harming or hindering themselves from incorrect advice. And my experience with these models is mainly academic and related to engineering, so I just don't have much to offer normies, but I'm sure other people have made lots of ground on that. Personally I think chat models in their current form just aren't natural or functional enough to appeal to the average person. I think the average person will see the biggest benefits from tooling built around modern models. I'm working on one right now, a grid-based component system which essentially lets you create tiny little tools that can speak with each other, and orchestrate them into one or more domain-specific UIs. Users can share and adapt apps or individual components, or create production-ready in-house creative or business tooling. Social productivity programs like this, as well as calendars, sheets, etc (all buildable within my app in minutes with a handful of stock components, with built-in multi-user support) will unlock the full power of advanced natural language models. Hoping to debut it sometime next year.

If you've experienced this life altering change and it's reproducible, you could show up a lot of AI critics with specifics. How have LLMs expanded your ability to reason, for example?

soulofmischief 2y ago

At the risk of sounding negative... The thing is I have tried interfacing with skeptics, and most of them are just run-of-the-mill closeminded, have their minds made up before you even begin and will just argue in circles until it simply isn't worth it. Meanwhile, a decent portion of my own peers echo my sentiment, mainly programmers. I don't have to argue with them. Instead I can analyze and improve methodologies with them, collaborate, and generally have positive, stimulating and thought-provoking conversations. You can imagine which of the two kinds of people I typically choose to engage with. Especially on a forum like HN, where meandering circular arguments are discouraged. Maybe the happy medium is just blogging about it. I really do want to blog and I'm trying to learn about it and make more time to write, but HN does already scratch a lot of that itch for me. All in all... the only self-proclaimed AI critics left at this point are people who have either chosen to be deliberately ignorant about the benefits of this technology, or who lack the depth of skill or interest to find useful things for these models to do for them. I've taken on increasingly ambitious projects because I now have little programmable assistants embedded into the UX of various tools that I work with. They're not perfect, sometimes we argue, sometimes I just have to turn them off for a few hours, roll up my sleeves and work through the muck. But at a high level, the benefits are huge. Modern adequately-trained LLMs are amazing at project scaffolding, architecture, design, documentation and generally being a backboard for my thoughts when I have no one else around to converse with. My typical day is highly varied and while I have specialist friends, none of them match the generalist abilities of some LLMs. I am generally skilled enough with informatics to know when I need to corroborate or discard information (basic research skills learned independently of LLMS) and so "what if it's wrong / how will you know?" has always been an irrelevant, false paradox parroted by people lacking those basic skills which should have been taught in school. These same people already struggle with finding accurate information with search engines or libraries, it's no wonder they struggle with something like an LLM which can be very confidently wrong. With programming, it's easier. You can keep the model focused, break down tasks into tiny pieces, solve and write tests for them one by one. It encourages you to write clean, modular, self-documenting code. With other topics like science, art and mathematics, I'm still consistently impressed by 4o and o1's capabilities, despite glaring shortcomings. I know you want very specific instances but I'm really ADHD and so I am not exaggerating when I say my conversations with LLMs are highly multidisciplinary and before a just a couple years ago, I had a hard time organizing some of these more esoteric and complex systems in my head. My typical conversations would probably be of little use to someone. I'm now working in parallel on several scientific and mathematical inquiries, as well as a few ambitious engineering projects. My time spent researching has greatly reduced, as I can get up to speed very quickly by dumping some articles into an LLM conversation and asking it detailed questions, asking it to provide thought models, etc., getting maximal value out of the information by immediately dialing into areas of interest. Essentially... I've always felt naked without a phone or computer around to google the random questions and ideas I have throughout the day, and I consider the internet and search engines integral to who I am and the knowledge and skill I've attained. Now, instead of a search engine, I feel naked if I don't have a well-trained chat model around. I have developed a similar dependence as I have to search engines (I panic when I have a question, slap my leg and realize my phone isn't on my person) but the tradeoff is that I feel my thinking and doing has been augmented. And even if transformers/LLMs hit a dead end in our lifetime... after all, many of these techniques are rooted in ideas from the 60s-90s which simply "didn't work" at the time, only to become relevant again after sufficient compute is accessible... I am eager to see what the next 40-odd years of technology brings us. Regarding reproducibility, I think it would be extremely beneficial for people to be shown how AI can help them with day-to-day things, but I have a hard time recommending LLMs to people who I know aren't equipped with enough research skill to avoid harming or hindering themselves from incorrect advice. And my experience with these models is mainly academic and related to engineering, so I just don't have much to offer normies, but I'm sure other people have made lots of ground on that. Personally I think chat models in their current form just aren't natural or functional enough to appeal to the average person. I think the average person will see the biggest benefits from tooling built around modern models. I'm working on one right now, a grid-based component system which essentially lets you create tiny little tools that can speak with each other, and orchestrate them into one or more domain-specific UIs. Users can share and adapt apps or individual components, or create production-ready in-house creative or business tooling. Social productivity programs like this, as well as calendars, sheets, etc (all buildable within my app in minutes with a handful of stock components, with built-in multi-user support) will unlock the full power of advanced natural language models. Hoping to debut it sometime next year.