3 ms·

Interesting: The last demo on the blog took 2.5h to complete: https://www.cognition-labs.com/blog https://www.cognition-labs.com/blog https://www.youtube.co

by singularity2001 3y ago

Interesting: The last demo on the blog took 2.5h to complete: https://www.cognition-labs.com/blog https://www.cognition-labs.com/blog https://www.youtube.com/watch?v=UTS2Hz96HYQ https://www.youtube.com/watch?v=UTS2Hz96HYQ "Devin's Upwork Side Hustle" I wonder how much time of this was consumed by manually directing Devin into the right direction, manually fixing and undoing the mess Devin produced and watching Devin burn through $$$. As others said, being completely non-transparent about this burns a bit of trust, but I'd really like to know where we are right now. Since Devin is currently "invite only demos", a more realistic peek into the state of the art can be seen here: https://docs.sweep.dev/blogs/gpt-4-modification https://docs.sweep.dev/blogs/gpt-4-modification My gut feeling (and limited experience): gpt-4 and other models are not quite there yet, but whoever prepares for the next generation of models now will eventually win big times. Or be replaced by simpler approaches.

joshuahutt 3y ago
We're solving the wrong problem. People trying to use cars to pull horse carts are doomed to fail. Trying to use AI to build the software of yesterday is a waste of time.
- singularity2001 3y ago
  So what should the AI build instead? Specifically with regard to UI. I don't want my banking app to run on a bunch of non-deterministic prompts.
  - sergiotapia 3y ago
    Akin to alchemy, spring up the UI to solve the user's problem. When timelines are shortened from weeks to hours, what can we build? Can a user just talk to a computer and solve their problem regardless of the platform?
    - joshuahutt 3y ago
      Exactly my point. Why do I need a custom UI for every LOB task under the sun? Just let me use a common interface to address all manner of uninteresting data problems. The UI goes away, or fades into the background, and the focus rests solely on the information I need, and the decisions I make, which I can dive deeper into with a focused AI companion. Seems like a no-brainer. Maybe folks LIKE clicking on buttons and going through 10-step procedures to get tasks done. Some mice like the maze more than the cheese, I guess.
  - joshuahutt 3y ago
    Great point. I have no idea. What are your banking use cases? For me, it's mostly information I want. I don't really need a full app for that. I want to know: 1) How much money do I have? 2) Did a check I cashed clear yet? 3) Are there any unusual charges? How is my spending this month? 4) Anything I should look into? For actions I'd want to take: 1) Deposit check 2) Transfer money from account to account 3) Make a payment / authenticate with new EFT payee All of that could be done conversationally, with a flexible level of detail. The data could be shown on any number of shared interfaces (messaging app, dedicated companion app, etc). It doesn't obviate the need for software, and there are a ton of software ideas that exist today that will still be useful, as well as ideas that have yet to be discovered that will be useful. But...I expect the LOB app to go extinct in the next couple of decades.
    - PodgieTar 3y ago
      This sounds like hell. Why on earth would you want that? Open the app, go to the account, enter the money with specificity, select the account to transfer it to, click the button. Sure, being able to say "Transfer 200 to Steve" is nice and all but.. I just don't... consider it much better than the process we have today?
      - theshackleford 3y ago
        > Sure, being able to say "Transfer 200 to Steve" is nice and all but.. I just don't... consider it much better than the process we have today? If I could actually do that verbally, that would be a huge improvement. Too bad it doesn’t work like that.
      - joshuahutt 3y ago
        Just because the process today is "good enough" doesn't mean that it's a worthwhile use of developer time to create that process. But, you're highlighting one of the challenges of changing the status quo. The "new thing" has to be significantly better than the old, otherwise people won't immediately want to switch. Similar arguments were probably made when the iPhone removed the physical keyboard.

joshuahutt 3y ago

We're solving the wrong problem. People trying to use cars to pull horse carts are doomed to fail. Trying to use AI to build the software of yesterday is a waste of time.

singularity2001 3y ago
So what should the AI build instead? Specifically with regard to UI. I don't want my banking app to run on a bunch of non-deterministic prompts.
- sergiotapia 3y ago
  Akin to alchemy, spring up the UI to solve the user's problem. When timelines are shortened from weeks to hours, what can we build? Can a user just talk to a computer and solve their problem regardless of the platform?
  - joshuahutt 3y ago
    Exactly my point. Why do I need a custom UI for every LOB task under the sun? Just let me use a common interface to address all manner of uninteresting data problems. The UI goes away, or fades into the background, and the focus rests solely on the information I need, and the decisions I make, which I can dive deeper into with a focused AI companion. Seems like a no-brainer. Maybe folks LIKE clicking on buttons and going through 10-step procedures to get tasks done. Some mice like the maze more than the cheese, I guess.
- joshuahutt 3y ago
  Great point. I have no idea. What are your banking use cases? For me, it's mostly information I want. I don't really need a full app for that. I want to know: 1) How much money do I have? 2) Did a check I cashed clear yet? 3) Are there any unusual charges? How is my spending this month? 4) Anything I should look into? For actions I'd want to take: 1) Deposit check 2) Transfer money from account to account 3) Make a payment / authenticate with new EFT payee All of that could be done conversationally, with a flexible level of detail. The data could be shown on any number of shared interfaces (messaging app, dedicated companion app, etc). It doesn't obviate the need for software, and there are a ton of software ideas that exist today that will still be useful, as well as ideas that have yet to be discovered that will be useful. But...I expect the LOB app to go extinct in the next couple of decades.
  - PodgieTar 3y ago
    This sounds like hell. Why on earth would you want that? Open the app, go to the account, enter the money with specificity, select the account to transfer it to, click the button. Sure, being able to say "Transfer 200 to Steve" is nice and all but.. I just don't... consider it much better than the process we have today?
    - theshackleford 3y ago
      > Sure, being able to say "Transfer 200 to Steve" is nice and all but.. I just don't... consider it much better than the process we have today? If I could actually do that verbally, that would be a huge improvement. Too bad it doesn’t work like that.
    - joshuahutt 3y ago
      Just because the process today is "good enough" doesn't mean that it's a worthwhile use of developer time to create that process. But, you're highlighting one of the challenges of changing the status quo. The "new thing" has to be significantly better than the old, otherwise people won't immediately want to switch. Similar arguments were probably made when the iPhone removed the physical keyboard.