4 ms·

Because it was not trained on screenshots or real rendered computer UIs, but text. That is also why in my experience, LLM suck at describing click paths, and ar

Because it was not trained on screenshots or real rendered computer UIs, but text. That is also why in my experience, LLM suck at describing click paths, and are less helpful on UI development, as they never really "see" the result of the code as in rendered HTML outputs.

Gigachad 8mo ago
The terminal is also just the easier way to instruct someone to do things. "Just run this" is easier than a step by step guide through UIs which often change.
- jadeopteryx 8mo ago
  When Windows 95 was introduced as a fully graphical operating system every manual coming with Microsoft software instructed you to open the "Run"-dialog and type your drive letter followed by "setup.exe" to install the software.
- ErroneousBosh 8mo ago
  I go into the shop, I walk up to the counter, and I say "Can I have a 1/2" drive T50 Torx bit please", and the person behind the counter says "Yes of course" and we go over to the small expensive tools cabinet and get one out. I don't go into the shop and wander about until I find something that looks like it, then stand there pointing things going "THAT!" until someone figures out what I mean. And now I have a T50 Torx bit that I can stick on a ratchet with a long extension and get the passenger seat out of the Range Rover so I can retrieve my daughter's favourite necklace from where it's gotten entangled with the wiring to the gearbox and suspension ECUs in a place where I can see it with a dentist's mirror but can't actually get a grabber onto to fish it out, worse luck. So that's my afternoon sorted then. Because we're not just hacking on computers round here.
  - relaxing 8mo ago
    On the other hand, if you went and browsed the visual interface, you might discover you could purchase a 1/2” drive to 1/4” hex adapter, thereby opening up the possibility of using the entire set of impact driver bits you already own.
    - ErroneousBosh 8mo ago
      That doesn't solve the problem I have, because I already have a 1/4" ratchet and I don't have a 1/4" T50 bit. Furthermore, a T50 bit with 1/4" drive would just snap instantly. If the bit didn't break, you'd twist the end off the extension bar. I have a specific problem, which I already know how to solve, which has a specific solution, for which I need a specific component.
      - relaxing 8mo ago
        Nonsense. They make T50 bits for regular impact drivers and they don’t immediately self-destruct. Anyway the point was about the discoverability factor of user interfaces.
        ErroneousBosh 8mo ago
        So why would a 1/2" to 1/4" adaptor help, then? Consider that to crack the seat bolts free initially, I need to use a metre long breaker bar to get them moving, and I need to torque them down to something ridiculous on refitting.
- jasonfrost 8mo ago
  Like the past several decades of Linux problems, you find some stack overflow answer saying just run this command. Terminal is eternal, UI changes
- al_borland 8mo ago
  Getting people in the habit of running random commands they don’t understand in the terminal seems dangerous.
Myrmornis 8mo ago
Getting them to take screenshots with playwright/puppeteer and look at them as part of their development iteration cycle works well.
- littlecranky67 8mo ago
  For local inference, sure, but we simply lack the computing power to train them on all the images and html content that is available in the internet and books. That will happen sometime in the future, though.
  - Myrmornis 8mo ago
    Ah right, sorry, you were making a much more interesting point than my reply! I read "UI development" and jumped to the conclusion that the point was just about inference-time modify-test cycles. Yes, agreed, if they trained on images, or even better (?) on (code, image) or (code-delta, image-delta) pairs, they would surely be better at UI development.
Jackson__ 8mo ago
Alternative take: Because no designers are getting paid to move "rm" to "fileops rm" or otherwise between releases.
ixsploit 8mo ago
The UI is also less stable then most cli tools. The enterprise tools I am currently working with often have outdated screenshots in their own documentation.
6LLvveMx2koXfwn 8mo ago
Yep and also their 'click paths' (<- love that by the way) are trained on READMEs which are often out of date.

Gigachad 8mo ago

The terminal is also just the easier way to instruct someone to do things. "Just run this" is easier than a step by step guide through UIs which often change.

jadeopteryx 8mo ago
When Windows 95 was introduced as a fully graphical operating system every manual coming with Microsoft software instructed you to open the "Run"-dialog and type your drive letter followed by "setup.exe" to install the software.
ErroneousBosh 8mo ago
I go into the shop, I walk up to the counter, and I say "Can I have a 1/2" drive T50 Torx bit please", and the person behind the counter says "Yes of course" and we go over to the small expensive tools cabinet and get one out. I don't go into the shop and wander about until I find something that looks like it, then stand there pointing things going "THAT!" until someone figures out what I mean. And now I have a T50 Torx bit that I can stick on a ratchet with a long extension and get the passenger seat out of the Range Rover so I can retrieve my daughter's favourite necklace from where it's gotten entangled with the wiring to the gearbox and suspension ECUs in a place where I can see it with a dentist's mirror but can't actually get a grabber onto to fish it out, worse luck. So that's my afternoon sorted then. Because we're not just hacking on computers round here.
- relaxing 8mo ago
  On the other hand, if you went and browsed the visual interface, you might discover you could purchase a 1/2” drive to 1/4” hex adapter, thereby opening up the possibility of using the entire set of impact driver bits you already own.
  - ErroneousBosh 8mo ago
    That doesn't solve the problem I have, because I already have a 1/4" ratchet and I don't have a 1/4" T50 bit. Furthermore, a T50 bit with 1/4" drive would just snap instantly. If the bit didn't break, you'd twist the end off the extension bar. I have a specific problem, which I already know how to solve, which has a specific solution, for which I need a specific component.
    - relaxing 8mo ago
      Nonsense. They make T50 bits for regular impact drivers and they don’t immediately self-destruct. Anyway the point was about the discoverability factor of user interfaces.
      - ErroneousBosh 8mo ago
        So why would a 1/2" to 1/4" adaptor help, then? Consider that to crack the seat bolts free initially, I need to use a metre long breaker bar to get them moving, and I need to torque them down to something ridiculous on refitting.
jasonfrost 8mo ago
Like the past several decades of Linux problems, you find some stack overflow answer saying just run this command. Terminal is eternal, UI changes
al_borland 8mo ago
Getting people in the habit of running random commands they don’t understand in the terminal seems dangerous.

Myrmornis 8mo ago

Getting them to take screenshots with playwright/puppeteer and look at them as part of their development iteration cycle works well.

littlecranky67 8mo ago
For local inference, sure, but we simply lack the computing power to train them on all the images and html content that is available in the internet and books. That will happen sometime in the future, though.
- Myrmornis 8mo ago
  Ah right, sorry, you were making a much more interesting point than my reply! I read "UI development" and jumped to the conclusion that the point was just about inference-time modify-test cycles. Yes, agreed, if they trained on images, or even better (?) on (code, image) or (code-delta, image-delta) pairs, they would surely be better at UI development.

Jackson__ 8mo ago

Alternative take: Because no designers are getting paid to move "rm" to "fileops rm" or otherwise between releases.

ixsploit 8mo ago

The UI is also less stable then most cli tools. The enterprise tools I am currently working with often have outdated screenshots in their own documentation.

6LLvveMx2koXfwn 8mo ago

Yep and also their 'click paths' (<- love that by the way) are trained on READMEs which are often out of date.