3 ms·

Hmmm so I should get rid of the asking / permissions message?

by danielhanchen 1y ago

mkl 1y ago
Yes, since you won't actually need the permissions.
- danielhanchen 1y ago
  Hmmm I'm worried people will really not get on how to install / compile / use the terminal hmmm hence I thought permissions were like a compromise solution
  - segmondy 1y ago
    Don't listen to this crowd, these are "technical folks". Most of your audience will fail to figure it out. You can provide an option that llama.cpp is missing and give them an option where you auto install it or they can install it themselves and do manual configuration. I personally won't tho.
    - danielhanchen 1y ago
      I think for a compromise solution I'll allow the permission asking to install. I'll definitely try investigating pre built binaries though
    - Computer0 1y ago
      Who do you think the audience is here if not technical. We are in a discussion about a model that requires over 250gb of ram to run. I don't know a non-technical person with more than 32gb.
      - pxc 1y ago
        I think most of the people like this in the ML world are extreme specialists (e.g.: bioinformaticians, statisticians, linguists, data scientists) who are "technical" in some ways but aren't really "computer people". They're power users in a sense but they're also prone to strange bouts of computing insanity and/or helplessness.
  - solarkraft 1y ago
    I think that it is, quite a good one, even: - Determine the command that has to be run by the algorithm above. This does most of the work a user would have to figure out what has to be installed on their system. - Ask whether to run the command automatically. This allows the “software should never install dependencies by itself” crowd to say no and figure out further steps, while allowing people who just want it to work to get on with their task as quickly as possible (who do you think there are more of?). I think it would be fine to print out the command and force the user to run it themselves, but it would bring little material gain at the cost of some of your users’ peace (“oh no it failed, what is it this time ...”).
    - danielhanchen 1y ago
      Oh ok! I would say 50% of people manually install llama.cpp and the other 50% want it to be automated

Hmmm so I should get rid of the asking / permissions message?

mkl 1y ago

Yes, since you won't actually need the permissions.

danielhanchen 1y ago
Hmmm I'm worried people will really not get on how to install / compile / use the terminal hmmm hence I thought permissions were like a compromise solution
- segmondy 1y ago
  Don't listen to this crowd, these are "technical folks". Most of your audience will fail to figure it out. You can provide an option that llama.cpp is missing and give them an option where you auto install it or they can install it themselves and do manual configuration. I personally won't tho.
  - danielhanchen 1y ago
    I think for a compromise solution I'll allow the permission asking to install. I'll definitely try investigating pre built binaries though
  - Computer0 1y ago
    Who do you think the audience is here if not technical. We are in a discussion about a model that requires over 250gb of ram to run. I don't know a non-technical person with more than 32gb.
    - pxc 1y ago
      I think most of the people like this in the ML world are extreme specialists (e.g.: bioinformaticians, statisticians, linguists, data scientists) who are "technical" in some ways but aren't really "computer people". They're power users in a sense but they're also prone to strange bouts of computing insanity and/or helplessness.
- solarkraft 1y ago
  I think that it is, quite a good one, even: - Determine the command that has to be run by the algorithm above. This does most of the work a user would have to figure out what has to be installed on their system. - Ask whether to run the command automatically. This allows the “software should never install dependencies by itself” crowd to say no and figure out further steps, while allowing people who just want it to work to get on with their task as quickly as possible (who do you think there are more of?). I think it would be fine to print out the command and force the user to run it themselves, but it would bring little material gain at the cost of some of your users’ peace (“oh no it failed, what is it this time ...”).
  - danielhanchen 1y ago
    Oh ok! I would say 50% of people manually install llama.cpp and the other 50% want it to be automated