3 ms·

I'm working in this area right now if you want to help :) http://www.oilshell.org/ http://www.oilshell.org/ I took a survey of what people use here: https://l

by chubot 8y ago

I'm working in this area right now if you want to help :) http://www.oilshell.org/ http://www.oilshell.org/ I took a survey of what people use here: https://lobste.rs/s/z96uyr/survey_what_shell_completion_scripts_do https://lobste.rs/s/z96uyr/survey_what_shell_completion_scri... That produced a link to this old project which tried to do something like what you want: a completion system that works for multiple shells (in this case, by code generation from a DSL) https://github.com/mbrubeck/compleat https://github.com/mbrubeck/compleat It's easy for you to say "completion should be specified in the binary" without actually specifying HOW. That's not straightforward, although I agree it's a good goal. ----- Right now I'm implementing a bash-compatible completion API, and I'm actually getting pretty far without too much code. git-completion.bash is 3000 lines of code, so it's actually easier to emulate bash (with all its warts) than to write an entirely new completion system AND THEN write 3000+ lines of git completion in that hypothetical system. https://github.com/oilshell/oil/issues/175 https://github.com/oilshell/oil/issues/175 FWIW git is also the biggest completion script in the zsh source tree by a factor of 2 -- ~7000 lines IIRC with the next largest being around ~3000 lines. Eventually Oil should have something better than bash completion, but the first step is taking advantage of ~40K lines of existing code in the bash-completion [1] project. I also looked at emulating zsh but that would be a lot more work than emulating bash. [1] https://github.com/scop/bash-completion https://github.com/scop/bash-completion

daveFNbuck 8y ago
Are you building something to support multiple shells, or just yours?
- chubot 8y ago
  Well, since I'm emulating bash to start, those completion scripts will support multiple shells :) However, I recently learned that zsh also emulates bash, e.g. the complete/compgen/compopt builtins, along with some global variables. So that is already technically true. Still, I'd like to define some kind of "nicer" protocol that binaries can implement to get completion. But that also sort of exists: I learned that when you do "ls --<TAB>" in bash right now, the script actually dynamically greps "ls --help" for flags! This is in contrast to how ZSH works -- it has a bunch of canned completions, which presumably suffer from a version skew problem. Someone out pointed out "npm completion" in this thread, which is new to me (try it; it prints a bash script). git is also adding 'git --listcmds' to help with completion. So the logic is partially in the binary, and partially in the shell completion script. I think I've seen other ad hoc mechanisms along those lines too. Ah yes I recall that there was XML output for the Google flag parser [1], which is meant to be used for completion, although I'm not sure how commonly it's used. So basically there are a lot of different systems. Hoping that someone will come along and produce a universal solution is probably wishful thinking. It's another "boiling the ocean" problem. [1] https://github.com/gflags/gflags https://github.com/gflags/gflags
  - daveFNbuck 8y ago
    I'd like to contribute to a project that would help me be able to write a CLI tool and have tab completions work across shells. The problem is that I don't have a good enough understanding of how tab completion currently works to even know where to start. Is it fair to say that you're having the same problem?
    - chubot 8y ago
      Yes I think that is a good problem to solve. I'm working in this area right now, although I wouldn't say cross-shell compatibility the specific problem I'm solving now. I think what would be nice is to collect examples like 'git --listcmds' and 'npm completion' (previously mentioned), i.e. places where the binary itself helps out with completion. In those cases, more of the logic is shell-independent. It's not 100% and will never be, but it's nice to share as much as possible. Also, it would nice to see other ways that commands support multiple shells. For example, git has both bash and zsh completion in its tree. Though I'm pretty sure the zsh developers wrote their own completion that is much richer than the bash-like one in upstream. I believe the problem is that "completion" in zsh has a higher standard. You can make a lowest-common-denominator solution already. I think that is OK for now, but zsh users might disagree. I think the other popular interactive shell is fish (based on my survey), so I'd be interested in learning more about it. However I wouldn't underestimate the fact that probably 90% of people use bash. Feel free to e-mail me if you want to talk about it more (address in profile), or you can chat with me here: https://oilshell.zulipchat.com/ https://oilshell.zulipchat.com/

by chubot 8y ago

daveFNbuck 8y ago

Are you building something to support multiple shells, or just yours?

chubot 8y ago
Well, since I'm emulating bash to start, those completion scripts will support multiple shells :) However, I recently learned that zsh also emulates bash, e.g. the complete/compgen/compopt builtins, along with some global variables. So that is already technically true. Still, I'd like to define some kind of "nicer" protocol that binaries can implement to get completion. But that also sort of exists: I learned that when you do "ls --<TAB>" in bash right now, the script actually dynamically greps "ls --help" for flags! This is in contrast to how ZSH works -- it has a bunch of canned completions, which presumably suffer from a version skew problem. Someone out pointed out "npm completion" in this thread, which is new to me (try it; it prints a bash script). git is also adding 'git --listcmds' to help with completion. So the logic is partially in the binary, and partially in the shell completion script. I think I've seen other ad hoc mechanisms along those lines too. Ah yes I recall that there was XML output for the Google flag parser [1], which is meant to be used for completion, although I'm not sure how commonly it's used. So basically there are a lot of different systems. Hoping that someone will come along and produce a universal solution is probably wishful thinking. It's another "boiling the ocean" problem. [1] https://github.com/gflags/gflags https://github.com/gflags/gflags
- daveFNbuck 8y ago
  I'd like to contribute to a project that would help me be able to write a CLI tool and have tab completions work across shells. The problem is that I don't have a good enough understanding of how tab completion currently works to even know where to start. Is it fair to say that you're having the same problem?
  - chubot 8y ago
    Yes I think that is a good problem to solve. I'm working in this area right now, although I wouldn't say cross-shell compatibility the specific problem I'm solving now. I think what would be nice is to collect examples like 'git --listcmds' and 'npm completion' (previously mentioned), i.e. places where the binary itself helps out with completion. In those cases, more of the logic is shell-independent. It's not 100% and will never be, but it's nice to share as much as possible. Also, it would nice to see other ways that commands support multiple shells. For example, git has both bash and zsh completion in its tree. Though I'm pretty sure the zsh developers wrote their own completion that is much richer than the bash-like one in upstream. I believe the problem is that "completion" in zsh has a higher standard. You can make a lowest-common-denominator solution already. I think that is OK for now, but zsh users might disagree. I think the other popular interactive shell is fish (based on my survey), so I'd be interested in learning more about it. However I wouldn't underestimate the fact that probably 90% of people use bash. Feel free to e-mail me if you want to talk about it more (address in profile), or you can chat with me here: https://oilshell.zulipchat.com/ https://oilshell.zulipchat.com/