4 ms·

Could you cache the help doc after first full loaded run and only regenerate when new plugins are added / updated?

• simonw 1y ago
  It's not just help - the plugins need to be imported so the root level CLI tool knows what to do if you type "llm subcommand ..." where that subcommand is defined by a plugin.
  • Inufu 1y ago
    In that case the CLI only needs to import the plugin that defined that sub command, not all plugins?
    • simonw 1y ago
      It doesn't know which plugin defines a subcommand until it imports the plugin's module. I'm happy with the solution I have now, which is to encourage plugin authors not to import PyTorch or other heavy dependencies at the root level of their plugin code.
      • peterfirefly 1y ago
        > It doesn't know which plugin defines a subcommand until it imports the plugin's module. That might be considered a design mistake -- one that should be easy to migrate away from. You won't need to do anything, of course, if the lazy import becomes available on common Python installs some day in the future. That might take years, though.