If I don't quit vim, and do Ctrl+P, things got cached (which you force-refresh with F5) so it's instant. If I quit and restart vim, the Ctrl-P cache is invalid

If I don't quit vim, and do Ctrl+P, things got cached (which you force-refresh with F5) so it's instant. If I quit and restart vim, the Ctrl-P cache is invalidated thus it's scanning again, but it's down to 3~5s since disk reads got cached by the OS.