If someone from the future read this, I needed to add one more line to make it work: autoload -U edit-command-line zle -N edit-command-line bindkey -M vicmd

If someone from the future read this, I needed to add one more line to make it work: autoload -U edit-command-line zle -N edit-command-line bindkey -M vicmd v edit-command-line