This cannot possibly work because the page tables are not ran between L1 and L2, they are ran parallel to L1. While VIPT caches allow you to know the cache sets

This cannot possibly work because the page tables are not ran between L1 and L2, they are ran parallel to L1. While VIPT caches allow you to know the cache sets without page tables, they cannot choose from the right cache way. So, every way is loaded as the TLBs are accessed and at the end, the correct way is chosen based on the result of the TLB.