One of the downsides is your job can be easily outsourced to a country with lower wages, and with remote work here to stay (IMO), that is going to be even easie

One of the downsides is your job can be easily outsourced to a country with lower wages, and with remote work here to stay (IMO), that is going to be even easier than before Only if PII isn't an issue. Which it still is for a large number of remote jobs. You have to do the work inside US borders because of liability or security issues for an incredibly large number of remote roles. If you don't believe me, just roll over to weworkremotely.com or any of the other remote job boards and check out how many current openings specify "USA only."