But then technically you’d need to add additional punctuation to actually end the outer sentence, “like this!”. I have a firm preference of putting punctuation

But then technically you’d need to add additional punctuation to actually end the outer sentence, “like this!”. I have a firm preference of putting punctuation that does not belong to the quote itself outside of it, and when I want to add punctuation that does belong to the quote inside, I usually work around the problem above by just putting the quote after a colon: “like this!”