Easy. Set it up just like a honeypot. Except that instead of being a sticky honeypot, it's poisoned honey they get. OP mentioned the attack is easily identifie

Easy. Set it up just like a honeypot. Except that instead of being a sticky honeypot, it's poisoned honey they get. OP mentioned the attack is easily identified so legitimate traffic gets served correctly bad traffic gets "logged in" to the poisoned honeypot. 301 after login perhaps