It should be comfortable with a lot more than a few connections per second. I've just benchmarked my Pi4 running Nginx on Raspbian from my laptop over wifi, run

It should be comfortable with a lot more than a few connections per second. I've just benchmarked my Pi4 running Nginx on Raspbian from my laptop over wifi, running Apachebench and obtained 322 requests per second with a 34kB html file (the HN homepage). Running ab on the Pi itself, the CPUs can deliver over 3k rps though of course the network subsystem is an important part of the story.