5 ms·Sounds fast. Does it respect `robots.txt`? My web services are not written in Rust, Zig, or Go. :)by aorth 11mo agoSounds fast. Does it respect `robots.txt`? My web services are not written in Rust, Zig, or Go. :)