The last thing that scratched this itch for me was Dredd https://github.com/apiaryio/dredd https://github.com/apiaryio/dredd . But writing tests in markdown is

The last thing that scratched this itch for me was Dredd https://github.com/apiaryio/dredd https://github.com/apiaryio/dredd . But writing tests in markdown is not for everyone. Here are few examples of what "test files" look like https://github.com/apiaryio/api-blueprint/tree/master/examples https://github.com/apiaryio/api-blueprint/tree/master/exampl... I didn't use in for two years so I can't say how well it works today (it doesn't appear to be actively maintained).