Tokenization and stop word skipping is something that in most cases needs adjustments. These adjustments are too complex to be config settings - they need to be

Tokenization and stop word skipping is something that in most cases needs adjustments. These adjustments are too complex to be config settings - they need to be in code. The solution could be default implementations that you could replace by Dependency Injection or Inheritance with Overriding. Unfortunately DI is not yet popular enough.