I've seen researchers trying different statistical tests until they get a "significant" result. I was a bit shocked; it's essentially unobjective and dishonest

I've seen researchers trying different statistical tests until they get a "significant" result. I was a bit shocked; it's essentially unobjective and dishonest. The other one was removal of "obvious outliers" which is equally unobjective. It's part of the distribution of your data whether you like it or not. Add more replicates or do a better experiment, but don't manipulate the data and/or use inappropriate tests when the best one for your data gives you a P-value you don't like.