3 ms·

I think testing and code coverage is important, but over evaluated. 1 year ago I worked on a Java Project with over 2500 test cases and over 82% code coverage.

by reiz 15y ago

I think testing and code coverage is important, but over evaluated. 1 year ago I worked on a Java Project with over 2500 test cases and over 82% code coverage. The portal was still pretty buggy. 82% code coverage means nothing. To get such a high code coverage we tested really everything. We even wrote unit tests for DTOs, Entities and so on. To have a bunch of tests for simple getters and setters is pretty use less in my opinion :-) I agree with the part, that to write good tests is not easy. That is not a job for students or for bad payed employes with less experience/skills. In my current project I have much less tests. I am just testing the important parts. But that I am testing very carefully. And I have now much less bugs then in my old project.

jeffskj 15y ago
The only problem with not writing tests for getters/setters is that is makes it harder to identify actual code that is untested. If code coverage tools were smarter about not counting getters/setters towards the coverage number it wouldn't be a problem but if they aren't tested your coverage report might say you have 25% coverage in a package and you don't know that's because it has a bunch of DTOs in it or if its because there's bunch of actual untested logic in that package. The way we solved that problem on my team was to write a little utility that used reflection to automatically test the basic getter/setter pairs which made writing the tests for DTOs basically one line of code.
- astral303 15y ago
  Many coverage tools have ways to ignore getters/setters and things like "if (debug logging enabled) log" types of statements.
  - jeffskj 15y ago
    I'm not aware of any open source ones for Java that can do that, Atlassian Clover (not open source) might do it but I'm not sure on that. If you know of one I'd love to take a look at it.
    - reiz 15y ago
      I think the same. And I think getters and setters are useless! Just wasted lines of code. One more reason to switch to a dynamic language like Ruby or Python. The applications I saw in the last 14 months in the Ruby community are much more object oriented than the stuff I saw the last 10 years in the Java World. And because they are more object oriented their are much more easy to test. It is so easy to write test cases for a Ruby on Rails App, but it is a nightmare to do the same for JSF & EJB.
zanny 15y ago
I agree with this, that raw test coverage is a useless metric. The real value in tests is when you can specify interfaces that will rarely change, create a test suite for that interface that will rarely need to change, and use it to find any problems in the production code and any refactorings of that code done in the future, and that the test suite will verify correctness of the code no matter what changes. That is the true, sole, value of testing in my book. If having good RADs and UML acts as validation of models and endeavors, good testing verifies the code written to that spec.

by reiz 15y ago

jeffskj 15y ago

The only problem with not writing tests for getters/setters is that is makes it harder to identify actual code that is untested. If code coverage tools were smarter about not counting getters/setters towards the coverage number it wouldn't be a problem but if they aren't tested your coverage report might say you have 25% coverage in a package and you don't know that's because it has a bunch of DTOs in it or if its because there's bunch of actual untested logic in that package. The way we solved that problem on my team was to write a little utility that used reflection to automatically test the basic getter/setter pairs which made writing the tests for DTOs basically one line of code.

astral303 15y ago
Many coverage tools have ways to ignore getters/setters and things like "if (debug logging enabled) log" types of statements.
- jeffskj 15y ago
  I'm not aware of any open source ones for Java that can do that, Atlassian Clover (not open source) might do it but I'm not sure on that. If you know of one I'd love to take a look at it.
  - reiz 15y ago
    I think the same. And I think getters and setters are useless! Just wasted lines of code. One more reason to switch to a dynamic language like Ruby or Python. The applications I saw in the last 14 months in the Ruby community are much more object oriented than the stuff I saw the last 10 years in the Java World. And because they are more object oriented their are much more easy to test. It is so easy to write test cases for a Ruby on Rails App, but it is a nightmare to do the same for JSF & EJB.

zanny 15y ago

I agree with this, that raw test coverage is a useless metric. The real value in tests is when you can specify interfaces that will rarely change, create a test suite for that interface that will rarely need to change, and use it to find any problems in the production code and any refactorings of that code done in the future, and that the test suite will verify correctness of the code no matter what changes. That is the true, sole, value of testing in my book. If having good RADs and UML acts as validation of models and endeavors, good testing verifies the code written to that spec.