Test-Suite report (SonarQube?)

[chkpnt]

I'd like to have a browsable test report.... unfortunately, Travis-CI doesn't support suche a thing.

Maybe SonarQube could be used. I've experimented with the Junit-Callback to get the playbooks' outputs written in Junit XML files. Unfortunately, they can't directly be used by SonarQube:

• To get the "SurefireSensor" be executed, there must be at least one Java file in the repository
• The Junit reports have to be renamed: SurefireSensor expects that the filenames start with "TEST-".
• When the renamed reports are scanned, I see lots of warnings:

  00:10:04.531 INFO: Sensor SurefireSensor [java]
  00:10:04.533 INFO: parsing [/Users/ich/repos/chkpnt-mailserver/tests/build/repots]
  00:10:04.610 DEBUG: Class not found in resource cache : /Users/ich/repos/chkpnt-mailserver/tests/tests/incoming/SieveCanDeliverToFolderTest.yml:44
  00:10:04.611 DEBUG: Class not found in resource cache : SieveCanDeliverToFolderTest
  00:10:04.611 DEBUG: Resource not found: /Users/ich/repos/chkpnt-mailserver/tests/tests/incoming/SieveCanDeliverToFolderTest.yml:44
  00:10:04.611 DEBUG: Class not found in resource cache : /Users/ich/repos/chkpnt-mailserver/tests/tests/fetching/IMAPLoginWithCorrectCredentialsTest.yml:21
  00:10:04.611 DEBUG: Class not found in resource cache : IMAPLoginWithCorrectCredentialsTest
  00:10:04.611 DEBUG: Resource not found: /Users/ich/repos/chkpnt-mailserver/tests/tests/fetching/IMAPLoginWithCorrectCredentialsTest.yml:21
  00:10:04.611 DEBUG: Class not found in resource cache : /Users/ich/repos/chkpnt-mailserver/tests/tests/incoming/RejectBecauseOfSpamTest.yml:28
  

• There are still no tests in the dashboard:
  
  https://sonar.chkpnt.de/dashboard?id=chkpnt-mailserver

Instead of the Junit callback I could write and use a callback for the SonarQube's Generic Test Data.

Or something like junit2html or xunit-viewer.

[chkpnt]

Uh, just saw the following output in Travis-CI:

It's ways more readable than the current output on master. So instead of calling make -k tests, I should call each test separately, so the output will be folded by Travis-CI.