Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Number of ran tests and seconds in "Totals" aren't matched each other when stestr run --until-failure #126

Open
masayukig opened this issue Nov 7, 2017 · 2 comments

Comments

@masayukig
Copy link
Collaborator

I noticed that the number of ran tests and seconds aren't matched each other.

The number of tests shows the sum of execution number of runs tests, but the seconds shows the only for one time execution. Belows are the example.

Ran: 110 tests in 5.4677 sec.
   :
Ran: 111 tests in 5.2347 sec.
$ stestr run --until-failure ......
:
======
Totals
======
Ran: 110 tests in 5.4677 sec.
 - Passed: 110
 - Skipped: 0
 - Expected Fail: 0
 - Unexpected Success: 0
 - Failed: 0
Sum of execute time for each test: 169.2701 sec.

==============
Worker Balance
==============
 - Worker 0 (110 tests) => 0:09:18.657611
{0} cinder.tests.unit.api.contrib.test_volume_type_encryption.VolumeTypeEncryptionTest.test_delete_with_volume_in_use [1.716951s] ... ok

======
Totals
======
Ran: 111 tests in 5.2347 sec.
 - Passed: 111
 - Skipped: 0
 - Expected Fail: 0
 - Unexpected Success: 0
 - Failed: 0
Sum of execute time for each test: 170.9871 sec.
:

Is this related to #119?

@masayukig masayukig changed the title Number of ran tests and seconds in "Totals" aren't matched each other when stestr run --until-failure Number of ran tests and seconds in "Totals" aren't matched each other when stestr run --until-failure Nov 7, 2017
@mtreinish
Copy link
Owner

Sort of, this is basically caused by the same thing that's causing #119. The elapsed time value is generated by doing a time delta by checking the time before and after the tests are executed. Depending on how we fix #119 we'll fix this too.

@masayukig
Copy link
Collaborator Author

masayukig commented Nov 8, 2017

OK, thanks, maybe, I'll dig it later.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants