Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Performance measurement starting at --beforeEachCommand instead of --testCommand #298

Open
dipak-amber opened this issue Jul 2, 2024 · 0 comments

Comments

@dipak-amber
Copy link

As per flashlight documantation

--testCommand Test command (e.g. maestro test flow.yml). App performance during execution of this script will be measured over several iterations.

When i am running tests using command

flashlight test
--bundleId com.something
--beforeAllCommand "maestro test file path to SetupFlow.yml"
--beforeEachCommand "maestro test file path to ScrollSearchPageBeforeEach.yml"
--testCommand "maestro test file path to ScrollSearchPage.yml"
--resultsFilePath file path to resulscroll.json
--iterationCount 2 \ --SkipRestart

Performance measuremant starts at --beforeEachCommand instead of --testCommand

full log of the command running

Running on QCVGA6BAN7F6UOZS

Running on QCVGA6BAN7F6UOZS

Flow
Launch app "com.amberstudent"...Run flow when "Allow amber to send you notifications?" is visible...

Run flow when "Allow amber to send you notifications?" is visible...

[14:48:56] ℹ️ Installing C++ profiler for arm64-v8a architecture
[14:48:57] ✅ C++ Profiler installed in /data/local/tmp/BAMPerfProfiler
[14:48:59] ℹ️ Running iteration 1/2
Running on QCVGA6BAN7F6UOZS

Running on QCVGA6BAN7F6UOZS

Flow

Launch app "com.amberstudent"...
COMPLETED

Tap on "Search by City, University or Property"...
COMPLETED

Tap on id: inventorySearchBarInput...
COMPLETED

Input text Dublin...
COMPLETED

Tap on id: searchResultsItem, Index: 0...
COMPLETED

Running on QCVGA6BAN7F6UOZS

Running on QCVGA6BAN7F6UOZS

Flow

Scrolling DOWN until "Lowest Price" is visible....
COMPLETED

[14:51:10] ✅ Finished iteration 1/2 in 62271.32183301449ms (0 retry so far)
[14:51:10] ℹ️ Running iteration 2/2
Running on QCVGA6BAN7F6UOZS

Running on QCVGA6BAN7F6UOZS

Flow

Launch app "com.amberstudent"...
COMPLETED

Tap on "Search by City, University or Property"...
COMPLETED

Tap on id: inventorySearchBarInput...
COMPLETED

Input text Dublin...
COMPLETED

Tap on id: searchResultsItem, Index: 0...
COMPLETED

Running on QCVGA6BAN7F6UOZS

[14:52:15] 🚨

Running on QCVGA6BAN7F6UOZS

Flow

Scrolling DOWN until "Lowest Price" is visible....
COMPLETED

[14:53:14] ✅ Finished iteration 2/2 in 60723.98116701841ms (0 retry so far)
[14:53:14] ✅ Results written to /users/dipakkorde/desktop/results/resulscroll.json.
To open the web report, run:

flashlight report /users/dipakkorde/desktop/results/resulscroll.json

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant