Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Test using reframe on RLP Gitlab #543

Open
wants to merge 4 commits into
base: main
Choose a base branch
from
Open

Test using reframe on RLP Gitlab #543

wants to merge 4 commits into from

Conversation

vchuravy
Copy link
Member

  • write a first reframe test
  • Create a gitlab ci yml

Copy link
Contributor

github-actions bot commented Oct 24, 2024

Benchmark Results

main 447e57d... main/447e57da1eff80...
saxpy/default/Float16/1024 0.545 ± 0.0059 μs 0.537 ± 0.0046 μs 1.01
saxpy/default/Float16/1048576 0.172 ± 0.0073 ms 0.175 ± 0.0081 ms 0.987
saxpy/default/Float16/16384 3.14 ± 0.055 μs 3.12 ± 0.039 μs 1
saxpy/default/Float16/2048 0.731 ± 0.0076 μs 0.713 ± 0.0073 μs 1.03
saxpy/default/Float16/256 0.415 ± 0.0038 μs 0.416 ± 0.0039 μs 0.998
saxpy/default/Float16/262144 0.0441 ± 0.0025 ms 0.0437 ± 0.00067 ms 1.01
saxpy/default/Float16/32768 5.84 ± 0.11 μs 5.79 ± 0.044 μs 1.01
saxpy/default/Float16/4096 1.1 ± 0.016 μs 1.09 ± 0.025 μs 1.01
saxpy/default/Float16/512 0.463 ± 0.0043 μs 0.459 ± 0.0048 μs 1.01
saxpy/default/Float16/64 0.387 ± 0.0041 μs 0.385 ± 0.0035 μs 1
saxpy/default/Float16/65536 11.5 ± 0.23 μs 11.4 ± 0.18 μs 1.01
saxpy/default/Float32/1024 0.441 ± 0.0064 μs 0.427 ± 0.0053 μs 1.03
saxpy/default/Float32/1048576 0.193 ± 0.04 ms 0.195 ± 0.036 ms 0.992
saxpy/default/Float32/16384 2.71 ± 0.93 μs 2.54 ± 0.17 μs 1.07
saxpy/default/Float32/2048 0.533 ± 0.011 μs 0.525 ± 0.012 μs 1.01
saxpy/default/Float32/256 0.379 ± 0.0071 μs 0.383 ± 0.0041 μs 0.992
saxpy/default/Float32/262144 0.0444 ± 0.0034 ms 0.0449 ± 0.0038 ms 0.99
saxpy/default/Float32/32768 5.32 ± 1.5 μs 4.99 ± 0.33 μs 1.07
saxpy/default/Float32/4096 0.91 ± 0.014 μs 0.914 ± 0.047 μs 0.996
saxpy/default/Float32/512 0.398 ± 0.0044 μs 0.398 ± 0.004 μs 1
saxpy/default/Float32/64 0.367 ± 0.0047 μs 0.375 ± 0.0057 μs 0.976
saxpy/default/Float32/65536 12.2 ± 1.7 μs 11.7 ± 1.2 μs 1.05
saxpy/default/Float64/1024 0.545 ± 0.01 μs 0.548 ± 0.013 μs 0.994
saxpy/default/Float64/1048576 0.473 ± 0.069 ms 0.486 ± 0.053 ms 0.973
saxpy/default/Float64/16384 5.58 ± 1.7 μs 5.06 ± 0.51 μs 1.1
saxpy/default/Float64/2048 0.921 ± 0.02 μs 0.925 ± 0.034 μs 0.996
saxpy/default/Float64/256 0.41 ± 0.0056 μs 0.4 ± 0.0044 μs 1.02
saxpy/default/Float64/262144 0.0891 ± 0.0095 ms 0.0954 ± 0.011 ms 0.934
saxpy/default/Float64/32768 12.8 ± 2 μs 12.2 ± 1.7 μs 1.05
saxpy/default/Float64/4096 1.7 ± 0.29 μs 1.49 ± 0.21 μs 1.14
saxpy/default/Float64/512 0.443 ± 0.0056 μs 0.438 ± 0.0067 μs 1.01
saxpy/default/Float64/64 0.385 ± 0.0047 μs 0.386 ± 0.0044 μs 0.997
saxpy/default/Float64/65536 23.9 ± 4.5 μs 23.8 ± 3.7 μs 1
saxpy/static workgroup=(1024,)/Float16/1024 1.92 ± 0.03 μs 1.9 ± 0.023 μs 1.01
saxpy/static workgroup=(1024,)/Float16/1048576 0.156 ± 0.0055 ms 0.158 ± 0.014 ms 0.988
saxpy/static workgroup=(1024,)/Float16/16384 4.13 ± 0.12 μs 4.21 ± 0.13 μs 0.982
saxpy/static workgroup=(1024,)/Float16/2048 2.07 ± 0.034 μs 2.1 ± 0.057 μs 0.985
saxpy/static workgroup=(1024,)/Float16/256 2.57 ± 0.023 μs 2.58 ± 0.033 μs 0.996
saxpy/static workgroup=(1024,)/Float16/262144 0.0414 ± 0.0025 ms 0.0414 ± 0.005 ms 1
saxpy/static workgroup=(1024,)/Float16/32768 6.52 ± 0.24 μs 6.67 ± 0.27 μs 0.977
saxpy/static workgroup=(1024,)/Float16/4096 2.4 ± 0.028 μs 2.42 ± 0.035 μs 0.991
saxpy/static workgroup=(1024,)/Float16/512 3 ± 0.068 μs 3.02 ± 0.049 μs 0.993
saxpy/static workgroup=(1024,)/Float16/64 2.26 ± 0.034 μs 2.27 ± 0.043 μs 0.996
saxpy/static workgroup=(1024,)/Float16/65536 12.1 ± 0.53 μs 12.2 ± 0.63 μs 0.994
saxpy/static workgroup=(1024,)/Float32/1024 1.93 ± 0.026 μs 1.94 ± 0.029 μs 0.996
saxpy/static workgroup=(1024,)/Float32/1048576 0.197 ± 0.036 ms 0.198 ± 0.032 ms 0.993
saxpy/static workgroup=(1024,)/Float32/16384 4.04 ± 0.25 μs 4.12 ± 0.19 μs 0.981
saxpy/static workgroup=(1024,)/Float32/2048 2.08 ± 0.04 μs 2.09 ± 0.028 μs 0.996
saxpy/static workgroup=(1024,)/Float32/256 2.4 ± 0.034 μs 2.44 ± 0.041 μs 0.986
saxpy/static workgroup=(1024,)/Float32/262144 0.0476 ± 0.0039 ms 0.0476 ± 0.004 ms 1
saxpy/static workgroup=(1024,)/Float32/32768 6.96 ± 0.39 μs 7.15 ± 0.46 μs 0.973
saxpy/static workgroup=(1024,)/Float32/4096 2.36 ± 0.034 μs 2.37 ± 0.058 μs 0.997
saxpy/static workgroup=(1024,)/Float32/512 2.42 ± 0.051 μs 2.45 ± 0.089 μs 0.988
saxpy/static workgroup=(1024,)/Float32/64 2.61 ± 7.2 μs 2.65 ± 8.2 μs 0.986
saxpy/static workgroup=(1024,)/Float32/65536 14.4 ± 1.7 μs 14 ± 1.1 μs 1.03
saxpy/static workgroup=(1024,)/Float64/1024 2.06 ± 0.028 μs 2.04 ± 0.03 μs 1.01
saxpy/static workgroup=(1024,)/Float64/1048576 0.497 ± 0.094 ms 0.498 ± 0.092 ms 0.998
saxpy/static workgroup=(1024,)/Float64/16384 6.9 ± 0.52 μs 7.04 ± 0.46 μs 0.98
saxpy/static workgroup=(1024,)/Float64/2048 2.33 ± 0.065 μs 2.32 ± 0.047 μs 1
saxpy/static workgroup=(1024,)/Float64/256 2.41 ± 0.058 μs 2.43 ± 0.075 μs 0.992
saxpy/static workgroup=(1024,)/Float64/262144 0.0964 ± 0.0089 ms 0.0976 ± 0.013 ms 0.987
saxpy/static workgroup=(1024,)/Float64/32768 14.5 ± 2.1 μs 15.2 ± 2.3 μs 0.951
saxpy/static workgroup=(1024,)/Float64/4096 2.87 ± 0.18 μs 2.91 ± 0.23 μs 0.986
saxpy/static workgroup=(1024,)/Float64/512 2.4 ± 0.057 μs 2.39 ± 0.063 μs 1
saxpy/static workgroup=(1024,)/Float64/64 2.39 ± 10 μs 2.37 ± 1.8 μs 1.01
saxpy/static workgroup=(1024,)/Float64/65536 26.2 ± 2.3 μs 26.5 ± 4.7 μs 0.988
time_to_load 0.723 ± 0.04 s 0.748 ± 0.081 s 0.966

Benchmark Plots

A plot of the benchmark results have been uploaded as an artifact to the workflow run for this PR.
Go to "Actions"->"Benchmark a pull request"->[the most recent run]->"Artifacts" (at the bottom).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant