Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Make nTS loops configurable #45406

Merged
merged 1 commit into from
Jul 11, 2024

Conversation

kaderci-johannes
Copy link
Contributor

PR description:

Local and global runs in HF require different number of time slices (3 for global and 6 for local). The sizes in the definitions of the digi tables already contain the variables but the for loops that fill those tables has hardcoded numbers instead of variables. This is a fix to make the nTS modification from the configuration script to work properly. This change was originally done locally by Alexi Mestvirishvili.

PR validation:

I ran the script in https://gitlab.cern.ch/cmshcal/hcalpfg/hcalnanoprod/-/blob/main/test/globalrun_cfg.py with default inputs and the output file had 3 time slices for HF, as expected. I also ran the script in https://gitlab.cern.ch/cmshcal/hcalpfg/hcalnanoprod/-/blob/main/test/localrun_cfg.py the same way. I edited the line: process.hcalDigiSortedTable.nTS_HF = cms.untracked.uint32(x) with x=6, 8 and 12. The output files from these instances were created with 6, 8 and 12 time slices for HF, respectively.

@cmsbuild
Copy link
Contributor

cmsbuild commented Jul 8, 2024

cms-bot internal usage

@cmsbuild
Copy link
Contributor

cmsbuild commented Jul 8, 2024

@cmsbuild
Copy link
Contributor

cmsbuild commented Jul 8, 2024

A new Pull Request was created by @kaderci-johannes for master.

It involves the following packages:

  • DPGAnalysis/HcalNanoAOD (xpog)

@cmsbuild, @ftorrresd, @hqucms, @vlimant can you please review it and eventually sign? Thanks.
@mmusich this is something you requested to watch as well.
@antoniovilela, @rappoccio, @sextonkennedy you are the release manager for this.

cms-bot commands are listed here

@vlimant
Copy link
Contributor

vlimant commented Jul 9, 2024

enable nano

@vlimant
Copy link
Contributor

vlimant commented Jul 9, 2024

please test

@vlimant
Copy link
Contributor

vlimant commented Jul 9, 2024

@DryRun : can you please update your cmsDriver commands to use ...,NANO:@HCAL in your configurations (not related to this PR)

@cmsbuild
Copy link
Contributor

cmsbuild commented Jul 9, 2024

+1

Size: This PR adds an extra 16KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-442f98/40292/summary.html
COMMIT: cdf7cdc
CMSSW: CMSSW_14_1_X_2024-07-08-2300/el8_amd64_gcc12
Additional Tests: NANO
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/45406/40292/install.sh to create a dev area with all the needed externals and cmssw changes.

  • DAS Queries: The DAS query tests failed, see the summary page for details.

Comparison Summary

There are some workflows for which there are errors in the baseline:
29634.911 step 2
The results for the comparisons for these workflows could be incomplete
This means most likely that the IB is having errors in the relvals.The error does NOT come from this pull request

Summary:

  • You potentially removed 18 lines from the logs
  • ROOTFileChecks: Some differences in event products or their sizes found
  • Reco comparison results: 4 differences found in the comparisons
  • DQMHistoTests: Total files compared: 47
  • DQMHistoTests: Total histograms compared: 3246793
  • DQMHistoTests: Total failures: 3
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 3246770
  • DQMHistoTests: Total skipped: 20
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 46 files compared)
  • Checked 199 log files, 163 edm output root files, 47 DQM output files
  • TriggerResults: no differences found

NANO Comparison Summary

Summary:

  • You potentially removed 6 lines from the logs
  • Reco comparison results: 0 differences found in the comparisons
  • DQMHistoTests: Total files compared: 15
  • DQMHistoTests: Total histograms compared: 17023
  • DQMHistoTests: Total failures: 0
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 17023
  • DQMHistoTests: Total skipped: 0
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 14 files compared)
  • Checked 57 log files, 34 edm output root files, 15 DQM output files

Nano size comparison Summary:

Sample kb/ev ref kb/ev diff kb/ev ev/s/thd ref ev/s/thd diff rate mem/thd ref mem/thd
2500.0 2.783 2.783 0.000 ( +0.0% ) 3.26 3.31 -1.5% 6.025 6.016
2500.001 2.897 2.897 0.000 ( +0.0% ) 2.91 2.95 -1.3% 6.372 6.388
2500.002 2.843 2.843 0.000 ( +0.0% ) 3.04 3.08 -1.5% 6.348 6.328
2500.01 1.446 1.446 0.000 ( +0.0% ) 5.64 5.72 -1.4% 2.395 2.370
2500.011 1.906 1.906 0.000 ( +0.0% ) 3.10 3.12 -0.6% 2.569 2.538
2500.012 1.761 1.761 0.000 ( +0.0% ) 4.48 4.50 -0.3% 2.483 2.409
2500.1 2.353 2.353 0.000 ( +0.0% ) 4.15 4.21 -1.5% 5.959 5.947
2500.2 2.459 2.459 0.000 ( +0.0% ) 4.66 4.79 -2.5% 5.962 6.350
2500.21 1.285 1.285 0.000 ( +0.0% ) 3.04 3.08 -1.2% 2.296 2.282
2500.211 1.668 1.668 0.000 ( +0.0% ) 2.84 2.93 -3.0% 2.375 2.366
2500.3 2.229 2.229 0.000 ( +0.0% ) 8.45 8.77 -3.6% 6.083 6.509
2500.301 2.833 2.833 0.000 ( +0.0% ) 7.70 7.94 -3.0% 2.427 2.431
2500.31 7.164 7.164 0.000 ( +0.0% ) 1.45 1.52 -4.8% 1.706 1.707
2500.311 1.568 1.568 0.000 ( +0.0% ) 7.73 8.03 -3.8% 1.055 1.058
2500.312 540.338 540.338 0.000 ( +0.0% ) 0.52 0.53 -2.9% 1.661 1.676
2500.313 816.269 816.269 0.000 ( +0.0% ) 0.74 0.76 -3.2% 1.645 1.646
2500.32 1.348 1.348 0.000 ( +0.0% ) 10.00 10.44 -4.2% 2.377 2.376
2500.321 1.757 1.757 0.000 ( +0.0% ) 8.62 9.06 -4.9% 2.455 2.430
2500.322 1.236 1.236 0.000 ( +0.0% ) 8.54 8.80 -3.1% 2.281 2.072
2500.323 7.642 7.642 0.000 ( +0.0% ) 3.80 2.10 +80.7% 1.949 1.925
2500.324 1.874 1.874 0.000 ( +0.0% ) 8.69 9.05 -4.0% 2.368 2.289
2500.325 4.136 4.136 0.000 ( +0.0% ) 3.98 4.03 -1.2% 2.382 2.194
2500.326 3.342 3.342 0.000 ( +0.0% ) 1.44 1.48 -2.6% 2.319 2.084
2500.327 1.811 1.811 0.000 ( +0.0% ) 8.65 8.99 -3.8% 2.365 2.190
2500.328 3.364 3.364 0.000 ( +0.0% ) 1.33 1.36 -2.4% 2.046 2.128
2500.4 2.374 2.374 0.000 ( +0.0% ) 8.15 8.27 -1.4% 5.463 5.923
2500.401 1.891 1.891 0.000 ( +0.0% ) 7.56 7.75 -2.4% 2.346 2.201
2500.402 2.950 2.950 0.000 ( +0.0% ) 7.44 7.58 -1.8% 2.390 2.184
2500.403 8.700 8.700 0.000 ( +0.0% ) 2.71 2.73 -0.8% 2.301 2.229
2500.404 5.474 5.474 0.000 ( +0.0% ) 1.07 1.08 -1.2% 2.126 2.289
2500.405 2.860 2.860 0.000 ( +0.0% ) 7.44 7.67 -3.0% 2.377 2.210
2500.406 5.491 5.491 0.000 ( +0.0% ) 1.00 1.02 -1.3% 2.519 2.330
2500.5 5.194 5.194 0.000 ( +0.0% ) 15.85 16.03 -1.1% 1.526 1.484
2500.51 9.120 9.120 0.000 ( +0.0% ) 9.67 9.72 -0.5% 1.480 1.471

@vlimant
Copy link
Contributor

vlimant commented Jul 10, 2024

+1

@cmsbuild
Copy link
Contributor

This pull request is fully signed and it will be integrated in one of the next master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @rappoccio, @sextonkennedy, @antoniovilela (and backports should be raised in the release meeting by the corresponding L2)

@rappoccio
Copy link
Contributor

+1

@cmsbuild cmsbuild merged commit 61923d8 into cms-sw:master Jul 11, 2024
13 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants