[14_0_X] Update to `relval_gpu.py`for Alpaka and Pixel Triplets Alpaka Workflows #45959

AdrianoDee · 2024-09-09T10:54:21Z

Backport of #45694 (with the exception of a comment that will anyway disappear soon) and #45963 (a fix) to 14_0_X.

This is useful because it allows to run 2024 Alpaka wfs in the PR testing, meaning we test also the Alpaka HLT.

Note: for Phase2, differently from master and 14_1_X we use D98 wfs here (since it was the baseline for 14_0_X).

- removing CUDA wfs - adding triplets - fixing Phase2 DQM GPUvsGPU (no raw)

cmsbuild · 2024-09-09T10:54:46Z

A new Pull Request was created by @AdrianoDee for CMSSW_14_0_X.

It involves the following packages:

Configuration/PyReleaseValidation (upgrade, pdmv)
DQM/SiPixelHeterogeneous (dqm)
RecoTracker/Configuration (reconstruction)

@AdrianoDee, @antoniovagnerini, @cmsbuild, @jfernan2, @kskovpen, @mandrenguyen, @miquork, @nothingface0, @rvenditti, @srimanob, @subirsarkar, @sunilUIET, @syuvivida, @tjavaid can you please review it and eventually sign? Thanks.
@GiacomoSguazzoni, @JanFSchulte, @Martin-Grunewald, @VinInn, @VourMa, @dgulhan, @fabiocos, @felicepantaleo, @fioriNTU, @gpetruc, @idebruyn, @jandrea, @makortel, @missirol, @mmusich, @mtosi, @rovere, @slomeo, @threus this is something you requested to watch as well.
@antoniovilela, @mandrenguyen, @rappoccio, @sextonkennedy you are the release manager for this.

cms-bot commands are listed here

Backported from Update to relval_gpu.pyfor Alpaka and Pixel Triplets Alpaka Workflows #45694

cmsbuild · 2024-09-09T10:54:47Z

cms-bot internal usage

AdrianoDee · 2024-09-09T10:57:18Z

test parameters:

workflows = 12834.406, 12834.402, 29834.402, 29634.406
workflows_gpu = 12834.406, 12834.402, 12834.403, 29834.402, 29634.406, 29834.403, 29634.496, 12834.496
relvals_opt = --what upgrade
relvals_opt_gpu = --what upgrade

AdrianoDee · 2024-09-09T10:57:23Z

enable gpu

AdrianoDee · 2024-09-09T10:57:28Z

please test

cmsbuild · 2024-09-09T13:29:36Z

-1

Failed Tests: RelVals RelVals-GPU
Size: This PR adds an extra 36KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-4a1d3c/41408/summary.html
COMMIT: b485a98
CMSSW: CMSSW_14_0_X_2024-09-09-1100/el8_amd64_gcc12
Additional Tests: GPU
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/45959/41408/install.sh to create a dev area with all the needed externals and cmssw changes.

RelVals

29834.402

----- Begin Fatal Exception 09-Sep-2024 14:23:18 CEST-----------------------
An exception of category 'NoSecondaryFiles' occurred while
   [0] Constructing the EventProcessor
   [1] Constructing module: class=MixingModule label='mix'
Exception Message:
RootEmbeddedFileSequence no input files specified for secondary input source.
----- End Fatal Exception -------------------------------------------------

29634.406A fatal system signal has occurred: abort signal

RelVals-GPU

29834.40229834.402_TTbar_14TeV+2026D110PU_Patatrack_PixelOnlyAlpaka/step2_TTbar_14TeV+2026D110PU_Patatrack_PixelOnlyAlpaka.log
29834.40329834.403_TTbar_14TeV+2026D110PU_Patatrack_PixelOnlyAlpaka_Validation/step2_TTbar_14TeV+2026D110PU_Patatrack_PixelOnlyAlpaka_Validation.log
29634.40629634.406_TTbar_14TeV+2026D110_Patatrack_PixelOnlyTripletsAlpaka/step3_TTbar_14TeV+2026D110_Patatrack_PixelOnlyTripletsAlpaka.log

Expand to see more relval errors ...

29634.496

cmsbuild · 2024-09-09T13:48:34Z

Pull request #45959 was updated. @AdrianoDee, @antoniovagnerini, @cmsbuild, @jfernan2, @kskovpen, @mandrenguyen, @miquork, @nothingface0, @rvenditti, @srimanob, @subirsarkar, @sunilUIET, @syuvivida, @tjavaid can you please check and sign again.

AdrianoDee · 2024-09-09T14:04:29Z

please test

…

cmsbuild · 2024-09-09T16:03:23Z

-1

Failed Tests: RelVals RelVals-GPU
Size: This PR adds an extra 16KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-4a1d3c/41413/summary.html
COMMIT: f647555
CMSSW: CMSSW_14_0_X_2024-09-09-1100/el8_amd64_gcc12
Additional Tests: GPU
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/45959/41413/install.sh to create a dev area with all the needed externals and cmssw changes.

RelVals

29834.402

----- Begin Fatal Exception 09-Sep-2024 17:40:51 CEST-----------------------
An exception of category 'NoSecondaryFiles' occurred while
   [0] Constructing the EventProcessor
   [1] Constructing module: class=MixingModule label='mix'
Exception Message:
RootEmbeddedFileSequence no input files specified for secondary input source.
----- End Fatal Exception -------------------------------------------------

29634.406A fatal system signal has occurred: abort signal

RelVals-GPU

29834.40229834.402_TTbar_14TeV+2026D110PU_Patatrack_PixelOnlyAlpaka/step2_TTbar_14TeV+2026D110PU_Patatrack_PixelOnlyAlpaka.log
29834.40329834.403_TTbar_14TeV+2026D110PU_Patatrack_PixelOnlyAlpaka_Validation/step2_TTbar_14TeV+2026D110PU_Patatrack_PixelOnlyAlpaka_Validation.log
29634.40629634.406_TTbar_14TeV+2026D110_Patatrack_PixelOnlyTripletsAlpaka/step3_TTbar_14TeV+2026D110_Patatrack_PixelOnlyTripletsAlpaka.log

Expand to see more relval errors ...

29634.496

AdrianoDee · 2024-09-10T08:36:34Z

test parameters:

workflows = 12834.406, 12834.402, 24834.402
workflows_gpu = 12834.406, 12834.402, 12834.403, 25034.402, 24834.402, 24834.403, 24834.406, 12834.496
relvals_opt = --what upgrade
relvals_opt_gpu = --what upgrade

AdrianoDee · 2024-09-10T08:36:36Z

please test

cmsbuild · 2024-09-10T11:38:24Z

-1

Failed Tests: RelVals-GPU
Size: This PR adds an extra 20KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-4a1d3c/41429/summary.html
COMMIT: 1a74c0f
CMSSW: CMSSW_14_0_X_2024-09-09-2300/el8_amd64_gcc12
Additional Tests: GPU
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/45959/41429/install.sh to create a dev area with all the needed externals and cmssw changes.

RelVals-GPU

Comparison Summary

Summary:

You potentially removed 85 lines from the logs
Reco comparison results: 52 differences found in the comparisons
DQMHistoTests: Total files compared: 49
DQMHistoTests: Total histograms compared: 3453156
DQMHistoTests: Total failures: 12
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 3453124
DQMHistoTests: Total skipped: 20
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 48 files compared)
Checked 206 log files, 170 edm output root files, 49 DQM output files
TriggerResults: no differences found

cmsbuild · 2024-09-10T11:57:24Z

Pull request #45959 was updated. @AdrianoDee, @antoniovagnerini, @cmsbuild, @jfernan2, @kskovpen, @mandrenguyen, @miquork, @nothingface0, @rvenditti, @srimanob, @subirsarkar, @sunilUIET, @syuvivida, @tjavaid can you please check and sign again.

AdrianoDee · 2024-09-10T11:57:25Z

please test

cmsbuild · 2024-09-10T15:03:52Z

+1

Size: This PR adds an extra 20KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-4a1d3c/41435/summary.html
COMMIT: ac5b488
CMSSW: CMSSW_14_0_X_2024-09-10-1100/el8_amd64_gcc12
Additional Tests: GPU
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/45959/41435/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

You potentially added 100 lines to the logs
Reco comparison results: 52 differences found in the comparisons
DQMHistoTests: Total files compared: 49
DQMHistoTests: Total histograms compared: 3453156
DQMHistoTests: Total failures: 6
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 3453130
DQMHistoTests: Total skipped: 20
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 48 files compared)
Checked 206 log files, 170 edm output root files, 49 DQM output files
TriggerResults: no differences found

GPU Comparison Summary

Summary:

No significant changes to the logs found
Reco comparison results: 0 differences found in the comparisons
DQMHistoTests: Total files compared: 1
DQMHistoTests: Total histograms compared: 0
DQMHistoTests: Total failures: 0
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 0
DQMHistoTests: Total skipped: 0
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0 KiB( 0 files compared)
Checked 0 log files, 0 edm output root files, 1 DQM output files

AdrianoDee · 2024-09-10T15:11:35Z

+pdmv

jfernan2 · 2024-09-10T16:16:12Z

+1

antoniovagnerini · 2024-09-11T15:30:56Z

backport of #45694

vicha-w · 2024-09-11T18:31:42Z

Hi @AdrianoDee,

This PR has been successfully tested on central DQM playback machines with CMSSW 14_0_15_patch1 and run 384377. For more details please have a look at DQM^2 mirror here: https://cmsweb.cern.ch/dqm/dqm-square/?run=518487&db=playback

Best regards,
Vichayanun

antoniovagnerini · 2024-09-12T09:06:13Z

+1

Move relval_gpu to 2024 Alpaka + add D110 wfs (140X)

b485a98

- removing CUDA wfs - adding triplets - fixing Phase2 DQM GPUvsGPU (no raw)

AdrianoDee marked this pull request as ready for review September 9, 2024 10:54

cmsbuild added this to the CMSSW_14_0_X milestone Sep 9, 2024

cmsbuild added reconstruction-pending dqm-pending pending-signatures tests-pending orp-pending pdmv-pending upgrade-pending tracking trk labels Sep 9, 2024

cmsbuild added tests-started and removed tests-pending labels Sep 9, 2024

cmsbuild added tests-rejected tests-pending and removed tests-started tests-rejected labels Sep 9, 2024

cmsbuild added tests-started and removed tests-pending labels Sep 9, 2024

cmsbuild removed the tests-started label Sep 9, 2024

cmsbuild added tests-started and removed tests-rejected labels Sep 10, 2024

cmsbuild added tests-rejected and removed tests-started labels Sep 10, 2024

Use D98 wfs + Fix Alpaka Harvesting for Phase2

ac5b488

AdrianoDee force-pushed the relval_gpu_alpaka_140X branch from 1a74c0f to ac5b488 Compare September 10, 2024 11:57

cmsbuild added tests-pending and removed tests-rejected labels Sep 10, 2024

cmsbuild added tests-started and removed tests-pending labels Sep 10, 2024

cmsbuild added tests-approved and removed tests-started labels Sep 10, 2024

cmsbuild added pdmv-approved and removed pdmv-pending labels Sep 10, 2024

cmsbuild added reconstruction-approved and removed reconstruction-pending labels Sep 10, 2024

cmsbuild added the backport-ok label Sep 11, 2024

cmsbuild added dqm-approved and removed dqm-pending labels Sep 12, 2024

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[14_0_X] Update to `relval_gpu.py`for Alpaka and Pixel Triplets Alpaka Workflows #45959

[14_0_X] Update to `relval_gpu.py`for Alpaka and Pixel Triplets Alpaka Workflows #45959

AdrianoDee commented Sep 9, 2024 •

edited

Loading

cmsbuild commented Sep 9, 2024 •

edited

Loading

cmsbuild commented Sep 9, 2024 •

edited

Loading

AdrianoDee commented Sep 9, 2024

AdrianoDee commented Sep 9, 2024

AdrianoDee commented Sep 9, 2024

cmsbuild commented Sep 9, 2024

cmsbuild commented Sep 9, 2024

AdrianoDee commented Sep 9, 2024 via email

cmsbuild commented Sep 9, 2024

AdrianoDee commented Sep 10, 2024

AdrianoDee commented Sep 10, 2024

cmsbuild commented Sep 10, 2024

cmsbuild commented Sep 10, 2024

AdrianoDee commented Sep 10, 2024

cmsbuild commented Sep 10, 2024

AdrianoDee commented Sep 10, 2024

jfernan2 commented Sep 10, 2024

antoniovagnerini commented Sep 11, 2024

vicha-w commented Sep 11, 2024

antoniovagnerini commented Sep 12, 2024

[14_0_X] Update to relval_gpu.pyfor Alpaka and Pixel Triplets Alpaka Workflows #45959

Are you sure you want to change the base?

[14_0_X] Update to relval_gpu.pyfor Alpaka and Pixel Triplets Alpaka Workflows #45959

Conversation

AdrianoDee commented Sep 9, 2024 • edited Loading

cmsbuild commented Sep 9, 2024 • edited Loading

cmsbuild commented Sep 9, 2024 • edited Loading

AdrianoDee commented Sep 9, 2024

AdrianoDee commented Sep 9, 2024

AdrianoDee commented Sep 9, 2024

cmsbuild commented Sep 9, 2024

RelVals

RelVals-GPU

cmsbuild commented Sep 9, 2024

AdrianoDee commented Sep 9, 2024 via email

cmsbuild commented Sep 9, 2024

RelVals

RelVals-GPU

AdrianoDee commented Sep 10, 2024

AdrianoDee commented Sep 10, 2024

cmsbuild commented Sep 10, 2024

RelVals-GPU

Comparison Summary

cmsbuild commented Sep 10, 2024

AdrianoDee commented Sep 10, 2024

cmsbuild commented Sep 10, 2024

Comparison Summary

GPU Comparison Summary

AdrianoDee commented Sep 10, 2024

jfernan2 commented Sep 10, 2024

antoniovagnerini commented Sep 11, 2024

vicha-w commented Sep 11, 2024

antoniovagnerini commented Sep 12, 2024

[14_0_X] Update to `relval_gpu.py`for Alpaka and Pixel Triplets Alpaka Workflows #45959

[14_0_X] Update to `relval_gpu.py`for Alpaka and Pixel Triplets Alpaka Workflows #45959

AdrianoDee commented Sep 9, 2024 •

edited

Loading

cmsbuild commented Sep 9, 2024 •

edited

Loading

cmsbuild commented Sep 9, 2024 •

edited

Loading