[14_1_X] Update to `relval_gpu.py`for Alpaka and Pixel Triplets Alpaka Workflows #45958

AdrianoDee · 2024-09-09T10:53:02Z

Backport of #45694 (with the exception of a comment that will anyway disappear soon) and #45963 (a fix) to 14_1_X.

This is useful because it allows to run 2024 Alpaka wfs in the PR testing, meaning we test also the Alpaka HLT.

- removing CUDA wfs - adding triplets - fixing Phase2 DQM GPUvsGPU (no raw)

cmsbuild · 2024-09-09T10:53:26Z

A new Pull Request was created by @AdrianoDee for CMSSW_14_1_X.

It involves the following packages:

Configuration/PyReleaseValidation (upgrade, pdmv)
DQM/SiPixelHeterogeneous (dqm)
RecoTracker/Configuration (reconstruction)

@AdrianoDee, @antoniovagnerini, @cmsbuild, @jfernan2, @kskovpen, @mandrenguyen, @miquork, @nothingface0, @rvenditti, @srimanob, @subirsarkar, @sunilUIET, @syuvivida, @tjavaid can you please review it and eventually sign? Thanks.
@GiacomoSguazzoni, @JanFSchulte, @Martin-Grunewald, @VinInn, @VourMa, @dgulhan, @fabiocos, @felicepantaleo, @fioriNTU, @gpetruc, @idebruyn, @jandrea, @makortel, @missirol, @mmusich, @mtosi, @rovere, @slomeo, @threus this is something you requested to watch as well.
@antoniovilela, @mandrenguyen, @rappoccio, @sextonkennedy you are the release manager for this.

cms-bot commands are listed here

cmsbuild · 2024-09-09T10:53:26Z

cms-bot internal usage

AdrianoDee · 2024-09-09T10:55:26Z

enable gpu

AdrianoDee · 2024-09-09T10:57:02Z

test parameters:

workflows = 12834.406, 12834.402, 29834.402, 29634.406
workflows_gpu = 12834.406, 12834.402, 12834.403, 29834.402, 29634.406, 29834.403, 29634.496, 12834.496
relvals_opt = --what upgrade
relvals_opt_gpu = --what upgrade

AdrianoDee · 2024-09-09T10:57:07Z

please test

cmsbuild · 2024-09-09T15:11:55Z

-1

Failed Tests: RelVals-GPU
Size: This PR adds an extra 32KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-a0c426/41407/summary.html
COMMIT: bcb80e4
CMSSW: CMSSW_14_1_X_2024-09-09-1100/el8_amd64_gcc12
Additional Tests: GPU
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/45958/41407/install.sh to create a dev area with all the needed externals and cmssw changes.

RelVals-GPU

29834.40329834.403_TTbar_14TeV+2026D110PU_Patatrack_PixelOnlyAlpaka_Validation/step4_TTbar_14TeV+2026D110PU_Patatrack_PixelOnlyAlpaka_Validation.log

Comparison Summary

Summary:

You potentially removed 1 lines from the logs
Reco comparison results: 7 differences found in the comparisons
DQMHistoTests: Total files compared: 45
DQMHistoTests: Total histograms compared: 3434917
DQMHistoTests: Total failures: 9
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 3434888
DQMHistoTests: Total skipped: 20
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 44 files compared)
Checked 195 log files, 166 edm output root files, 45 DQM output files
TriggerResults: no differences found

AdrianoDee · 2024-09-09T16:17:47Z

please test

AdrianoDee · 2024-09-09T16:18:17Z

please abort

cmsbuild · 2024-09-09T16:18:26Z

Pull request #45958 was updated. @AdrianoDee, @antoniovagnerini, @cmsbuild, @jfernan2, @kskovpen, @mandrenguyen, @miquork, @nothingface0, @rvenditti, @srimanob, @subirsarkar, @sunilUIET, @syuvivida, @tjavaid can you please check and sign again.

AdrianoDee · 2024-09-09T16:18:30Z

please test

cmsbuild · 2024-09-09T20:56:31Z

+1

Size: This PR adds an extra 16KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-a0c426/41418/summary.html
COMMIT: 01c3101
CMSSW: CMSSW_14_1_X_2024-09-09-1100/el8_amd64_gcc12
Additional Tests: GPU
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/45958/41418/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

No significant changes to the logs found
Reco comparison results: 78 differences found in the comparisons
DQMHistoTests: Total files compared: 45
DQMHistoTests: Total histograms compared: 3434917
DQMHistoTests: Total failures: 4598
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 3430299
DQMHistoTests: Total skipped: 20
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 44 files compared)
Checked 195 log files, 166 edm output root files, 45 DQM output files
TriggerResults: no differences found

GPU Comparison Summary

Summary:

No significant changes to the logs found
Reco comparison results: 0 differences found in the comparisons
DQMHistoTests: Total files compared: 1
DQMHistoTests: Total histograms compared: 0
DQMHistoTests: Total failures: 0
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 0
DQMHistoTests: Total skipped: 0
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0 KiB( 0 files compared)
Checked 0 log files, 0 edm output root files, 1 DQM output files

jfernan2 · 2024-09-10T08:05:23Z

+1

AdrianoDee · 2024-09-10T08:50:41Z

+pdmv

AdrianoDee · 2024-09-10T08:51:04Z

Note to @cms-sw/dqm-l2: the fix in #45963 should go in first. Thanks.

antoniovagnerini · 2024-09-12T10:28:46Z

+1

spurious differences seen from unstable WF 12834.7 (open issue spurious differences in outputs of Run-3 wfs *.7 #39803 )

mmusich · 2024-09-16T17:25:41Z

@cms-sw/upgrade-l2 please take a look / sign

srimanob · 2024-09-16T17:34:22Z

Configuration/PyReleaseValidation/README.md

@@ -33,11 +33,15 @@ The offsets currently in use are:
 * 0.402: Alpaka, pixel only quadruplets, portable
 * 0.403: Alpaka, pixel only quadruplets, portable vs. CPU validation
 * 0.404: Alpaka, pixel only quadruplets, portable profiling
+* 0.406: Alpaka, pixel only triplets, portable
+* 0.407: Alpaka, pixel only triplets, portable vs. CPU validation
+* 0.407: Alpaka, pixel only triplets, portable profiling


Typo? Also in the master. Please fix in the follow up PR.

srimanob · 2024-09-16T17:35:18Z

+Upgrade

cmsbuild · 2024-09-16T17:35:40Z

This pull request is fully signed and it will be integrated in one of the next CMSSW_14_1_X IBs (tests are also fine) and once validation in the development release cycle CMSSW_14_2_X is complete. This pull request will now be reviewed by the release team before it's merged. @rappoccio, @sextonkennedy, @antoniovilela, @mandrenguyen (and backports should be raised in the release meeting by the corresponding L2)

mandrenguyen · 2024-09-17T18:00:29Z

+1

Move relval_gpu to 2024 Alpaka + add D110 wfs (141X)

bcb80e4

- removing CUDA wfs - adding triplets - fixing Phase2 DQM GPUvsGPU (no raw)

cmsbuild added this to the CMSSW_14_1_X milestone Sep 9, 2024

cmsbuild added reconstruction-pending dqm-pending pending-signatures tests-pending orp-pending pdmv-pending upgrade-pending tracking trk labels Sep 9, 2024

AdrianoDee marked this pull request as ready for review September 9, 2024 10:55

cmsbuild added tests-started and removed tests-pending labels Sep 9, 2024

cmsbuild added tests-rejected and removed tests-started labels Sep 9, 2024

Fix Alpaka Harvesting for Phase2

01c3101

cmsbuild added tests-pending and removed tests-rejected labels Sep 9, 2024

cmsbuild removed the tests-pending label Sep 9, 2024

cmsbuild added the tests-started label Sep 9, 2024

cmsbuild added tests-approved and removed tests-started labels Sep 9, 2024

cmsbuild added reconstruction-approved and removed reconstruction-pending labels Sep 10, 2024

cmsbuild added pdmv-approved and removed pdmv-pending labels Sep 10, 2024

cmsbuild added dqm-approved and removed dqm-pending labels Sep 12, 2024

srimanob reviewed Sep 16, 2024

View reviewed changes

cmsbuild removed pending-signatures upgrade-pending labels Sep 16, 2024

cmsbuild added fully-signed upgrade-approved labels Sep 16, 2024

cmsbuild added orp-approved and removed orp-pending labels Sep 17, 2024

cmsbuild merged commit f120b86 into cms-sw:CMSSW_14_1_X Sep 17, 2024
13 checks passed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[14_1_X] Update to `relval_gpu.py`for Alpaka and Pixel Triplets Alpaka Workflows #45958

[14_1_X] Update to `relval_gpu.py`for Alpaka and Pixel Triplets Alpaka Workflows #45958

AdrianoDee commented Sep 9, 2024 •

edited

Loading

cmsbuild commented Sep 9, 2024

cmsbuild commented Sep 9, 2024 •

edited

Loading

AdrianoDee commented Sep 9, 2024

AdrianoDee commented Sep 9, 2024

AdrianoDee commented Sep 9, 2024

cmsbuild commented Sep 9, 2024

AdrianoDee commented Sep 9, 2024

AdrianoDee commented Sep 9, 2024

cmsbuild commented Sep 9, 2024

AdrianoDee commented Sep 9, 2024

cmsbuild commented Sep 9, 2024

jfernan2 commented Sep 10, 2024

AdrianoDee commented Sep 10, 2024

AdrianoDee commented Sep 10, 2024

antoniovagnerini commented Sep 12, 2024

mmusich commented Sep 16, 2024

srimanob Sep 16, 2024

srimanob commented Sep 16, 2024

cmsbuild commented Sep 16, 2024

mandrenguyen commented Sep 17, 2024

[14_1_X] Update to relval_gpu.pyfor Alpaka and Pixel Triplets Alpaka Workflows #45958

[14_1_X] Update to relval_gpu.pyfor Alpaka and Pixel Triplets Alpaka Workflows #45958

Conversation

AdrianoDee commented Sep 9, 2024 • edited Loading

cmsbuild commented Sep 9, 2024

cmsbuild commented Sep 9, 2024 • edited Loading

AdrianoDee commented Sep 9, 2024

AdrianoDee commented Sep 9, 2024

AdrianoDee commented Sep 9, 2024

cmsbuild commented Sep 9, 2024

RelVals-GPU

Comparison Summary

AdrianoDee commented Sep 9, 2024

AdrianoDee commented Sep 9, 2024

cmsbuild commented Sep 9, 2024

AdrianoDee commented Sep 9, 2024

cmsbuild commented Sep 9, 2024

Comparison Summary

GPU Comparison Summary

jfernan2 commented Sep 10, 2024

AdrianoDee commented Sep 10, 2024

AdrianoDee commented Sep 10, 2024

antoniovagnerini commented Sep 12, 2024

mmusich commented Sep 16, 2024

srimanob Sep 16, 2024

Choose a reason for hiding this comment

srimanob commented Sep 16, 2024

cmsbuild commented Sep 16, 2024

mandrenguyen commented Sep 17, 2024

[14_1_X] Update to `relval_gpu.py`for Alpaka and Pixel Triplets Alpaka Workflows #45958

[14_1_X] Update to `relval_gpu.py`for Alpaka and Pixel Triplets Alpaka Workflows #45958

AdrianoDee commented Sep 9, 2024 •

edited

Loading

cmsbuild commented Sep 9, 2024 •

edited

Loading