Patatrack integration - Pixel track reconstruction (10/N)

[fwyzard]

PR description:

Data formats and algorithms for the Pixel track reconstruction running on GPU.
Implements building the pixel pairs, running the CA, applying the Fishbone cleaning, and performing either Riemann or Broken Line fit to produce tracks made by triplets and/or ntuplets.

Includes changes to "MTV" for the validation of pixel-only tracks.

PR validation:

Changes in use in the Patatrack releases.

if this PR is a backport please specify the original PR and why you need to backport that PR:

Includes changes from:

• Add a DQM sequence for pixel-only tracking cms-patatrack/cmssw#23: Add a DQM sequence for pixel-only tracking
• Use the gpu modifier to read the pixel clusters from the unpacker cms-patatrack/cmssw#31: Use the gpu modifier to read the pixel clusters from the unpacker
• Riemann fit patatrack cms-patatrack/cmssw#34: Implement Riemann fit for pixel tracks
• Riemann fit gpu cms-patatrack/cmssw#60: Port the Riemann fit to CUDA
• Heterogeneous version of Raw2Cluster and RecHit cms-patatrack/cmssw#62: Implement a Heterogeneous version of Raw2Cluster and RecHit
• Clean up CAHitNtupletHeterogeneousEDProducer cms-patatrack/cmssw#83: Clean up CAHitNtupletHeterogeneousEDProducer
• Next prototype of the framework integration cms-patatrack/cmssw#100: Next prototype of the framework integration
• Cluster2TP assoc on GPU cms-patatrack/cmssw#105: Heterogeneous ClusterTPAssociation
• Customize function to provide a minimal configuration for profiling cms-patatrack/cmssw#106: Customize function to provide a minimal configuration for profiling
• Fix cluster->TP matching for pixel tracking CPU workflow cms-patatrack/cmssw#111: Fix Cluster-to-TrackingParticle matching for pixel tracking CPU workflow
• Pixel doublets on GPU (rebased on 10_2_1) cms-patatrack/cmssw#118: Pixel doublets on GPU
• Cleanup defines, includes, file names, and debug messages cms-patatrack/cmssw#122: Cleanup defines, includes, file names, and debug messages
• Move all CUDA code to the plugins/ directory cms-patatrack/cmssw#123: Move all CUDA code to the plugins/ directory
• Remove GPU-CA dependence on CPU doublets cms-patatrack/cmssw#126: Remove GPU-CellularAutomaton dependence on CPU doublets
• Add optional flags to disable SOA->legacy conversion and GPU->CPU transfer cms-patatrack/cmssw#132: Add optional flags to disable SOA->legacy conversion and GPU->CPU transfer
• Cleanup after merging with CMSSW 10.2.2 cms-patatrack/cmssw#134: Cleanup after merging with CMSSW 10.2.2
• clang-format RiemannFit.h cms-patatrack/cmssw#143: Reformat the Riemann fit code
• Clean up and bugfixes for the Riemann fit cms-patatrack/cmssw#148: Clean up and bugfixes for the Riemann fit
• Add MTV instance for pixel tracks from PV cms-patatrack/cmssw#156: Add MTV instance for pixel tracks from PV
• Doublet tuning and new vertex algo cms-patatrack/cmssw#158: Tune and speed up doublet algo
• Reduce CA memory need cms-patatrack/cmssw#159: Reduce CA memory need
• Optimise gpuPixelDoublets::doubletsFromHisto() kernel cms-patatrack/cmssw#167: Optimise gpuPixelDoublets::doubletsFromHisto() kernel
• Rieman fit in CA cms-patatrack/cmssw#169: Add Rieman fit to the CA
• Introduce Cluster Charge Cut, optimize Histogram (bucket sorting) cms-patatrack/cmssw#171: Introduce Cluster Charge Cut, optimize Histogram (bucket sorting)
• Riemann fit multiple scattering cms-patatrack/cmssw#174: Riemann fit multiple scattering
• Clean up Riemann fit in CA  cms-patatrack/cmssw#178: Clean up Riemann fit in CA
• Suppress asserts in the GPU code, unless GPU_DEBUG is defined cms-patatrack/cmssw#186: Suppress asserts in the GPU code, unless GPU_DEBUG is defined
• Riemann fit updates cms-patatrack/cmssw#190: Recover pre-10.4.x Riemann fit rework
• Riemann fit updates cms-patatrack/cmssw#190: Riemann fit rework
• Fix MTV validation of initialStepPreSplitting tracks and add B-hadron MTV variation to pixel track validation sequence cms-patatrack/cmssw#199: Fix MTV validation of initialStepPreSplitting tracks and add B-hadron MTV variation to pixel track validation sequence
• Migrate tracker local reconstruction and pixel tracking to Tasks (backport #25163) cms-patatrack/cmssw#202: Migrate tracker local reconstruction and pixel tracking to Tasks (backport Migrate tracker local reconstruction and pixel tracking to Tasks #25163)
• Address code style and quality issues cms-patatrack/cmssw#203: Address code style and quality issues
• faster track fit and faster clustering cms-patatrack/cmssw#216: Full workflow from raw data to pixel tracks and vertices on GPUs
• Remove unnecessary pragmas cms-patatrack/cmssw#249: Remove unnecessary pragmas
• Skip CUDA-related tests if no GPU is present cms-patatrack/cmssw#252: Skip CUDA-related tests if no GPU is present
• Use 2D grid for inner loop parallelization cms-patatrack/cmssw#260: Speed up the doublet finder
• Various updates to pixel track/vertex DQM and MTV cms-patatrack/cmssw#285: Various updates to pixel track/vertex DQM and MTV
• Tracking developments for review and merging cms-patatrack/cmssw#338: Clean up by clang-format
• Tracking developments for review and merging cms-patatrack/cmssw#338: Improve pixel doublets and CA, and extend debugging functionality
• Tracking developments for review and merging cms-patatrack/cmssw#338: Migrate the pixel rechits producer and CA to the new heterogeneous framework
• Tracking developments for review and merging cms-patatrack/cmssw#338: Rework the Riemann fit and broken line fit
• First implementation of the broken line fit cms-patatrack/cmssw#340: Implementation of the broken line fit
• Make the CA, ntuplet fit, and track clustering modules configurable cms-patatrack/cmssw#347: Make GPU CellularAutomaton configurable
• Make the CA, ntuplet fit, and track clustering modules configurable cms-patatrack/cmssw#347: Make doClusterCut, doZCut, doPhiCut configurable
• Move event and stream caches, and caching allocators out from CUDAService cms-patatrack/cmssw#364: Move event and stream caches, and caching allocators out from CUDAService
• Build seeds directly from cpu product cms-patatrack/cmssw#365: Build seeds directly from cpu product
• Implement triplets in the pixel ntuplet producer cms-patatrack/cmssw#382: Implement triplets in the pixel ntuplet producer
• fix bug in (and extend) cluster shape cut cms-patatrack/cmssw#383: fix bug in (and extend) cluster shape cut
• Port the whole pixel workflow to new heterogeneous framework cms-patatrack/cmssw#384: Port the whole pixel workflow to new heterogeneous framework
• Implement full Pixel SoA workflow on CPU cms-patatrack/cmssw#385: Implement full Pixel SoA workflow on CPU
• Fix clang warnings cms-patatrack/cmssw#387: Fix clang warnings
• Replace use of API wrapper stream and event with plain CUDA, part 1 cms-patatrack/cmssw#389: Replace use of API wrapper stream and event with plain CUDA, part 1
• Synchronize event in the CUDAProductBase destructor cms-patatrack/cmssw#391: Synchronize event in the CUDAProductBase destructor
• Replace CUDA API wrapper memory operations with native CUDA calls cms-patatrack/cmssw#395: Replace CUDA API wrapper memory operations with native CUDA calls
• migrate cluster track associator cms-patatrack/cmssw#409: Migrate cluster track associator
• Small Optimization in doublet code cms-patatrack/cmssw#411: Optimize doublet reconstruction and cuts
• Drop obsolete heterogenous framework cms-patatrack/cmssw#416: Drop obsolete heterogenous framework
• Clean up the last remaining references to CUDA API Wrappers cms-patatrack/cmssw#417: Remove last references to CUDA API Wrappers
• Rename exitSansCUDADevices to requireCUDADevices cms-patatrack/cmssw#423: Rename exitSansCUDADevices to requireCUDADevices
• [WIP] Follow-ups to the CUDA framework PR review cms-patatrack/cmssw#429: Implement changes from the CUDA framework review
• Apply feedback from upstream PR cms-patatrack/cmssw#441: Apply feedback from upstream PR
• Integrate the comments from the upstream PRs cms-patatrack/cmssw#442: Integrate the comments from the upstream PRs
• Fix use of namespaces cms-patatrack/cmssw#446: Fix use of namespaces
• Replace cub prefix-scan with home-brewed one. cms-patatrack/cmssw#447: Replace cub prefix scan with home-brewed one
• Use std::isnan cms-patatrack/cmssw#456: Use std::isnan
• use a dynamic buffer for CA cells components, adjust allocator growing factor to reduce memory used cms-patatrack/cmssw#509: Reduce GPU memory usage
• Protect CAHitNtupletCUDA ctor/dtor when CUDA is not available cms-patatrack/cmssw#544: Protect CAHitNtupletCUDA ctor/dtor when CUDA is not available
• Updating RelVal WF & customisation on CPU cms-patatrack/cmssw#549: Update the RelVal workflows and the CPU customisation
• Add customisations for profiling the Pixel-only workflow cms-patatrack/cmssw#553: Add customisations for profiling the Pixel-only workflow
• Further clean up after merging CMSSW_11_2_0_pre7 cms-patatrack/cmssw#556: Further clean up after merging CMSSW_11_2_0_pre7
• Move the siPixelClusters.payloadType change to the SoA-on-CPU customisation cms-patatrack/cmssw#560: Move the siPixelClusters.payloadType to the SoA-on-CPU customisation
• move to int32 for hit indices cms-patatrack/cmssw#583: Move hit indexes to 32 bits
• Clean up the pixel local reconstruction code cms-patatrack/cmssw#593: Clean up the pixel local reconstruction code
• Clean up the pixel local reconstruction code cms-patatrack/cmssw#602: Clean up the pixel local reconstruction code
• Clean up the pixel track reconstruction code cms-patatrack/cmssw#606: Clean up the pixel track reconstruction code
• Further clean up the CA ntuplet generator cms-patatrack/cmssw#610: Further clean up the CA ntuplet generator
• Minor fixes and clean up for the pixel track reconstruction code cms-patatrack/cmssw#611: Minor fixes and clean up for the pixel track reconstruction code

[fwyzard]

For all questions, please address @makortel @felicepantaleo @VinInn @rovere .
For all changes, please make PRs against cms-patatrack:patatrack_integration_10_N_pixel_tracks .

[cmsbuild]

The code-checks are being triggered in jenkins.

[cmsbuild]

-code-checks

ERROR: Build errors found during clang-tidy run.

CUDADataFormats/TrackingRecHit/interface/TrackingRecHit2DSOAView.h:6:10: error: 'CUDADataFormats/SiPixelCluster/interface/gpuClusteringConstants.h' file not found [clang-diagnostic-error]
#include "CUDADataFormats/SiPixelCluster/interface/gpuClusteringConstants.h"
         ^
Suppressed 221 warnings (220 in non-user code, 1 with check filters).
--
RecoPixelVertexing/PixelTriplets/plugins/CAHitNtupletGeneratorKernelsImpl.h:14:10: error: 'RecoLocalTracker/SiPixelRecHits/interface/pixelCPEforGPU.h' file not found [clang-diagnostic-error]
#include "RecoLocalTracker/SiPixelRecHits/interface/pixelCPEforGPU.h"
         ^
Suppressed 330 warnings (329 in non-user code, 1 with check filters).
--
CUDADataFormats/Track/interface/PixelTrackHeterogeneous.h:7:10: error: 'CUDADataFormats/Common/interface/HeterogeneousSoA.h' file not found [clang-diagnostic-error]
#include "CUDADataFormats/Common/interface/HeterogeneousSoA.h"
         ^
Suppressed 314 warnings (313 in non-user code, 1 with check filters).
--
CUDADataFormats/Track/interface/PixelTrackHeterogeneous.h:7:10: error: 'CUDADataFormats/Common/interface/HeterogeneousSoA.h' file not found [clang-diagnostic-error]
#include "CUDADataFormats/Common/interface/HeterogeneousSoA.h"
         ^
Suppressed 315 warnings (314 in non-user code, 1 with check filters).
--
RecoPixelVertexing/PixelTrackFitting/plugins/PixelTrackSoAFromCUDA.cc:4:10: error: 'CUDADataFormats/Common/interface/HostProduct.h' file not found [clang-diagnostic-error]
#include "CUDADataFormats/Common/interface/HostProduct.h"
         ^
Suppressed 740 warnings (739 in non-user code, 1 with check filters).
--
CUDADataFormats/TrackingRecHit/interface/TrackingRecHit2DSOAView.h:6:10: error: 'CUDADataFormats/SiPixelCluster/interface/gpuClusteringConstants.h' file not found [clang-diagnostic-error]
#include "CUDADataFormats/SiPixelCluster/interface/gpuClusteringConstants.h"
         ^
Suppressed 993 warnings (992 in non-user code, 1 with check filters).
--
CUDADataFormats/Track/interface/PixelTrackHeterogeneous.h:7:10: error: 'CUDADataFormats/Common/interface/HeterogeneousSoA.h' file not found [clang-diagnostic-error]
#include "CUDADataFormats/Common/interface/HeterogeneousSoA.h"
         ^
Suppressed 861 warnings (860 in non-user code, 1 with check filters).
--
CUDADataFormats/Track/interface/PixelTrackHeterogeneous.h:7:10: error: 'CUDADataFormats/Common/interface/HeterogeneousSoA.h' file not found [clang-diagnostic-error]
#include "CUDADataFormats/Common/interface/HeterogeneousSoA.h"
         ^
Suppressed 957 warnings (956 in non-user code, 1 with check filters).
--
CUDADataFormats/TrackingRecHit/interface/TrackingRecHit2DSOAView.h:6:10: error: 'CUDADataFormats/SiPixelCluster/interface/gpuClusteringConstants.h' file not found [clang-diagnostic-error]
#include "CUDADataFormats/SiPixelCluster/interface/gpuClusteringConstants.h"
         ^
Suppressed 1136 warnings (1135 in non-user code, 1 with check filters).
--
RecoPixelVertexing/PixelTrackFitting/plugins/PixelTrackProducerFromSoA.cc:30:10: error: 'CUDADataFormats/Common/interface/HostProduct.h' file not found [clang-diagnostic-error]
#include "CUDADataFormats/Common/interface/HostProduct.h"
         ^
Suppressed 1300 warnings (1299 in non-user code, 1 with check filters).
--
gmake: *** [config/SCRAM/GMake/Makefile.coderules:128: code-checks] Error 2
gmake: *** [There are compilation/build errors. Please see the detail log above.] Error 2

[cmsbuild]

The tests are being triggered in jenkins.
Tested with other pull request(s) #31854,#31721,#31723
Test Parameters:

• MATRIX_EXTRAS = 10824.505,10824.506,11634.505,11634.506
• CMSSW_11_2_X_2020-10-19-1100/slc7_amd64_gcc820: https://cmssdt.cern.ch/jenkins/job/ib-run-pr-tests/10089/console Started: 2020/10/19 17:51

[cmsbuild]

-1
@fwyzard This pull request cannot be automatically merged, could you please rebase it?

You can see the log for git cms-merge-topic here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-31722/10089/git-merge-result