Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Updated root to tip of branch master #9025

Conversation

iarspider
Copy link
Contributor

No description provided.

@cmsbuild
Copy link
Contributor

A new Pull Request was created by @iarspider for branch IB/CMSSW_14_1_X/rootmaster.

@cmsbuild, @iarspider, @aandvalenzuela, @smuzaffar can you please review it and eventually sign? Thanks.
@rappoccio, @antoniovilela, @sextonkennedy you are the release manager for this.
cms-bot commands are listed here

@cmsbuild
Copy link
Contributor

cmsbuild commented Feb 19, 2024

cms-bot internal usage

@iarspider
Copy link
Contributor Author

please test

@cmsbuild
Copy link
Contributor

-1

Failed Tests: Build ClangBuild
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-5f67dc/37549/summary.html
COMMIT: 1543064
CMSSW: CMSSW_14_1_X_2024-02-19-1100/el8_amd64_gcc12
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmsdist/9025/37549/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-5f67dc/37549/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-5f67dc/37549/git-merge-result

Build

I found compilation error when building:

>> Compiling edm plugin src/PhysicsTools/NanoAOD/plugins/rntuple/NanoAODRNTupleOutputModule.cc
>> Compiling edm plugin src/PhysicsTools/NanoAOD/plugins/rntuple/NanoAODRNTuples.cc
>> Compiling edm plugin src/PhysicsTools/NanoAOD/plugins/rntuple/SummaryTableOutputFields.cc
>> Compiling edm plugin src/PhysicsTools/NanoAOD/plugins/rntuple/TableOutputFields.cc
>> Compiling edm plugin src/PhysicsTools/NanoAOD/plugins/rntuple/TriggerOutputFields.cc
src/PhysicsTools/NanoAOD/plugins/rntuple/NanoAODRNTupleOutputModule.cc:22:35: error: 'RPageSinkFile' has not been declared in 'ROOT::Experimental::Detail'
   22 | using ROOT::Experimental::Detail::RPageSinkFile;
      |                                   ^~~~~~~~~~~~~
src/PhysicsTools/NanoAOD/plugins/rntuple/NanoAODRNTuples.cc:12:35: error: 'RPageSinkFile' has not been declared in 'ROOT::Experimental::Detail'
   12 | using ROOT::Experimental::Detail::RPageSinkFile;
      |                                   ^~~~~~~~~~~~~


Clang Build

I found compilation error while trying to compile with clang. Command used:

USER_CUDA_FLAGS='--expt-relaxed-constexpr' USER_CXXFLAGS='-Wno-register -fsyntax-only' scram build -k -j 32 COMPILER='llvm compile'

>> Entering Package Validation/TrackerDigis
>> Entering Package Validation/TrackerHits
>> Entering Package Validation/TrackerRecHits
>> Entering Package Validation/TrackingMCTruth
>> Compile sequence completed for CMSSW CMSSW_14_1_X_2024-02-19-1100
gmake: *** [There are compilation/build errors. Please see the detail log above.] Error 1
+ eval scram build outputlog '&&' '(python3' /data/cmsbld/jenkins/workspace/ib-run-pr-tests/cms-bot/buildLogAnalyzer.py --logDir /data/cmsbld/jenkins/workspace/ib-run-pr-tests/CMSSW_14_1_X_2024-02-19-1100/tmp/el8_amd64_gcc12/cache/log/src '||' 'true)'
++ scram build outputlog
>> Entering Package Alignment/APEEstimation
Entering library rule at src/Alignment/APEEstimation/plugins
>> Compiling edm plugin src/Alignment/APEEstimation/plugins/ApeEstimator.cc


@iarspider
Copy link
Contributor Author

please test for CMSSW_14_1_ROOT6_X

@cmsbuild
Copy link
Contributor

-1

Failed Tests: Build
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-5f67dc/37563/summary.html
COMMIT: 1543064
CMSSW: CMSSW_14_1_ROOT6_X_2024-02-19-2300/el8_amd64_gcc12
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmsdist/9025/37563/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-5f67dc/37563/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-5f67dc/37563/git-merge-result

Build

I found compilation error when building:

>> Compiling edm plugin src/PhysicsTools/NanoAOD/plugins/rntuple/NanoAODRNTupleOutputModule.cc
>> Compiling edm plugin src/PhysicsTools/NanoAOD/plugins/rntuple/NanoAODRNTuples.cc
>> Compiling edm plugin src/PhysicsTools/NanoAOD/plugins/rntuple/SummaryTableOutputFields.cc
>> Compiling edm plugin src/PhysicsTools/NanoAOD/plugins/rntuple/TableOutputFields.cc
>> Compiling edm plugin src/PhysicsTools/NanoAOD/plugins/rntuple/TriggerOutputFields.cc
src/PhysicsTools/NanoAOD/plugins/rntuple/NanoAODRNTupleOutputModule.cc:22:35: error: 'RPageSinkFile' has not been declared in 'ROOT::Experimental::Detail'
   22 | using ROOT::Experimental::Detail::RPageSinkFile;
      |                                   ^~~~~~~~~~~~~
src/PhysicsTools/NanoAOD/plugins/rntuple/NanoAODRNTuples.cc:12:35: error: 'RPageSinkFile' has not been declared in 'ROOT::Experimental::Detail'
   12 | using ROOT::Experimental::Detail::RPageSinkFile;
      |                                   ^~~~~~~~~~~~~


@iarspider
Copy link
Contributor Author

please test for CMSSW_14_1_ROOT6_X

@iarspider
Copy link
Contributor Author

please abort

@iarspider
Copy link
Contributor Author

please test for CMSSW_14_1_ROOT6_X

@cmsbuild
Copy link
Contributor

-1

Failed Tests: UnitTests RelVals
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-5f67dc/37583/summary.html
COMMIT: 1543064
CMSSW: CMSSW_14_1_ROOT6_X_2024-02-19-2300/el8_amd64_gcc12
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmsdist/9025/37583/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-5f67dc/37583/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-5f67dc/37583/git-merge-result

Unit Tests

I found 2 errors in the following unit tests:

---> test materialBudgetTrackerPlots had ERRORS
---> test materialBudgetHGCalPlots had ERRORS

RelVals

----- Begin Fatal Exception 20-Feb-2024 23:30:47 CET-----------------------
An exception of category 'FatalRootError' occurred while
   [0] Processing  stream begin Run run: 160960 stream: 0
   [1] Calling method for module SiStripMonitorTrack/'SiStripMonitorTrack_ckf'
   Additional Info:
      [a] Fatal Root Error: @SUB=TAxis::TAxis::SetRangeUser
ulast > fXmax, fXmax is used

----- End Fatal Exception -------------------------------------------------
----- Begin Fatal Exception 20-Feb-2024 23:33:12 CET-----------------------
An exception of category 'FatalRootError' occurred while
   [0] Processing  stream begin Run run: 1 stream: 0
   [1] Calling method for module SiStripMonitorTrack/'SiStripMonitorTrack_ckf'
   Additional Info:
      [a] Fatal Root Error: @SUB=TAxis::TAxis::SetRangeUser
ulast > fXmax, fXmax is used

----- End Fatal Exception -------------------------------------------------
----- Begin Fatal Exception 20-Feb-2024 23:34:23 CET-----------------------
An exception of category 'FatalRootError' occurred while
   [0] Processing  stream begin Run run: 1 stream: 0
   [1] Calling method for module SiStripMonitorTrack/'SiStripMonitorTrack_ckf'
   Additional Info:
      [a] Fatal Root Error: @SUB=TAxis::TAxis::SetRangeUser
ulast > fXmax, fXmax is used

----- End Fatal Exception -------------------------------------------------
Expand to see more relval errors ...

@iarspider
Copy link
Contributor Author

please test for CMSSW_14_1_ROOT6_X
No idea why RelVals failed like this

@iarspider
Copy link
Contributor Author

please abort

@iarspider
Copy link
Contributor Author

Failures are caused by this ROOT PR: root-project/root#14589

@iarspider
Copy link
Contributor Author

@cms-sw/core-l2 FYI.

@makortel
Copy link
Contributor

This condition (also given ROOT only added the message without changing behavior) does not seem to me worth of terminating a job, so I would add these messages to the list of ROOT messages to be converted to Info messages instead of exceptions.

Written that, it could be good to fix the culprit SetRangeUser call too. @iarspider Would you be able to get a stack trace of the exception?

FYI @cms-sw/dqm-l2

@iarspider
Copy link
Contributor Author

iarspider commented Feb 22, 2024

@makortel is there a standard way to do it (gdb-ing a RelVal is tough)? Also, looks like there is a different error in some RelVals, see e.g. 140.53 - but I can't find what throws it.

@makortel
Copy link
Contributor

is there a standard way to do it (gdb-ing a RelVal is tough)?

Running the workflow locally is the way to go (the PR test message includes a simple recipe to use the same build area). E.g. in gdb do catch throw, and print the stack trace. Or run the job through cmsTraceExceptions cmsRun ... to print the stack traces of the exceptions where they are thrown (that is just a wrapper for gdb). The fact that there are some exceptions that get captured during the job could favor the cmsTraceExceptions

Also, looks like there is a different error in some RelVals, see e.g. 140.53 - but I can't find what throws it.

That looks indeed a different problem.

@makortel
Copy link
Contributor

This condition (also given ROOT only added the message without changing behavior) does not seem to me worth of terminating a job, so I would add these messages to the list of ROOT messages to be converted to Info messages instead of exceptions.

This is now done in cms-sw/cmssw#44060

@iarspider
Copy link
Contributor Author

Thread 5 "cmsRun" hit Catchpoint 1 (exception thrown), 0x00007ffff5b952f1 in __cxxabiv1::__cxa_throw (obj=0x7fff720a5900, tinfo=0x7ffff7999610 <typeinfo for edm::Exception>, dest=0x7ffff7963010 <edm::Exception::~Exception()>) at ../../../../libstdc++-v3/libsupc++/eh_throw.cc:81
81	../../../../libstdc++-v3/libsupc++/eh_throw.cc: No such file or directory.
#0  0x00007ffff5b952f1 in __cxxabiv1::__cxa_throw (obj=0x7fff720a5900, tinfo=0x7ffff7999610 <typeinfo for edm::Exception>, dest=0x7ffff7963010 <edm::Exception::~Exception()>) at ../../../../libstdc++-v3/libsupc++/eh_throw.cc:81
#1  0x00007fffee3a9979 in (anonymous namespace)::RootErrorHandlerImpl(int, char const*, char const*) [clone .cold] () from /data/cmsbld/shift/CMSSW_14_1_ROOT6_X_2024-02-19-2300/lib/el8_amd64_gcc12/pluginFWCoreServicesPlugins.so
#2  0x00007ffff6e0ca9b in ErrorHandler () from /data/cmsbld/shift/CMSSW_14_1_ROOT6_X_2024-02-19-2300/external/el8_amd64_gcc12/lib/libCore.so
#3  0x00007ffff6d4f0a4 in TObject::Warning(char const*, char const*, ...) const () from /data/cmsbld/shift/CMSSW_14_1_ROOT6_X_2024-02-19-2300/external/el8_amd64_gcc12/lib/libCore.so
#4  0x00007fffee0d90f1 in TAxis::SetRangeUser(double, double) () from /data/cmsbld/shift/CMSSW_14_1_ROOT6_X_2024-02-19-2300/external/el8_amd64_gcc12/lib/libHist.so
#5  0x00007fffeefe8cf5 in dqm::impl::MonitorElement::setAxisRange(double, double, int) () from /data/cmsbld/shift/CMSSW_14_1_ROOT6_X_2024-02-19-2300/lib/el8_amd64_gcc12/libDQMServicesCore.so
#6  0x00007fff97283f60 in SiStripMonitorTrack::bookSubDetMEs(dqm::implementation::IBooker&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >&) () from /data/cmsbld/shift/CMSSW_14_1_ROOT6_X_2024-02-19-2300/lib/el8_amd64_gcc12/pluginDQMSiStripMonitorTrack.so
#7  0x00007fff97286000 in SiStripMonitorTrack::book(dqm::implementation::IBooker&, TrackerTopology const*, TkDetMap const*) () from /data/cmsbld/shift/CMSSW_14_1_ROOT6_X_2024-02-19-2300/lib/el8_amd64_gcc12/pluginDQMSiStripMonitorTrack.so
#8  0x00007fff9727895e in DQMEDAnalyzer::beginRun(edm::Run const&, edm::EventSetup const&) () from /data/cmsbld/shift/CMSSW_14_1_ROOT6_X_2024-02-19-2300/lib/el8_amd64_gcc12/pluginDQMSiStripMonitorTrack.so
#9  0x00007ffff7ce3405 in edm::stream::ProducingModuleAdaptorBase<edm::stream::EDProducerBase>::doStreamBeginRun(edm::StreamID, edm::RunTransitionInfo const&, edm::ModuleCallingContext const*) () from /data/cmsbld/shift/CMSSW_14_1_ROOT6_X_2024-02-19-2300/lib/el8_amd64_gcc12/libFWCoreFramework.so
#10 0x00007ffff7cc8800 in edm::WorkerT<edm::stream::EDProducerAdaptorBase>::implDoStreamBegin(edm::StreamID, edm::RunTransitionInfo const&, edm::ModuleCallingContext const*) () from /data/cmsbld/shift/CMSSW_14_1_ROOT6_X_2024-02-19-2300/lib/el8_amd64_gcc12/libFWCoreFramework.so
#11 0x00007ffff7bef869 in edm::Worker::doWorkNoPrefetchingAsync<edm::OccurrenceTraits<edm::RunPrincipal, (edm::BranchActionType)1> >(edm::WaitingTaskHolder, edm::OccurrenceTraits<edm::RunPrincipal, (edm::BranchActionType)1>::TransitionInfoType const&, edm::ServiceToken const&, edm::StreamID, edm::ParentContext const&, edm::OccurrenceTraits<edm::RunPrincipal, (edm::BranchActionType)1>::Context const*)::{lambda()#1}::operator()() const () from /data/cmsbld/shift/CMSSW_14_1_ROOT6_X_2024-02-19-2300/lib/el8_amd64_gcc12/libFWCoreFramework.so
#12 0x00007ffff7bfe9d9 in tbb::detail::d1::function_task<edm::Worker::doWorkNoPrefetchingAsync<edm::OccurrenceTraits<edm::RunPrincipal, (edm::BranchActionType)1> >(edm::WaitingTaskHolder, edm::OccurrenceTraits<edm::RunPrincipal, (edm::BranchActionType)1>::TransitionInfoType const&, edm::ServiceToken const&, edm::StreamID, edm::ParentContext const&, edm::OccurrenceTraits<edm::RunPrincipal, (edm::BranchActionType)1>::Context const*)::{lambda()#1}>::execute(tbb::detail::d1::execution_data&) () from /data/cmsbld/shift/CMSSW_14_1_ROOT6_X_2024-02-19-2300/lib/el8_amd64_gcc12/libFWCoreFramework.so
#13 0x00007ffff63ed95b in tbb::detail::r1::task_dispatcher::local_wait_for_all<false, tbb::detail::r1::outermost_worker_waiter> (t=0x7ffff3a8bc00, waiter=..., this=0x7ffff3b79480) at /data/cmsbld/jenkins/workspace/auto-builds/CMSSW_14_0_0_pre2_SKYLAKEAVX512-el8_amd64_gcc12/build/CMSSW_14_0_0_pre2_SKYLAKEAVX512-build/BUILD/el8_amd64_gcc12/external/tbb/v2021.9.0-5109e373398eaf79a8268d6a86a2f6e2/tbb-v2021.9.0/src/tbb/task_dispatcher.h:322
#14 tbb::detail::r1::task_dispatcher::local_wait_for_all<tbb::detail::r1::outermost_worker_waiter> (t=0x0, waiter=..., this=0x7ffff3b79480) at /data/cmsbld/jenkins/workspace/auto-builds/CMSSW_14_0_0_pre2_SKYLAKEAVX512-el8_amd64_gcc12/build/CMSSW_14_0_0_pre2_SKYLAKEAVX512-build/BUILD/el8_amd64_gcc12/external/tbb/v2021.9.0-5109e373398eaf79a8268d6a86a2f6e2/tbb-v2021.9.0/src/tbb/task_dispatcher.h:458
#15 tbb::detail::r1::arena::process (tls=..., this=<optimized out>) at /data/cmsbld/jenkins/workspace/auto-builds/CMSSW_14_0_0_pre2_SKYLAKEAVX512-el8_amd64_gcc12/build/CMSSW_14_0_0_pre2_SKYLAKEAVX512-build/BUILD/el8_amd64_gcc12/external/tbb/v2021.9.0-5109e373398eaf79a8268d6a86a2f6e2/tbb-v2021.9.0/src/tbb/arena.cpp:137
#16 tbb::detail::r1::market::process (this=<optimized out>, j=...) at /data/cmsbld/jenkins/workspace/auto-builds/CMSSW_14_0_0_pre2_SKYLAKEAVX512-el8_amd64_gcc12/build/CMSSW_14_0_0_pre2_SKYLAKEAVX512-build/BUILD/el8_amd64_gcc12/external/tbb/v2021.9.0-5109e373398eaf79a8268d6a86a2f6e2/tbb-v2021.9.0/src/tbb/market.cpp:599
#17 0x00007ffff63efb0e in tbb::detail::r1::rml::private_worker::run (this=0x7fffef597000) at /data/cmsbld/jenkins/workspace/auto-builds/CMSSW_14_0_0_pre2_SKYLAKEAVX512-el8_amd64_gcc12/build/CMSSW_14_0_0_pre2_SKYLAKEAVX512-build/BUILD/el8_amd64_gcc12/external/tbb/v2021.9.0-5109e373398eaf79a8268d6a86a2f6e2/tbb-v2021.9.0/src/tbb/private_server.cpp:271
#18 tbb::detail::r1::rml::private_worker::thread_routine (arg=0x7fffef597000) at /data/cmsbld/jenkins/workspace/auto-builds/CMSSW_14_0_0_pre2_SKYLAKEAVX512-el8_amd64_gcc12/build/CMSSW_14_0_0_pre2_SKYLAKEAVX512-build/BUILD/el8_amd64_gcc12/external/tbb/v2021.9.0-5109e373398eaf79a8268d6a86a2f6e2/tbb-v2021.9.0/src/tbb/private_server.cpp:221
#19 0x00007ffff552c1ca in start_thread () from /lib64/libpthread.so.0
#20 0x00007ffff5198e73 in clone () from /lib64/libc.so.6

@iarspider
Copy link
Contributor Author

For Batch::Batch exception:

Thread 1 "cmsRun" hit Catchpoint 1 (exception thrown), 0x00007ffff5b952f1 in __cxxabiv1::__cxa_throw (obj=0x7fff76af7500, tinfo=0x7ffff5cfb1c0 <typeinfo for std::runtime_error>, dest=0x7ffff5baa2a0 <std::runtime_error::~runtime_error()>) at ../../../../libstdc++-v3/libsupc++/eh_throw.cc:81
81	../../../../libstdc++-v3/libsupc++/eh_throw.cc: No such file or directory.
#0  0x00007ffff5b952f1 in __cxxabiv1::__cxa_throw (obj=0x7fff76af7500, tinfo=0x7ffff5cfb1c0 <typeinfo for std::runtime_error>, dest=0x7ffff5baa2a0 <std::runtime_error::~runtime_error()>) at ../../../../libstdc++-v3/libsupc++/eh_throw.cc:81
#1  0x00007fff7599e678 in RooBatchCompute::AVX2::(anonymous namespace)::fillArrays(std::vector<RooBatchCompute::AVX2::Batch, std::allocator<RooBatchCompute::AVX2::Batch> >&, std::vector<std::__ROOT::span<double const>, std::allocator<std::__ROOT::span<double const> > > const&, double*) [clone .constprop.0] [clone .cold] () from /cvmfs/cms-ci.cern.ch/week1/PR_6055da59/el8_amd64_gcc12/lcg/root/6.31.01-f7c240024014fc3e300562505a592d06/lib/libRooBatchCompute_AVX2.so
#2  0x00007fff7599f620 in std::_Function_handler<void (unsigned int), ROOT::TThreadExecutor::MapImpl<RooBatchCompute::AVX2::RooBatchComputeClass::compute(RooBatchCompute::Config const&, RooBatchCompute::Computer, double*, unsigned long, std::vector<std::__ROOT::span<double const>, std::allocator<std::__ROOT::span<double const> > > const&, std::vector<double, std::allocator<double> >&)::{lambda(unsigned long)#1}, unsigned long, void>(RooBatchCompute::AVX2::RooBatchComputeClass::compute(RooBatchCompute::Config const&, RooBatchCompute::Computer, double*, unsigned long, std::vector<std::__ROOT::span<double const>, std::allocator<std::__ROOT::span<double const> > > const&, std::vector<double, std::allocator<double> >&)::{lambda(unsigned long)#1}, std::vector<unsigned long, std::allocator<unsigned long> >&)::{lambda(unsigned int)#1}>::_M_invoke(std::_Any_data const&, unsigned int&&) () from /cvmfs/cms-ci.cern.ch/week1/PR_6055da59/el8_amd64_gcc12/lcg/root/6.31.01-f7c240024014fc3e300562505a592d06/lib/libRooBatchCompute_AVX2.so
#3  0x00007ffff5157b8c in tbb::detail::d1::start_for<tbb::detail::d1::blocked_range<unsigned int>, tbb::detail::d1::parallel_for_body_wrapper<std::function<void (unsigned int)>, unsigned int>, tbb::detail::d1::auto_partitioner const>::execute(tbb::detail::d1::execution_data&) () from /data/cmsbld/shift/CMSSW_14_1_ROOT6_X_2024-02-19-2300/external/el8_amd64_gcc12/lib/libImt.so
#4  0x00007ffff63f6281 in tbb::detail::r1::task_dispatcher::local_wait_for_all<false, tbb::detail::r1::external_waiter> (waiter=..., t=<optimized out>, this=0x7ffff3b6b700) at /data/cmsbld/jenkins/workspace/auto-builds/CMSSW_14_0_0_pre2_SKYLAKEAVX512-el8_amd64_gcc12/build/CMSSW_14_0_0_pre2_SKYLAKEAVX512-build/BUILD/el8_amd64_gcc12/external/tbb/v2021.9.0-5109e373398eaf79a8268d6a86a2f6e2/tbb-v2021.9.0/src/tbb/task_dispatcher.h:322
#5  tbb::detail::r1::task_dispatcher::local_wait_for_all<tbb::detail::r1::external_waiter> (waiter=..., t=<optimized out>, this=0x7ffff3b6b700) at /data/cmsbld/jenkins/workspace/auto-builds/CMSSW_14_0_0_pre2_SKYLAKEAVX512-el8_amd64_gcc12/build/CMSSW_14_0_0_pre2_SKYLAKEAVX512-build/BUILD/el8_amd64_gcc12/external/tbb/v2021.9.0-5109e373398eaf79a8268d6a86a2f6e2/tbb-v2021.9.0/src/tbb/task_dispatcher.h:458
#6  tbb::detail::r1::task_dispatcher::execute_and_wait (t=<optimized out>, wait_ctx=..., w_ctx=...) at /data/cmsbld/jenkins/workspace/auto-builds/CMSSW_14_0_0_pre2_SKYLAKEAVX512-el8_amd64_gcc12/build/CMSSW_14_0_0_pre2_SKYLAKEAVX512-build/BUILD/el8_amd64_gcc12/external/tbb/v2021.9.0-5109e373398eaf79a8268d6a86a2f6e2/tbb-v2021.9.0/src/tbb/task_dispatcher.cpp:168
#7  0x00007ffff5156bb3 in tbb::detail::d1::task_arena_function<ROOT::TThreadExecutor::ParallelFor(unsigned int, unsigned int, unsigned int, std::function<void (unsigned int)> const&)::{lambda()#1}::operator()() const::{lambda()#1}, void>::operator()() const () from /data/cmsbld/shift/CMSSW_14_1_ROOT6_X_2024-02-19-2300/external/el8_amd64_gcc12/lib/libImt.so
#8  0x00007ffff63e328e in operator() (__closure=<optimized out>) at /data/cmsbld/jenkins/workspace/auto-builds/CMSSW_14_0_0_pre2_SKYLAKEAVX512-el8_amd64_gcc12/build/CMSSW_14_0_0_pre2_SKYLAKEAVX512-build/BUILD/el8_amd64_gcc12/external/tbb/v2021.9.0-5109e373398eaf79a8268d6a86a2f6e2/tbb-v2021.9.0/src/tbb/arena.cpp:757
#9  tbb::detail::d0::try_call_proxy<tbb::detail::r1::isolate_within_arena(tbb::detail::d1::delegate_base&, intptr_t)::<lambda()> >::on_completion<tbb::detail::r1::isolate_within_arena(tbb::detail::d1::delegate_base&, intptr_t)::<lambda()> > (on_completion_body=..., this=<optimized out>) at /data/cmsbld/jenkins/workspace/auto-builds/CMSSW_14_0_0_pre2_SKYLAKEAVX512-el8_amd64_gcc12/build/CMSSW_14_0_0_pre2_SKYLAKEAVX512-build/BUILD/el8_amd64_gcc12/external/tbb/v2021.9.0-5109e373398eaf79a8268d6a86a2f6e2/tbb-v2021.9.0/src/tbb/../../include/oneapi/tbb/detail/_template_helpers.h:230
#10 tbb::detail::r1::isolate_within_arena (d=..., isolation=<optimized out>) at /data/cmsbld/jenkins/workspace/auto-builds/CMSSW_14_0_0_pre2_SKYLAKEAVX512-el8_amd64_gcc12/build/CMSSW_14_0_0_pre2_SKYLAKEAVX512-build/BUILD/el8_amd64_gcc12/external/tbb/v2021.9.0-5109e373398eaf79a8268d6a86a2f6e2/tbb-v2021.9.0/src/tbb/arena.cpp:758
#11 0x00007ffff5155493 in tbb::detail::d1::task_arena_function<ROOT::TThreadExecutor::ParallelFor(unsigned int, unsigned int, unsigned int, std::function<void (unsigned int)> const&)::{lambda()#1}, void>::operator()() const () from /data/cmsbld/shift/CMSSW_14_1_ROOT6_X_2024-02-19-2300/external/el8_amd64_gcc12/lib/libImt.so
#12 0x00007ffff63e29ad in tbb::detail::r1::task_arena_impl::execute (ta=..., d=...) at /data/cmsbld/jenkins/workspace/auto-builds/CMSSW_14_0_0_pre2_SKYLAKEAVX512-el8_amd64_gcc12/build/CMSSW_14_0_0_pre2_SKYLAKEAVX512-build/BUILD/el8_amd64_gcc12/external/tbb/v2021.9.0-5109e373398eaf79a8268d6a86a2f6e2/tbb-v2021.9.0/src/tbb/arena.cpp:688
#13 0x00007ffff5157199 in ROOT::TThreadExecutor::ParallelFor(unsigned int, unsigned int, unsigned int, std::function<void (unsigned int)> const&) () from /data/cmsbld/shift/CMSSW_14_1_ROOT6_X_2024-02-19-2300/external/el8_amd64_gcc12/lib/libImt.so
#14 0x00007fff7599fa35 in std::vector<std::invoke_result<RooBatchCompute::AVX2::RooBatchComputeClass::compute(RooBatchCompute::Config const&, RooBatchCompute::Computer, double*, unsigned long, std::vector<std::__ROOT::span<double const>, std::allocator<std::__ROOT::span<double const> > > const&, std::vector<double, std::allocator<double> >&)::{lambda(unsigned long)#1}, unsigned long>::type, std::allocator<std::invoke_result<RooBatchCompute::AVX2::RooBatchComputeClass::compute(RooBatchCompute::Config const&, RooBatchCompute::Computer, double*, unsigned long, std::vector<std::__ROOT::span<double const>, std::allocator<std::__ROOT::span<double const> > > const&, std::vector<double, std::allocator<double> >&)::{lambda(unsigned long)#1}, unsigned long>::type> > ROOT::TThreadExecutor::MapImpl<RooBatchCompute::AVX2::RooBatchComputeClass::compute(RooBatchCompute::Config const&, RooBatchCompute::Computer, double*, unsigned long, std::vector<std::__ROOT::span<double const>, std::allocator<std::__ROOT::span<double const> > > const&, std::vector<double, std::allocator<double> >&)::{lambda(unsigned long)#1}, unsigned long, void>(RooBatchCompute::AVX2::RooBatchComputeClass::compute(RooBatchCompute::Config const&, RooBatchCompute::Computer, double*, unsigned long, std::vector<std::__ROOT::span<double const>, std::allocator<std::__ROOT::span<double const> > > const&, std::vector<double, std::allocator<double> >&)::{lambda(unsigned long)#1}, std::vector<unsigned long, std::allocator<unsigned long> >&) () from /cvmfs/cms-ci.cern.ch/week1/PR_6055da59/el8_amd64_gcc12/lcg/root/6.31.01-f7c240024014fc3e300562505a592d06/lib/libRooBatchCompute_AVX2.so
#15 0x00007fff759a295c in RooBatchCompute::AVX2::RooBatchComputeClass::compute(RooBatchCompute::Config const&, RooBatchCompute::Computer, double*, unsigned long, std::vector<std::__ROOT::span<double const>, std::allocator<std::__ROOT::span<double const> > > const&, std::vector<double, std::allocator<double> >&) () from /cvmfs/cms-ci.cern.ch/week1/PR_6055da59/el8_amd64_gcc12/lcg/root/6.31.01-f7c240024014fc3e300562505a592d06/lib/libRooBatchCompute_AVX2.so
#16 0x00007fffa3a6ef54 in RooBreitWigner::computeBatch(double*, unsigned long, RooFit::Detail::DataMap const&) const () from /data/cmsbld/shift/CMSSW_14_1_ROOT6_X_2024-02-19-2300/external/el8_amd64_gcc12/lib/libRooFit.so
#17 0x00007fffa3560181 in RooFit::Evaluator::run() () from /data/cmsbld/shift/CMSSW_14_1_ROOT6_X_2024-02-19-2300/external/el8_amd64_gcc12/lib/libRooFitCore.so
#18 0x00007fffa353a5c5 in RooEvaluatorWrapper::getValV(RooArgSet const*) const () from /data/cmsbld/shift/CMSSW_14_1_ROOT6_X_2024-02-19-2300/external/el8_amd64_gcc12/lib/libRooFitCore.so
#19 0x00007fffa35e6daa in RooMinimizerFcn::operator()(double const*) const () from /data/cmsbld/shift/CMSSW_14_1_ROOT6_X_2024-02-19-2300/external/el8_amd64_gcc12/lib/libRooFitCore.so
#20 0x00007ffff74bd1ef in ROOT::Math::Functor::DoEval(double const*) const () from /data/cmsbld/shift/CMSSW_14_1_ROOT6_X_2024-02-19-2300/external/el8_amd64_gcc12/lib/libMathCore.so
#21 0x00007fffa302540e in ROOT::Minuit2::MnUserFcn::operator()(ROOT::Minuit2::LAVector const&) const () from /data/cmsbld/shift/CMSSW_14_1_ROOT6_X_2024-02-19-2300/external/el8_amd64_gcc12/lib/libMinuit2.so
#22 0x00007fffa3021883 in ROOT::Minuit2::MnSeedGenerator::operator()(ROOT::Minuit2::MnFcn const&, ROOT::Minuit2::GradientCalculator const&, ROOT::Minuit2::MnUserParameterState const&, ROOT::Minuit2::MnStrategy const&) const () from /data/cmsbld/shift/CMSSW_14_1_ROOT6_X_2024-02-19-2300/external/el8_amd64_gcc12/lib/libMinuit2.so
#23 0x00007fffa302cd40 in ROOT::Minuit2::ModularFunctionMinimizer::Minimize(ROOT::Minuit2::FCNBase const&, ROOT::Minuit2::MnUserParameterState const&, ROOT::Minuit2::MnStrategy const&, unsigned int, double) const () from /data/cmsbld/shift/CMSSW_14_1_ROOT6_X_2024-02-19-2300/external/el8_amd64_gcc12/lib/libMinuit2.so
#24 0x00007fffa2fed0f5 in ROOT::Minuit2::Minuit2Minimizer::Minimize() () from /data/cmsbld/shift/CMSSW_14_1_ROOT6_X_2024-02-19-2300/external/el8_amd64_gcc12/lib/libMinuit2.so
#25 0x00007ffff7517f5e in ROOT::Fit::Fitter::DoMinimization(ROOT::Math::IBaseFunctionMultiDimTempl<double> const*) () from /data/cmsbld/shift/CMSSW_14_1_ROOT6_X_2024-02-19-2300/external/el8_amd64_gcc12/lib/libMathCore.so
#26 0x00007fffa35e2736 in RooMinimizer::minimize(char const*, char const*) () from /data/cmsbld/shift/CMSSW_14_1_ROOT6_X_2024-02-19-2300/external/el8_amd64_gcc12/lib/libRooFitCore.so
#27 0x00007fffa3402046 in RooFit::FitHelpers::minimize(RooAbsReal&, RooAbsReal&, RooAbsData const&, RooCmdConfig const&) () from /data/cmsbld/shift/CMSSW_14_1_ROOT6_X_2024-02-19-2300/external/el8_amd64_gcc12/lib/libRooFitCore.so
#28 0x00007fffa3409cc3 in RooFit::FitHelpers::fitTo(RooAbsReal&, RooAbsData&, RooLinkedList const&, bool) () from /data/cmsbld/shift/CMSSW_14_1_ROOT6_X_2024-02-19-2300/external/el8_amd64_gcc12/lib/libRooFitCore.so
#29 0x00007fffa34710cc in RooAbsPdf::fitToImpl(RooAbsData&, RooLinkedList const&) () from /data/cmsbld/shift/CMSSW_14_1_ROOT6_X_2024-02-19-2300/external/el8_amd64_gcc12/lib/libRooFitCore.so
#30 0x00007fffa3c86255 in PhotonDataCertification::invMassZtest(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, TString, dqm::implementation::IGetter&) () from /data/cmsbld/shift/CMSSW_14_1_ROOT6_X_2024-02-19-2300/lib/el8_amd64_gcc12/pluginDQMOfflineEGammaPlugins.so
#31 0x00007fffa3c86712 in PhotonDataCertification::dqmEndJob(dqm::implementation::IBooker&, dqm::implementation::IGetter&) () from /data/cmsbld/shift/CMSSW_14_1_ROOT6_X_2024-02-19-2300/lib/el8_amd64_gcc12/pluginDQMOfflineEGammaPlugins.so
#32 0x00007fffa3c546f9 in non-virtual thunk to DQMEDHarvester::endProcessBlockProduce(edm::ProcessBlock&) () from /data/cmsbld/shift/CMSSW_14_1_ROOT6_X_2024-02-19-2300/lib/el8_amd64_gcc12/pluginDQMOfflineEGammaPlugins.so
#33 0x00007ffff7cd617b in edm::one::EDProducerBase::doEndProcessBlock(edm::ProcessBlockPrincipal const&, edm::ModuleCallingContext const*) () from /data/cmsbld/shift/CMSSW_14_1_ROOT6_X_2024-02-19-2300/lib/el8_amd64_gcc12/libFWCoreFramework.so
#34 0x00007ffff7cc0440 in edm::WorkerT<edm::one::EDProducerBase>::implDoEndProcessBlock(edm::ProcessBlockPrincipal const&, edm::ModuleCallingContext const*) () from /data/cmsbld/shift/CMSSW_14_1_ROOT6_X_2024-02-19-2300/lib/el8_amd64_gcc12/libFWCoreFramework.so
#35 0x00007ffff7c13f32 in std::__exception_ptr::exception_ptr edm::Worker::runModuleAfterAsyncPrefetch<edm::OccurrenceTraits<edm::ProcessBlockPrincipal, (edm::BranchActionType)3> >(std::__exception_ptr::exception_ptr, edm::OccurrenceTraits<edm::ProcessBlockPrincipal, (edm::BranchActionType)3>::TransitionInfoType const&, edm::StreamID, edm::ParentContext const&, edm::OccurrenceTraits<edm::ProcessBlockPrincipal, (edm::BranchActionType)3>::Context const*) () from /data/cmsbld/shift/CMSSW_14_1_ROOT6_X_2024-02-19-2300/lib/el8_amd64_gcc12/libFWCoreFramework.so
#36 0x00007ffff7c177fe in edm::SerialTaskQueue::QueuedTask<edm::SerialTaskQueueChain::push<edm::Worker::RunModuleTask<edm::OccurrenceTraits<edm::ProcessBlockPrincipal, (edm::BranchActionType)3> >::execute()::{lambda()#1}&>(tbb::detail::d1::task_group&, edm::Worker::RunModuleTask<edm::OccurrenceTraits<edm::ProcessBlockPrincipal, (edm::BranchActionType)3> >::execute()::{lambda()#1}&)::{lambda()#1}>::execute() () from /data/cmsbld/shift/CMSSW_14_1_ROOT6_X_2024-02-19-2300/lib/el8_amd64_gcc12/libFWCoreFramework.so
#37 0x00007ffff79a31d0 in tbb::detail::d1::function_task<edm::SerialTaskQueue::spawn(edm::SerialTaskQueue::TaskBase&)::{lambda()#1}>::execute(tbb::detail::d1::execution_data&) () from /cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02825/el8_amd64_gcc12/cms/cmssw/CMSSW_14_1_ROOT6_X_2024-02-18-2300/lib/el8_amd64_gcc12/libFWCoreConcurrency.so
#38 0x00007ffff63f6281 in tbb::detail::r1::task_dispatcher::local_wait_for_all<false, tbb::detail::r1::external_waiter> (waiter=..., t=<optimized out>, this=0x7ffff3b6be00) at /data/cmsbld/jenkins/workspace/auto-builds/CMSSW_14_0_0_pre2_SKYLAKEAVX512-el8_amd64_gcc12/build/CMSSW_14_0_0_pre2_SKYLAKEAVX512-build/BUILD/el8_amd64_gcc12/external/tbb/v2021.9.0-5109e373398eaf79a8268d6a86a2f6e2/tbb-v2021.9.0/src/tbb/task_dispatcher.h:322
#39 tbb::detail::r1::task_dispatcher::local_wait_for_all<tbb::detail::r1::external_waiter> (waiter=..., t=<optimized out>, this=0x7ffff3b6be00) at /data/cmsbld/jenkins/workspace/auto-builds/CMSSW_14_0_0_pre2_SKYLAKEAVX512-el8_amd64_gcc12/build/CMSSW_14_0_0_pre2_SKYLAKEAVX512-build/BUILD/el8_amd64_gcc12/external/tbb/v2021.9.0-5109e373398eaf79a8268d6a86a2f6e2/tbb-v2021.9.0/src/tbb/task_dispatcher.h:458
#40 tbb::detail::r1::task_dispatcher::execute_and_wait (t=<optimized out>, wait_ctx=..., w_ctx=...) at /data/cmsbld/jenkins/workspace/auto-builds/CMSSW_14_0_0_pre2_SKYLAKEAVX512-el8_amd64_gcc12/build/CMSSW_14_0_0_pre2_SKYLAKEAVX512-build/BUILD/el8_amd64_gcc12/external/tbb/v2021.9.0-5109e373398eaf79a8268d6a86a2f6e2/tbb-v2021.9.0/src/tbb/task_dispatcher.cpp:168
#41 0x00007ffff7bd5ceb in edm::FinalWaitingTask::wait() () from /data/cmsbld/shift/CMSSW_14_1_ROOT6_X_2024-02-19-2300/lib/el8_amd64_gcc12/libFWCoreFramework.so
#42 0x00007ffff7bdacbb in edm::EventProcessor::endProcessBlock(bool, bool) () from /data/cmsbld/shift/CMSSW_14_1_ROOT6_X_2024-02-19-2300/lib/el8_amd64_gcc12/libFWCoreFramework.so
#43 0x00007ffff7bdfc91 in edm::EventProcessor::runToCompletion() () from /data/cmsbld/shift/CMSSW_14_1_ROOT6_X_2024-02-19-2300/lib/el8_amd64_gcc12/libFWCoreFramework.so
#44 0x00000000004074ef in tbb::detail::d1::task_arena_function<main::{lambda()#1}::operator()() const::{lambda()#1}, void>::operator()() const ()
#45 0x00007ffff63e29ad in tbb::detail::r1::task_arena_impl::execute (ta=..., d=...) at /data/cmsbld/jenkins/workspace/auto-builds/CMSSW_14_0_0_pre2_SKYLAKEAVX512-el8_amd64_gcc12/build/CMSSW_14_0_0_pre2_SKYLAKEAVX512-build/BUILD/el8_amd64_gcc12/external/tbb/v2021.9.0-5109e373398eaf79a8268d6a86a2f6e2/tbb-v2021.9.0/src/tbb/arena.cpp:688
#46 0x0000000000408ed2 in main::{lambda()#1}::operator()() const ()
#47 0x000000000040517c in main ()

Thread 1 "cmsRun" hit Catchpoint 1 (exception thrown), 0x00007ffff5b952f1 in __cxxabiv1::__cxa_throw (obj=0x7fff76a3e980, tinfo=0x7ffff7999610 <typeinfo for edm::Exception>, dest=0x7ffff7963010 <edm::Exception::~Exception()>) at ../../../../libstdc++-v3/libsupc++/eh_throw.cc:81
81	in ../../../../libstdc++-v3/libsupc++/eh_throw.cc
#0  0x00007ffff5b952f1 in __cxxabiv1::__cxa_throw (obj=0x7fff76a3e980, tinfo=0x7ffff7999610 <typeinfo for edm::Exception>, dest=0x7ffff7963010 <edm::Exception::~Exception()>) at ../../../../libstdc++-v3/libsupc++/eh_throw.cc:81
#1  0x00007ffff795d50d in edm::convertException::stdToEDM(std::exception const&) [clone .cold] () from /cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02825/el8_amd64_gcc12/cms/cmssw/CMSSW_14_1_ROOT6_X_2024-02-18-2300/lib/el8_amd64_gcc12/libFWCoreUtilities.so
#2  0x00007ffff7b9c0df in std::__exception_ptr::exception_ptr edm::Worker::runModuleAfterAsyncPrefetch<edm::OccurrenceTraits<edm::ProcessBlockPrincipal, (edm::BranchActionType)3> >(std::__exception_ptr::exception_ptr, edm::OccurrenceTraits<edm::ProcessBlockPrincipal, (edm::BranchActionType)3>::TransitionInfoType const&, edm::StreamID, edm::ParentContext const&, edm::OccurrenceTraits<edm::ProcessBlockPrincipal, (edm::BranchActionType)3>::Context const*) [clone .cold] () from /data/cmsbld/shift/CMSSW_14_1_ROOT6_X_2024-02-19-2300/lib/el8_amd64_gcc12/libFWCoreFramework.so
#3  0x00007ffff7c177fe in edm::SerialTaskQueue::QueuedTask<edm::SerialTaskQueueChain::push<edm::Worker::RunModuleTask<edm::OccurrenceTraits<edm::ProcessBlockPrincipal, (edm::BranchActionType)3> >::execute()::{lambda()#1}&>(tbb::detail::d1::task_group&, edm::Worker::RunModuleTask<edm::OccurrenceTraits<edm::ProcessBlockPrincipal, (edm::BranchActionType)3> >::execute()::{lambda()#1}&)::{lambda()#1}>::execute() () from /data/cmsbld/shift/CMSSW_14_1_ROOT6_X_2024-02-19-2300/lib/el8_amd64_gcc12/libFWCoreFramework.so
#4  0x00007ffff79a31d0 in tbb::detail::d1::function_task<edm::SerialTaskQueue::spawn(edm::SerialTaskQueue::TaskBase&)::{lambda()#1}>::execute(tbb::detail::d1::execution_data&) () from /cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02825/el8_amd64_gcc12/cms/cmssw/CMSSW_14_1_ROOT6_X_2024-02-18-2300/lib/el8_amd64_gcc12/libFWCoreConcurrency.so
#5  0x00007ffff63f6281 in tbb::detail::r1::task_dispatcher::local_wait_for_all<false, tbb::detail::r1::external_waiter> (waiter=..., t=<optimized out>, this=0x7ffff3b6be00) at /data/cmsbld/jenkins/workspace/auto-builds/CMSSW_14_0_0_pre2_SKYLAKEAVX512-el8_amd64_gcc12/build/CMSSW_14_0_0_pre2_SKYLAKEAVX512-build/BUILD/el8_amd64_gcc12/external/tbb/v2021.9.0-5109e373398eaf79a8268d6a86a2f6e2/tbb-v2021.9.0/src/tbb/task_dispatcher.h:322
#6  tbb::detail::r1::task_dispatcher::local_wait_for_all<tbb::detail::r1::external_waiter> (waiter=..., t=<optimized out>, this=0x7ffff3b6be00) at /data/cmsbld/jenkins/workspace/auto-builds/CMSSW_14_0_0_pre2_SKYLAKEAVX512-el8_amd64_gcc12/build/CMSSW_14_0_0_pre2_SKYLAKEAVX512-build/BUILD/el8_amd64_gcc12/external/tbb/v2021.9.0-5109e373398eaf79a8268d6a86a2f6e2/tbb-v2021.9.0/src/tbb/task_dispatcher.h:458
#7  tbb::detail::r1::task_dispatcher::execute_and_wait (t=<optimized out>, wait_ctx=..., w_ctx=...) at /data/cmsbld/jenkins/workspace/auto-builds/CMSSW_14_0_0_pre2_SKYLAKEAVX512-el8_amd64_gcc12/build/CMSSW_14_0_0_pre2_SKYLAKEAVX512-build/BUILD/el8_amd64_gcc12/external/tbb/v2021.9.0-5109e373398eaf79a8268d6a86a2f6e2/tbb-v2021.9.0/src/tbb/task_dispatcher.cpp:168
#8  0x00007ffff7bd5ceb in edm::FinalWaitingTask::wait() () from /data/cmsbld/shift/CMSSW_14_1_ROOT6_X_2024-02-19-2300/lib/el8_amd64_gcc12/libFWCoreFramework.so
#9  0x00007ffff7bdacbb in edm::EventProcessor::endProcessBlock(bool, bool) () from /data/cmsbld/shift/CMSSW_14_1_ROOT6_X_2024-02-19-2300/lib/el8_amd64_gcc12/libFWCoreFramework.so
#10 0x00007ffff7bdfc91 in edm::EventProcessor::runToCompletion() () from /data/cmsbld/shift/CMSSW_14_1_ROOT6_X_2024-02-19-2300/lib/el8_amd64_gcc12/libFWCoreFramework.so
#11 0x00000000004074ef in tbb::detail::d1::task_arena_function<main::{lambda()#1}::operator()() const::{lambda()#1}, void>::operator()() const ()
#12 0x00007ffff63e29ad in tbb::detail::r1::task_arena_impl::execute (ta=..., d=...) at /data/cmsbld/jenkins/workspace/auto-builds/CMSSW_14_0_0_pre2_SKYLAKEAVX512-el8_amd64_gcc12/build/CMSSW_14_0_0_pre2_SKYLAKEAVX512-build/BUILD/el8_amd64_gcc12/external/tbb/v2021.9.0-5109e373398eaf79a8268d6a86a2f6e2/tbb-v2021.9.0/src/tbb/arena.cpp:688
#13 0x0000000000408ed2 in main::{lambda()#1}::operator()() const ()
#14 0x000000000040517c in main ()

@makortel
Copy link
Contributor

Thanks @iarspider. For the TAxis::SetRangeUser() warning I opened an issue cms-sw/cmssw#44062 because the proper action wasn't immediately clear to me.

@makortel
Copy link
Contributor

Regarding the

----- Begin Fatal Exception 20-Feb-2024 23:38:35 CET-----------------------
An exception of category 'StdException' occurred while
   [0] Processing end ProcessBlock
   [1] Calling method for module PhotonDataCertification/'photonDataCertification'
Exception Message:
A std::exception was thrown.
The span number 0 passed to Batches::Batches() is empty!
----- End Fatal Exception -------------------------------------------------

error could maybe @guitargeek be able to advice? #9025 (comment) shows a strack trace for the message.

@iarspider
Copy link
Contributor Author

please test for CMSSW_14_1_ROOT6_X

@cmsbuild
Copy link
Contributor

-1

Failed Tests: UnitTests RelVals
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-5f67dc/37634/summary.html
COMMIT: 1543064
CMSSW: CMSSW_14_1_ROOT6_X_2024-02-22-2300/el8_amd64_gcc12
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmsdist/9025/37634/install.sh to create a dev area with all the needed externals and cmssw changes.

Unit Tests

I found 2 errors in the following unit tests:

---> test materialBudgetTrackerPlots had ERRORS
---> test materialBudgetHGCalPlots had ERRORS

RelVals

----- Begin Fatal Exception 23-Feb-2024 16:41:53 CET-----------------------
An exception of category 'StdException' occurred while
   [0] Processing end ProcessBlock
   [1] Calling method for module PhotonDataCertification/'photonDataCertification'
Exception Message:
A std::exception was thrown.
The span number 0 passed to Batches::Batches() is empty!
----- End Fatal Exception -------------------------------------------------
----- Begin Fatal Exception 23-Feb-2024 16:46:12 CET-----------------------
An exception of category 'StdException' occurred while
   [0] Processing end ProcessBlock
   [1] Calling method for module PhotonDataCertification/'photonDataCertification'
Exception Message:
A std::exception was thrown.
The span number 0 passed to Batches::Batches() is empty!
----- End Fatal Exception -------------------------------------------------
----- Begin Fatal Exception 23-Feb-2024 16:50:04 CET-----------------------
An exception of category 'StdException' occurred while
   [0] Processing end ProcessBlock
   [1] Calling method for module PhotonDataCertification/'photonDataCertification'
Exception Message:
A std::exception was thrown.
The span number 0 passed to Batches::Batches() is empty!
----- End Fatal Exception -------------------------------------------------

@iarspider
Copy link
Contributor Author

@guitargeek looks like that fix was not enough.

@guitargeek
Copy link

Yes, indeed I overlooked something (the fact that the fit is done in a subrange, and we need to check if there are no entries in the fit range, not the full histogram).

I have updated the PR, can you maybe test again? Thanks a lot!

@iarspider
Copy link
Contributor Author

please test for CMSSW_14_1_ROOT6_X

@cmsbuild
Copy link
Contributor

-1

Failed Tests: UnitTests
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-5f67dc/37649/summary.html
COMMIT: 1543064
CMSSW: CMSSW_14_1_ROOT6_X_2024-02-23-2300/el8_amd64_gcc12
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmsdist/9025/37649/install.sh to create a dev area with all the needed externals and cmssw changes.

Unit Tests

I found 2 errors in the following unit tests:

---> test materialBudgetTrackerPlots had ERRORS
---> test materialBudgetHGCalPlots had ERRORS

Comparison Summary

Summary:

guitargeek added a commit to guitargeek/root that referenced this pull request Feb 25, 2024
As we discovered in a CMSSW ROOT `master` sync PR, the new RooFit CPU
backend treats empty datasets differently from the legacy NLL evaluation
backend:
cms-sw/cmsdist#9025

This commit is fixing this, in particular removing the assumption that
datasets used for fits with the new CPU backend are never empty.

A unit test that validates the behavior for empty data objects is also
added.
@guitargeek
Copy link

Ok, well it works but the slight differences in the logic now cause differences in the DQM. That's because the subrange that is used for these DQM fits doesn't align with any bin boundaries of the full histogram. In that case my new logic "snaps" to the nearest inclusive bins, and the old logic used some rebinning techniques internal to the Range() option.

In this circumstances, the workaround on the CMSSW side is not as trivial as I expected initially. I'll close my CMSSW PR and rather fix the underlying problem on the ROOT side:
root-project/root#14817

guitargeek added a commit to guitargeek/root that referenced this pull request Feb 25, 2024
As we discovered in a CMSSW ROOT `master` sync PR, the new RooFit CPU
backend treats empty datasets differently from the legacy NLL evaluation
backend:
cms-sw/cmsdist#9025

This commit is fixing this, in particular removing the assumption that
datasets used for fits with the new CPU backend are never empty.

A unit test that validates the behavior for empty data objects is also
added.
guitargeek added a commit to root-project/root that referenced this pull request Feb 26, 2024
As we discovered in a CMSSW ROOT `master` sync PR, the new RooFit CPU
backend treats empty datasets differently from the legacy NLL evaluation
backend:
cms-sw/cmsdist#9025

This commit is fixing this, in particular removing the assumption that
datasets used for fits with the new CPU backend are never empty.

A unit test that validates the behavior for empty data objects is also
added.
@iarspider
Copy link
Contributor Author

Closing in favor of #9034

@iarspider iarspider closed this Feb 27, 2024
kristupaspranc pushed a commit to kristupaspranc/root that referenced this pull request Apr 10, 2024
As we discovered in a CMSSW ROOT `master` sync PR, the new RooFit CPU
backend treats empty datasets differently from the legacy NLL evaluation
backend:
cms-sw/cmsdist#9025

This commit is fixing this, in particular removing the assumption that
datasets used for fits with the new CPU backend are never empty.

A unit test that validates the behavior for empty data objects is also
added.
lobis pushed a commit to lobis/root that referenced this pull request Apr 10, 2024
As we discovered in a CMSSW ROOT `master` sync PR, the new RooFit CPU
backend treats empty datasets differently from the legacy NLL evaluation
backend:
cms-sw/cmsdist#9025

This commit is fixing this, in particular removing the assumption that
datasets used for fits with the new CPU backend are never empty.

A unit test that validates the behavior for empty data objects is also
added.
kristupaspranc pushed a commit to kristupaspranc/root that referenced this pull request May 21, 2024
As we discovered in a CMSSW ROOT `master` sync PR, the new RooFit CPU
backend treats empty datasets differently from the legacy NLL evaluation
backend:
cms-sw/cmsdist#9025

This commit is fixing this, in particular removing the assumption that
datasets used for fits with the new CPU backend are never empty.

A unit test that validates the behavior for empty data objects is also
added.
silverweed pushed a commit to silverweed/root that referenced this pull request Aug 19, 2024
As we discovered in a CMSSW ROOT `master` sync PR, the new RooFit CPU
backend treats empty datasets differently from the legacy NLL evaluation
backend:
cms-sw/cmsdist#9025

This commit is fixing this, in particular removing the assumption that
datasets used for fits with the new CPU backend are never empty.

A unit test that validates the behavior for empty data objects is also
added.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants