HIGH: [Tracking] Implement report NextSteps in Auth

[mountiny]

Whatsnext post here.

Design doc https://docs.google.com/document/d/1gUDVqDdDj0jVOIuFBqPr0D6-vnClB-iztl38PzsiBqE/edit

GH Project https://github.com/orgs/Expensify/projects/154/views/1
CAP issue https://github.com/Expensify/Expensify/issues/406189

Proposal
Migrate the report next steps from PHP to Auth

Problem
Report next steps are currently calculated on the fly in PHP and are not stored in a database. This means that any commands using report next steps cannot be implemented following the true 1:1:1 API philosophy at the moment. We cannot queue report next steps updates in Auth because we must wait for an Auth command response to trigger the calculation of updated next steps in PHP. Only then can the update be pushed to relevant clients.

Similar to the case of violations, this leads to multiple Auth calls being made during a single API request, breaking the 1:1:1 rule. Many commands are slowed down due to the report next steps computation triggering multiple Auth calls. For example, any action that changes the state or status of a report will trigger a new next step computation. These may be computed multiple times per report as each participant of the expense report might receive different next steps.

It's worth noting that in order to support optimistic and offline calculation of some report next steps, we've implemented the core collect workspace next steps logic in the front-end code of NewDot.

While this project should only focus on migrating what we have from PHP to Auth, it is important to note that this migration is likely to be critical for ensuring that important upcoming projects are 1:1:1-compliant, such as the Search page, where we need to compute the next action for a report efficiently.

Solution
At a high level, the solution is to move report next steps to Auth; however, the details need to be fleshed out through predesign and a design document.

At minimum, we should discuss:

• The exact scope of this project.
• The deadline and priority of this project among others.
• How we are going to execute this migration from PHP to Auth to avoid any regressions in OldDot.
• Whether we should keep the report next steps in their own Onyx reportNextSteps key or add them as a key inside the report object.
• How we are going to coordinate with the violations migration that is related to this project (we need to be able to compute report violations to determine report next steps).
• How the timelines for the report next steps audit and this project will align.

cc @JmillsExpensify @cead22

---

Tasks

• Post Proposal (full Problem/Solution statement) in #whatsnext
• Wait at least one full business day, and until the post has a majority (2/3) of positive reactions (👍)
• Paste Proposal in the space above with a link to the Slack thread
• Email strategy@expensify.com and paste in the Proposal
• Host a pre-design meeting (example) in an appropriate slack channel to discuss any necessary details in public before filling out the High-level of proposed solution section.
• Fill out the High-level overview of the problem, Timeline, Terminology, and High-level of proposed solution sections of the Design Doc
• Email strategy@expensify.com (continue the same email chain as before - your last message should be the WN Proposal) with the link to your Design Doc containing your high-level problem and solution
• Add the DesignDocReview label to get the High-level overview of the problem and High-level of proposed solution section reviewed
• Respond to any questions or concerns and bring up blockers in Slack to get a consensus if necessary
• Confirm that the doc has the minimum necessary number of reviews before proceeding
• Host another pre-design meeting in the appropriate slack channel to ask for engineering feedback on the technical solution.
• Fill out the Detailed implementation of the solution and related sections.
• Re-add the DesignDocReview label to this issue
• Respond to any questions or concerns and bring up blockers in Slack to get consensus if necessary
• Confirm that the doc has the minimum necessary number of reviews before proceeding
• Email strategy@expensify.com one last time to let them know the Design Doc is moving into the implementation phase
• Implement the changes
• Add regression tests so that QA can test your feature with every deploy (instructions)
• Send out a follow up email to strategy@expensify.com once everything has been implemented and do a Project Wrap-Up retrospective that provides:
  • Summary of what we accomplished with this project
  • What went well?
  • What could we have done better?
  • What did we learn?

Issue Owner

Current Issue Owner: @dangrous

[mountiny]

Shared in WN https://expensify.slack.com/archives/CC7NECV4L/p1715644599860159

[muttmuure]

Moving this to critical to include it in the daily updates

[mountiny]

The proposal got enough support so we can move ahead. I will plan to make a short predesign for this project, but my week is broken up with moving stuff from Scotland to Czechia and short planned holiday. I expect to make more progress next week, but I will attempt to have the predesign out by EOW, early next week the latest.

[melvin-bot]

@mountiny Uh oh! This issue is overdue by 2 days. Don't forget to update your issues!

[mountiny]

Gonna pick this back up this week once the performance is in better place

[mountiny]

Looking into a predesign for tomorrow

[mountiny]

Deployer duties took over, still on my list

[mountiny]

The predesign was posted on Friday, going to sum it up to the doc this week

[mountiny]

Aiming for EOW still

[mountiny]

Violations doc is out, I havent made much progress yet on this, but will ship this on Monday

[melvin-bot]

@mountiny Whoops! This issue is 2 days overdue. Let's get this updated quick!

[mountiny]

Working on the high level still, aiming to have it mostly ready today

[dangrous]

I... have not had time. Next week for sure! I think this will be a bit slow even once I get started since there's a lot of moving pieces

[dangrous]

okay! starting to look into this again. I need to remember how far I got before and then go from there

[dangrous]

this is proceeding, discussing what we want to do about translations (which may change our approach) in this issue

[mountiny]

@dangrous is working through the detailed section and the increased scope with translations

[dangrous]

still prioritizing copilot, that will be launched on mon and can focus more on this then, if not before

[melvin-bot]

@dangrous, @mountiny Eep! 4 days overdue now. Issues have feelings too...

[dangrous]

predesign for a couple pieces of this will be going out tomorrow, then can continue work

[dangrous]

https://expensify.slack.com/archives/C05CBC62HGW/p1726247710654929

[melvin-bot]

@dangrous Uh oh! This issue is overdue by 2 days. Don't forget to update your issues!

[dangrous]

WIll start updating design doc based on predesign shortly!

[dangrous]

Got some good further discussion on the predesign, I'll be restructuring the design doc and should be out by EOnextW - that's the plan anyway

[dangrous]

Okay chill melvin, will have time to start mapping this out again this afternoon!