Refactor Task List and filters with error handlers for Scheduler

[Rieven]

Changes

Task list can be found at:

• "Tasks" in main menu

• OOI detail page

• Boefje Detail page

• When scheduler client is offline, throw a ConnectionError and catch it to show message in rocky.

• Add more task details for when task fetching fails/success, or (re)scheduling task fails, or get task failures. (plugin + OOI)

Issue link

#1955

Closes #1955

How's everything related?

sequenceDiagram
    SchedulerView->>+SchedulerClient: Get task list
    SchedulerClient->>+Scheduler: Get task list
    Scheduler->>+SchedulerClient: throws: ConnectError, HTTPError, etc..
    SchedulerClient->>+SchedulerView: Django message
    SchedulerView->>+SchedulerClient: Schedule task
    SchedulerClient->>+Scheduler: Schedule task
    Scheduler->>+SchedulerClient: throws: ConnectError, HTTPError, etc..
    SchedulerClient->>+SchedulerView: Django message
    SchedulerView->>+SchedulerClient: Re-schedule task
    SchedulerClient->>+Scheduler: Re-schedule task
    Scheduler->>+SchedulerClient: throws: ConnectError, HTTPError, etc..
    SchedulerClient->>+SchedulerView: Django message
    SchedulerView->>+SchedulerClient: Run Boefje
    SchedulerClient->>+Scheduler: Run Boefje
    Scheduler->>+SchedulerClient: throws: ConnectError, HTTPError, etc..
    SchedulerClient->>+SchedulerView: Django message
    SchedulerView->>+SchedulerClient: Run Normalizer
    SchedulerClient->>+Scheduler: Run Normalizer
    Scheduler->>+SchedulerClient: throws: ConnectError, HTTPError, etc..
    SchedulerClient->>+SchedulerView: Django message
    

Loading

Proof

Errors will be redirected to the health page:

Code Checklist

• All the commits in this PR are properly PGP-signed and verified;
• This PR only contains functionality relevant to the issue; tickets have been created for newly discovered issues.
• I have written unit tests for the changes or fixes I made.
• For any non-trivial functionality, I have added integration and/or end-to-end tests.
• I have performed a self-review of my code and refactored it to the best of my abilities.

Communication

• I have informed others of any required .env changes files if required and changed the .env-dist accordingly.
• I have made corresponding changes to the documentation, if necessary.

---

Checklist for code reviewers:

Copy-paste the checklist from the docs/source/templates folder into your comment.

---

Checklist for QA:

Copy-paste the checklist from the docs/source/templates folder into your comment.

[ammar92]

Can be improved. Tests are failing, and there are errors in return types. Moreover, there is a mix of type annotation styles (e.g. Optional[None] vs ... | None), so these should be rewritten to keep consistency.

[stephanie0x00]

Checklist for QA:

• I have checked out this branch, and successfully ran a fresh make reset.
• I confirmed that there are no unintended functional regressions in this branch:
  • I have managed to pass the onboarding flow
  • Objects and Findings are created properly
  • Tasks are created and completed properly
• I confirmed that the PR's advertised feature or hotfix works as intended.

What works:

Error message is shown on the Tasks, Health checks, when opening a finding object, and on the 'See Details' page in the Katalogus. When enabling the scheduler again the error message disappears again.

What doesn't work:

n/a

Bug or feature?:

n/a

[stephanie0x00]

During QA the following issues were identified:

• DnsRecords boefje details page in Katalogus misses some data. A similar thing is happening for Dnssec and nmap TCP boefjes.
• Normalizer template file removed from PR, which prevents various detail pages from loading.

DnsRecords boefje details page in this branch:

On main:

Template file removed from PR

[stephanie0x00]

From QA perspective it looks good now. The pages that were not properly loading in the katalogus now work again. Can be merged after Review has approved the changes.

[Rieven]

From QA perspective it looks good now. The pages that were not properly loading in the katalogus now work again. Can be merged after Review has approved the changes.

One little thing I am fixing now is that the normalizer detail page is not showing the task list, but this I am fixing now, thanks!

hanging change request