Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Check domains automatically #361

Open
scripthunter7 opened this issue Jul 4, 2023 · 2 comments
Open

Check domains automatically #361

scripthunter7 opened this issue Jul 4, 2023 · 2 comments

Comments

@scripthunter7
Copy link
Member

scripthunter7 commented Jul 4, 2023

Workflow:

  1. Extract domains from adblock filtering rules to a set with AGTree
    • For example, extract
      • example.com from example.com###banner or
      • example.net from /ads.js^$domain=example.net or
      • example.org from ||example.org/test, etc.
  2. Send a request to the domain and check the following:
    • does the request timeout?
    • is there a network error?
    • is the request redirected to a different domain?
  3. Creating a scheduled GH actions workflow
    • call this workflow every week
    • it is enough to give a warning for potentially problematic domains, as the result of the check script requires a human review
@scripthunter7
Copy link
Member Author

@ehrhardt06 Please note that we cannot check here the case if the content of the page changes to some random domain seller or other content, as the domaion and the website technically works in this case

@scripthunter7
Copy link
Member Author

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant