New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Deal with 'Too Many Requests' #25

Open

wjdp opened this issue Nov 29, 2016 · 0 comments · May be fixed by #217

Owner

wjdp commented Nov 29, 2016

When we check a lot of external URLs quickly from the same host it may rate limit us.

Back off, wait, and retry when we get too many requests.

theunrepentantgeek linked a pull request

that will close this issue

Limit per-host concurrency and add retries #217

Open

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment