Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

AUC bug report #355

Open
jeffzhengye opened this issue Jan 19, 2021 · 0 comments
Open

AUC bug report #355

jeffzhengye opened this issue Jan 19, 2021 · 0 comments

Comments

@jeffzhengye
Copy link

In ESMM, it seems there is a bug in auc computation. When there is no positive example in a batch, this batch is ignored for the auc computation. We cannot just simply remove this batch from computation, which is different from the auc caculation in tensorflow.

In my opinion, auc should be computed globally, insteady of averaging locally like in x-deeplearning. The all-negative batch can still change the number of FP globally, which cannot be ignored.

This bug makes the performance of esmm pretty high.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant