Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Questions on numerical results #23

Open
MouseHu opened this issue May 10, 2022 · 0 comments
Open

Questions on numerical results #23

MouseHu opened this issue May 10, 2022 · 0 comments

Comments

@MouseHu
Copy link

MouseHu commented May 10, 2022

Hi,
When reading the paper and checking issue #1 , I found that the numerical results in Appendix C&F are inconsistent with the provided expert scores. For example, in Figure 7, ICM with 10^5 pretraining on walker_walk has about 50% normalized score, and the numerical result in Table 5 is (302+-45). As the expert score is 971 mentioned in #1 , this is equivalent to about 31% normalized score. Did I miss something here? Also, it seems that the score for pretraining methods, in general, cannot compete with SOTA methods like CURL and DrQ, which do not require any pretraining. Is there any explanation for this? Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant