Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[CSE 276F Submission] PushT-v1 #378

Merged
merged 23 commits into from
Jun 15, 2024
Merged

Conversation

Xander-Hinrichsen
Copy link
Collaborator

@Xander-Hinrichsen Xander-Hinrichsen commented Jun 11, 2024

PushT from diffusion policy digital twin

Created PandaStick agent
Fully batched calculation for T block intersection area with goal T area, zero explicit loops

Support for ur5e robot is a todo for true twinness
Wristcam attached to PandaStick is a todo for visual based RL/IL

ppo args (consistent learning):
python ppo.py --env_id="PushT-v1" --exp-name="final_run" --num_envs=1024 --update_epochs=8 --num_minibatches=32 --total_timesteps=55_000_000 --eval_freq=8 --num-steps=100 --num_eval_steps=100 --gamma=0.99

@Xander-Hinrichsen
Copy link
Collaborator Author

@StoneT2000 , could I request a review on this PR please?
Thank you!

@StoneT2000 StoneT2000 self-requested a review June 11, 2024 21:50
Copy link
Member

@StoneT2000 StoneT2000 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nice work, would love to get this merged in, just see the comments. ppo works fast as well.

@Xander-Hinrichsen
Copy link
Collaborator Author

@StoneT2000 , I've made the changes. Let me know if there are any more issues

Copy link
Member

@StoneT2000 StoneT2000 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

only some small issues with comments left but i will fix that myself. This looks good to merge

@StoneT2000 StoneT2000 merged commit 799d0c3 into haosulab:main Jun 15, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants