Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support yolov8 pose estimation #20

Open
tonhathuy opened this issue Jun 7, 2024 · 1 comment
Open

Support yolov8 pose estimation #20

tonhathuy opened this issue Jun 7, 2024 · 1 comment

Comments

@tonhathuy
Copy link

Thank you, this project is great!
can I run this repo with yolov8 pose estimation? What do I have to adjust in the code to make it work?
thanks

@jveitchmichaelis
Copy link
Owner

jveitchmichaelis commented Jun 7, 2024

If you can export your model as an EdgeTPU file then you would need to add the post-processing code to convert the output into whatever format you expect the keypoints to be in. So the first step would be to run the model and inspect the output - if it's just a bunch of keypoints then you might not need to do much else. I guess minimally you have to re-scale the coordinates to the original image dimensions?

Currently there is no "support" for pose estimation, in that the repo was built for object detection (so there are a bunch of other post-processing steps like non-max suppression, coordinate scaling, etc). However the core code that takes an image and runs it through the EdgeTPU should work with your model. I'd be happy to merge a PR if you get it working and feel free to ask if you have questions about the code.

e.g. this function:

def forward(self, x:np.ndarray, with_nms=True) -> np.ndarray:

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants