Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Fix] fix mmpose regression codec sdk export #1684

Merged
merged 1 commit into from
Jan 31, 2023

Conversation

irexyc
Copy link
Collaborator

@irexyc irexyc commented Jan 30, 2023

Motivation

fix #1677

@irexyc irexyc added the bug Something isn't working label Jan 30, 2023
@lvhan028
Copy link
Collaborator

Which models can be tested?

@lvhan028
Copy link
Collaborator

isort lint issue will be resolved in #1685

@irexyc
Copy link
Collaborator Author

irexyc commented Jan 31, 2023

@RunningLeon
Copy link
Collaborator

@irexyc It seems that there is no regression model in supported models. BTW, tested and the sdk result is not aligned with pytorch.

python tools/deploy.py \
configs/mmpose/pose-detection_tensorrt_static-256x192.py \
../mmpose/configs/body_2d_keypoint/topdown_regression/coco/td-reg_mobilenetv2_rle-pretrained-8xb64-210e_coco-256x192.py \
https://download.openmmlab.com/mmpose/v1/body_2d_keypoint/topdown_regression/coco/td-reg_mobilenetv2_rle-pretrained-8xb64-210e_coco-256x192-39b73bd5_20220922.pth \
demo/resources/human-pose.jpg \
--work-dir ./work_dir \
--device cuda --dump-info
python tools/test.py \
configs/mmpose/pose-detection_sdk_static-256x192.py \
../mmpose/configs/body_2d_keypoint/topdown_regression/coco/td-reg_mobilenetv2_rle-pretrained-8xb64-210e_coco-256x192.py \
--model  ./work_dir  --device cuda --work-dir ./work_dir

results

Loading and preparing results...
DONE (t=4.88s)
creating index...
index created!
Running per image evaluation...
Evaluate annotation type *keypoints*
DONE (t=12.42s).
Accumulating evaluation results...
DONE (t=0.53s).
 Average Precision  (AP) @[ IoU=0.50:0.95 | area=   all | maxDets= 20 ] =  0.000
 Average Precision  (AP) @[ IoU=0.50      | area=   all | maxDets= 20 ] =  0.000
 Average Precision  (AP) @[ IoU=0.75      | area=   all | maxDets= 20 ] =  0.000
 Average Precision  (AP) @[ IoU=0.50:0.95 | area=medium | maxDets= 20 ] =  0.000
 Average Precision  (AP) @[ IoU=0.50:0.95 | area= large | maxDets= 20 ] =  0.000
 Average Recall     (AR) @[ IoU=0.50:0.95 | area=   all | maxDets= 20 ] =  0.001
 Average Recall     (AR) @[ IoU=0.50      | area=   all | maxDets= 20 ] =  0.002
 Average Recall     (AR) @[ IoU=0.75      | area=   all | maxDets= 20 ] =  0.001
 Average Recall     (AR) @[ IoU=0.50:0.95 | area=medium | maxDets= 20 ] =  0.001
 Average Recall     (AR) @[ IoU=0.50:0.95 | area= large | maxDets= 20 ] =  0.002
01/31 04:03:48 - mmengine - INFO - Epoch(test) [104125/104125]  coco/AP: 0.0000  coco/AP .5: 0.0000  coco/AP .75: 0.0000  coco/AP (M): 0.0000  coco/AP (L): 0.0000  coco/AR: 0.0011  coco/AR .5: 0.0019  coco/AR .75: 0.0011  coco/AR (M): 0.0007  coco/AR (L): 0.0016

@irexyc
Copy link
Collaborator Author

irexyc commented Jan 31, 2023

It seems that there is no regression model in supported models. BTW, tested and the sdk result is not aligned >with pytorch.

The wrong result is because when predict, RLEHead add sigmoid layer at the end.

@RunningLeon
Copy link
Collaborator

Copy link
Collaborator

@RunningLeon RunningLeon left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@lvhan028
Copy link
Collaborator

It seems that there is no regression model in supported models. BTW, tested and the sdk result is not aligned >with pytorch.

The wrong result is because when predict, RLEHead add sigmoid layer at the end.

Let's resolve it in another PR

Copy link
Collaborator

@lvhan028 lvhan028 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@lvhan028 lvhan028 merged commit a19cf64 into open-mmlab:dev-1.x Jan 31, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants