deployment.md

简体中文 | English

Inference

How to convert dygraph model to static model?

To infer and deploy a model, we need export an inference model, or called to_static: convert dygraph model to static model, at first.

python3.7 tools/export_model.py -c config_file -o output_path -p params_file

Note: In export_model.py, It will build a model again, and then loading the prarams. But some init params in the infer phase is different from the train phase. we add num_seg for TSM in advanced, please add more params or modify them if it is necessary. please refer to official documents for more information.

How to test the export model?

PaddleVideo supports a test script to test the exported model.

python3.7 tools/test_export_model.py -p params_file -i inference_folder -c config_file

We just print the output shape, please feel free to extend it. Avtually, only test a video file by PaddleInference can make sure the exported model is right.

How to use PaddleInference?

PaddleVideo supports tools/predict.py to infer

python3.7 tools/predict.py -v example.avi --model_file "./inference/example.pdmodel" --params_file "./inference/example.pdiparams" --enable_benchmark=False --model="example" --num_seg=8

How to test inference speed?

PaddleVideo support a script to test inference speed

python3.7 tools/predict.py --enable_benchmark=True --model_file=模型文件 --params_file=参数文件

How to use C++ infer?

^{coming soon}

Deployment

How to use PaddleHub Serving deploy?

^{coming soon}

How to use PaddleLite deploy?

^{coming soon}