How to convert to onxx/tensorRT?

[zhenyi1998]

Has anyone managed to convert? I am trying to improve the speed of the model, much appreciated!

[Mohammadakhavan75]

Hello,

I've been having trouble converting this model to ONNX, but I think I've narrowed down the problem to line 189 of the spiga/model/spiga.py file. In this line, the tensor is reshaped, which causes problems during the conversion to ONNX. This is because ONNX needs to know the exact shape of each variable (tensor) in order to create a graph. The reshape operation prevents ONNX from knowing the exact shape of the tensor, which causes the conversion to fail.