We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
使用Relative Position后显存占用明显增加是什么原因呢?
The text was updated successfully, but these errors were encountered:
Relative Position embedding占用的显存就是比绝对位置编码多的。一个长度为5的序列,相对位置编码就有5x5个embedding,每个token要保存该token和其余所有token的相对位置编码。
Sorry, something went wrong.
No branches or pull requests
使用Relative Position后显存占用明显增加是什么原因呢?
The text was updated successfully, but these errors were encountered: