Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[CustomOp]Remove paddle_custom_op dynamic libraries, and link to FLUID_CORE on Windows #32583

Merged
merged 5 commits into from
May 7, 2021

Conversation

zhwesky2010
Copy link
Contributor

@zhwesky2010 zhwesky2010 commented Apr 26, 2021

PR types

New features

PR changes

OPs

Describe

移除旧的paddle_custom_op动态库生成过程,并在Windows上复用到已有的core动态库

paddle_custom_op动态库存在两个问题:

  1. paddle_custom_op动态库core动态库,两个动态库会存在全局instance冲突,例如op_info_map;
  2. 通过python进行初始化的一些单例instance,例如deviceContextPool,只有通过import paddle后才会初始并存在于core动态库里,那么paddle_custom_op动态库将会缺失这种类型的instance,导致某些功能无法使用。

这些问题在Unix、Windows均会存在,因此需要复用core动态库,该PR调整了Windows动态库的设计,使用Windows软链+硬链的组合方式给用户提供core动态库的链接方式,是#31976 的后续。

@zhwesky2010 zhwesky2010 changed the title Remove paddle_custom_op dynamic libraries, and link to FLUID_CORE on windows Remove paddle_custom_op dynamic libraries, and link to FLUID_CORE on Windows Apr 26, 2021
@paddle-bot-old
Copy link

Thanks for your contribution!
Please wait for the result of CI firstly. See Paddle CI Manual for details.

@zhwesky2010 zhwesky2010 force-pushed the fix_windows_customop branch 3 times, most recently from 469a64b to c060331 Compare April 30, 2021 09:36
Copy link
Contributor

@chenwhql chenwhql left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@zhwesky2010 zhwesky2010 merged commit 7610c2b into PaddlePaddle:develop May 7, 2021
zhwesky2010 added a commit to zhwesky2010/Paddle that referenced this pull request May 7, 2021
…Windows (PaddlePaddle#32583)

* Remove paddle_custom_op dynamic libraries, change link to FLUID_CORE on windows, and check copy_to

* fix CI
lanxianghit pushed a commit that referenced this pull request May 7, 2021
…to FLUID_CORE on windows (#32583) (#32769)

* Remove paddle_custom_op dynamic libraries, change link to FLUID_CORE on windows, and check copy_to

* fix CI
@zhwesky2010 zhwesky2010 changed the title Remove paddle_custom_op dynamic libraries, and link to FLUID_CORE on Windows [CustomOp]Remove paddle_custom_op dynamic libraries, and link to FLUID_CORE on Windows Sep 28, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants