Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[v1.22.x]prov/efa: always use p2p for system memory #10397

Merged
merged 4 commits into from
Sep 19, 2024
Merged

[v1.22.x]prov/efa: always use p2p for system memory #10397

merged 4 commits into from
Sep 19, 2024

Commits on Sep 18, 2024

  1. [v1.22.x]prov/efa: copy user buffer for fi_sendmsg with FI_INJECT 

    Currently EFA provider doesn't handle the fi_sendmsg call with
FI_INJECT flags correctly. It allows user to pass in a buffer with
valid MR while doing inject - outbound buffer should be reusable
immediately after function returns.
That being said, without the inline HW support, EFA provider should
do a copy from the user buffer to the internal bounce buffer even
if application provides a valid MR for the buffer.

Signed-off-by: Jessie Yang <jiaxiyan@amazon.com>
(cherry picked from commit 22be7e0)
    @jiaxiyan
    jiaxiyan committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    ab7ab24 View commit details
    Browse the repository at this point in the history

  2. [v1.22.x]prov/efa: add device to host copy for inject rdma write 

    fi_writemsg with FI_INJECT needs to copy from outbound buffer to
internal bounce buffer. The outbound buffer can be non-system.
Extract and call a helper function for device to host copy.

Signed-off-by: Jessie Yang <jiaxiyan@amazon.com>
(cherry picked from commit 1b3fb77)
    @jiaxiyan
    jiaxiyan committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    cfdbe5c View commit details
    Browse the repository at this point in the history

  3. [v1.22.x]prov/efa: always use p2p for system memory 

    P2P is always available for host memory. Unregistered buffer will be
regarded as host memory as EFA provider requires FI_MR_HMEM.

Signed-off-by: Jessie Yang <jiaxiyan@amazon.com>
(cherry picked from commit b0af713)
    @jiaxiyan
    jiaxiyan committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    8268f6d View commit details
    Browse the repository at this point in the history

  4. [v1.22.x]prov/efa: rename p2p_available to mr_p2p_available 

    Rename to mr_p2p_available to indicate that we check the mr is not NULL.

Signed-off-by: Jessie Yang <jiaxiyan@amazon.com>
(cherry picked from commit 677bdeb)
    @jiaxiyan
    jiaxiyan committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    49c4b89 View commit details
    Browse the repository at this point in the history