Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Tune scan by key for SM90 #121

Merged
merged 1 commit into from
Jun 28, 2023
Merged

Tune scan by key for SM90 #121

merged 1 commit into from
Jun 28, 2023

Conversation

gevtushenko
Copy link
Collaborator

HBM3

KeyT \ ValueT I8 I16 I32 I64 I128
I8 -30% -18% -20% -13% -47%
I16 -19% -19% -19% -13% -47%
I32 -15% -19% -14% -13% -54%
I64 -13% -15% -14% -11% -47%
I128 -26% -26% -25% -22% -54%
F32 -15% -20% -15% -14% -54%
F64 -11% -15% -14% -12% -47%
C64 -12% -15% -14% -11% -47%
KeyT{ct} ValueT{ct} OffsetT{ct} Elements{io} Cmp Noise %Diff
I8 I8 I32 2^16 2.16% -7.69%
I8 I8 I32 2^20 1.62% -1.76%
I8 I8 I32 2^24 0.99% -25.14%
I8 I8 I32 2^28 0.26% -30.01%
I8 I16 I32 2^16 2.54% 5.35%
I8 I16 I32 2^20 1.64% 1.62%
I8 I16 I32 2^24 1.16% -12.38%
I8 I16 I32 2^28 0.35% -17.75%
I8 I32 I32 2^16 2.35% 1.27%
I8 I32 I32 2^20 1.84% 5.05%
I8 I32 I32 2^24 1.25% -15.93%
I8 I32 I32 2^28 0.48% -20.70%
I8 I64 I32 2^16 2.78% -1.16%
I8 I64 I32 2^20 1.80% -0.87%
I8 I64 I32 2^24 1.12% -10.02%
I8 I64 I32 2^28 0.27% -13.32%
I8 I128 I32 2^16 1.56% 3.92%
I8 I128 I32 2^20 1.27% -25.46%
I8 I128 I32 2^24 0.69% -44.30%
I8 I128 I32 2^28 0.19% -47.31%
I16 I8 I32 2^16 2.59% -5.20%
I16 I8 I32 2^20 2.06% 2.09%
I16 I8 I32 2^24 0.73% -15.76%
I16 I8 I32 2^28 0.20% -19.39%
I16 I16 I32 2^16 1.97% -2.16%
I16 I16 I32 2^20 1.60% 0.94%
I16 I16 I32 2^24 1.42% -14.30%
I16 I16 I32 2^28 0.50% -18.89%
I16 I32 I32 2^16 2.22% 4.56%
I16 I32 I32 2^20 1.69% 2.08%
I16 I32 I32 2^24 1.33% -13.92%
I16 I32 I32 2^28 0.47% -19.24%
I16 I64 I32 2^16 2.95% 0.36%
I16 I64 I32 2^20 1.60% -2.45%
I16 I64 I32 2^24 1.15% -10.62%
I16 I64 I32 2^28 0.26% -13.35%
I16 I128 I32 2^16 1.91% 6.23%
I16 I128 I32 2^20 1.33% -23.23%
I16 I128 I32 2^24 0.65% -43.73%
I16 I128 I32 2^28 0.16% -46.53%
I32 I8 I32 2^16 2.54% -3.36%
I32 I8 I32 2^20 1.65% 1.18%
I32 I8 I32 2^24 1.21% -11.96%
I32 I8 I32 2^28 0.41% -14.67%
I32 I16 I32 2^16 2.73% -0.56%
I32 I16 I32 2^20 1.52% 0.64%
I32 I16 I32 2^24 1.22% -13.67%
I32 I16 I32 2^28 0.50% -18.89%
I32 I32 I32 2^16 2.17% 6.19%
I32 I32 I32 2^20 1.58% 1.70%
I32 I32 I32 2^24 0.97% -6.36%
I32 I32 I32 2^28 0.25% -14.40%
I32 I64 I32 2^16 1.91% 7.07%
I32 I64 I32 2^20 1.81% 0.13%
I32 I64 I32 2^24 0.88% -8.34%
I32 I64 I32 2^28 0.14% -13.36%
I32 I128 I32 2^16 1.53% 1.24%
I32 I128 I32 2^20 1.40% -31.44%
I32 I128 I32 2^24 0.60% -50.90%
I32 I128 I32 2^28 0.15% -53.62%
I64 I8 I32 2^16 2.20% -6.30%
I64 I8 I32 2^20 2.02% 1.80%
I64 I8 I32 2^24 0.84% -10.29%
I64 I8 I32 2^28 0.30% -13.07%
I64 I16 I32 2^16 2.26% -7.41%
I64 I16 I32 2^20 1.74% -2.54%
I64 I16 I32 2^24 1.16% -11.35%
I64 I16 I32 2^28 0.33% -14.58%
I64 I32 I32 2^16 2.14% -0.93%
I64 I32 I32 2^20 1.74% 4.11%
I64 I32 I32 2^24 0.98% -10.50%
I64 I32 I32 2^28 0.21% -13.44%
I64 I64 I32 2^16 2.29% -3.13%
I64 I64 I32 2^20 1.59% -2.93%
I64 I64 I32 2^24 0.89% -7.76%
I64 I64 I32 2^28 0.17% -10.57%
I64 I128 I32 2^16 1.60% -4.67%
I64 I128 I32 2^20 2.01% -23.44%
I64 I128 I32 2^24 0.57% -44.78%
I64 I128 I32 2^28 0.15% -47.05%
I128 I8 I32 2^16 2.51% -1.34%
I128 I8 I32 2^20 1.68% -8.51%
I128 I8 I32 2^24 1.01% -21.70%
I128 I8 I32 2^28 0.24% -25.62%
I128 I16 I32 2^16 2.13% -1.37%
I128 I16 I32 2^20 1.54% -13.56%
I128 I16 I32 2^24 0.99% -22.28%
I128 I16 I32 2^28 0.21% -26.23%
I128 I32 I32 2^16 2.61% -1.53%
I128 I32 I32 2^20 1.56% -12.10%
I128 I32 I32 2^24 0.77% -21.53%
I128 I32 I32 2^28 0.14% -24.88%
I128 I64 I32 2^16 2.30% -0.23%
I128 I64 I32 2^20 2.18% -0.45%
I128 I64 I32 2^24 0.79% -19.74%
I128 I64 I32 2^28 0.19% -21.83%
I128 I128 I32 2^16 1.62% 0.56%
I128 I128 I32 2^20 1.55% -30.43%
I128 I128 I32 2^24 0.55% -51.87%
I128 I128 I32 2^28 0.14% -54.09%
F32 I8 I32 2^16 2.46% -4.11%
F32 I8 I32 2^20 1.85% -0.06%
F32 I8 I32 2^24 1.17% -12.33%
F32 I8 I32 2^28 0.39% -14.85%
F32 I16 I32 2^16 2.48% 3.15%
F32 I16 I32 2^20 1.44% -1.51%
F32 I16 I32 2^24 1.20% -14.26%
F32 I16 I32 2^28 0.50% -19.58%
F32 I32 I32 2^16 2.04% 6.18%
F32 I32 I32 2^20 1.76% 2.03%
F32 I32 I32 2^24 0.97% -6.70%
F32 I32 I32 2^28 0.27% -14.72%
F32 I64 I32 2^16 2.33% 6.70%
F32 I64 I32 2^20 1.72% -0.07%
F32 I64 I32 2^24 0.88% -8.69%
F32 I64 I32 2^28 0.15% -13.62%
F32 I128 I32 2^16 2.05% 2.94%
F32 I128 I32 2^20 1.30% -30.63%
F32 I128 I32 2^24 0.61% -50.98%
F32 I128 I32 2^28 0.14% -53.79%
F64 I8 I32 2^16 2.31% -2.70%
F64 I8 I32 2^20 1.72% 3.49%
F64 I8 I32 2^24 0.84% -8.66%
F64 I8 I32 2^28 0.27% -10.99%
F64 I16 I32 2^16 2.35% -5.54%
F64 I16 I32 2^20 1.64% -1.15%
F64 I16 I32 2^24 1.22% -11.45%
F64 I16 I32 2^28 0.35% -14.81%
F64 I32 I32 2^16 2.34% 0.89%
F64 I32 I32 2^20 1.82% 5.70%
F64 I32 I32 2^24 1.00% -10.52%
F64 I32 I32 2^28 0.21% -13.81%
F64 I64 I32 2^16 2.44% -2.30%
F64 I64 I32 2^20 1.60% -3.09%
F64 I64 I32 2^24 0.88% -8.75%
F64 I64 I32 2^28 0.19% -11.81%
F64 I128 I32 2^16 1.83% -4.22%
F64 I128 I32 2^20 2.02% -23.11%
F64 I128 I32 2^24 0.58% -44.96%
F64 I128 I32 2^28 0.15% -47.27%
C64 I8 I32 2^16 2.37% -3.52%
C64 I8 I32 2^20 1.83% 4.14%
C64 I8 I32 2^24 0.84% -9.06%
C64 I8 I32 2^28 0.29% -12.19%
C64 I16 I32 2^16 2.49% -2.12%
C64 I16 I32 2^20 1.55% 0.52%
C64 I16 I32 2^24 1.19% -11.10%
C64 I16 I32 2^28 0.32% -14.66%
C64 I32 I32 2^16 1.92% 3.31%
C64 I32 I32 2^20 1.80% 7.21%
C64 I32 I32 2^24 0.96% -10.24%
C64 I32 I32 2^28 0.20% -13.60%
C64 I64 I32 2^16 2.22% 1.61%
C64 I64 I32 2^20 1.71% 0.26%
C64 I64 I32 2^24 0.90% -7.28%
C64 I64 I32 2^28 0.19% -10.49%
C64 I128 I32 2^16 1.77% 2.48%
C64 I128 I32 2^20 2.08% -22.97%
C64 I128 I32 2^24 0.59% -44.73%
C64 I128 I32 2^28 0.15% -46.99%

HBM2e

KeyT \ ValueT I8 I16 I32 I64 I128
I8 -32% -16% -12% -9% -39%
I16 -20% -17% -12% -8% -38%
I32 -15% -10% -7% -8% -45%
I64 -12% -7% -6% -4% -38%
I128 -13% -12% -13% -12% -45%
F32 -15% -11% -8% -8% -45%
F64 -11% -7% -6% -5% -38%
C64 -11% -7% -6% -4% -38%
KeyT{ct} ValueT{ct} OffsetT{ct} Elements{io} Cmp Noise %Diff
I8 I8 I32 2^16 1.85% -6.56%
I8 I8 I32 2^20 1.62% 0.15%
I8 I8 I32 2^24 0.74% -27.53%
I8 I8 I32 2^28 0.44% -31.73%
I8 I16 I32 2^16 1.68% 5.56%
I8 I16 I32 2^20 1.26% 2.18%
I8 I16 I32 2^24 0.93% -10.68%
I8 I16 I32 2^28 0.50% -16.49%
I8 I32 I32 2^16 2.30% 3.06%
I8 I32 I32 2^20 1.28% 11.01%
I8 I32 I32 2^24 0.93% -11.93%
I8 I32 I32 2^28 0.66% -11.56%
I8 I64 I32 2^16 2.03% 1.84%
I8 I64 I32 2^20 1.17% -0.56%
I8 I64 I32 2^24 1.02% -6.79%
I8 I64 I32 2^28 0.50% -8.70%
I8 I128 I32 2^16 1.38% 3.47%
I8 I128 I32 2^20 1.61% -22.13%
I8 I128 I32 2^24 0.66% -37.83%
I8 I128 I32 2^28 0.19% -38.78%
I16 I8 I32 2^16 2.67% -6.31%
I16 I8 I32 2^20 1.58% 6.42%
I16 I8 I32 2^24 0.61% -16.77%
I16 I8 I32 2^28 0.36% -19.75%
I16 I16 I32 2^16 1.59% 2.26%
I16 I16 I32 2^20 1.09% -1.23%
I16 I16 I32 2^24 1.37% -12.73%
I16 I16 I32 2^28 0.70% -17.18%
I16 I32 I32 2^16 1.70% 4.18%
I16 I32 I32 2^20 1.10% 3.35%
I16 I32 I32 2^24 1.25% -11.20%
I16 I32 I32 2^28 0.58% -11.40%
I16 I64 I32 2^16 1.82% -2.02%
I16 I64 I32 2^20 1.23% -0.30%
I16 I64 I32 2^24 1.04% -6.79%
I16 I64 I32 2^28 0.50% -8.26%
I16 I128 I32 2^16 1.94% 9.00%
I16 I128 I32 2^20 1.37% -20.80%
I16 I128 I32 2^24 0.67% -37.06%
I16 I128 I32 2^28 0.18% -38.12%
I32 I8 I32 2^16 2.19% -3.79%
I32 I8 I32 2^20 1.32% 0.28%
I32 I8 I32 2^24 0.95% -11.69%
I32 I8 I32 2^28 0.54% -14.90%
I32 I16 I32 2^16 2.28% 1.75%
I32 I16 I32 2^20 1.29% 2.52%
I32 I16 I32 2^24 1.09% -11.07%
I32 I16 I32 2^28 0.68% -9.82%
I32 I32 I32 2^16 1.89% 8.57%
I32 I32 I32 2^20 1.02% 2.89%
I32 I32 I32 2^24 1.11% -5.18%
I32 I32 I32 2^28 0.50% -7.01%
I32 I64 I32 2^16 1.71% 9.72%
I32 I64 I32 2^20 1.02% 1.87%
I32 I64 I32 2^24 0.95% -5.46%
I32 I64 I32 2^28 0.50% -7.97%
I32 I128 I32 2^16 1.43% 3.70%
I32 I128 I32 2^20 1.37% -26.44%
I32 I128 I32 2^24 0.60% -43.68%
I32 I128 I32 2^28 0.14% -44.84%
I64 I8 I32 2^16 2.25% -3.60%
I64 I8 I32 2^20 1.54% 2.60%
I64 I8 I32 2^24 0.64% -9.31%
I64 I8 I32 2^28 0.62% -12.03%
I64 I16 I32 2^16 2.50% -4.68%
I64 I16 I32 2^20 1.68% 0.15%
I64 I16 I32 2^24 1.34% -7.75%
I64 I16 I32 2^28 0.54% -7.17%
I64 I32 I32 2^16 1.74% -0.12%
I64 I32 I32 2^20 1.21% 6.00%
I64 I32 I32 2^24 1.09% -4.65%
I64 I32 I32 2^28 0.50% -6.00%
I64 I64 I32 2^16 2.05% -0.79%
I64 I64 I32 2^20 0.85% -1.03%
I64 I64 I32 2^24 0.95% -3.24%
I64 I64 I32 2^28 0.50% -4.28%
I64 I128 I32 2^16 1.43% -0.50%
I64 I128 I32 2^20 1.57% -21.23%
I64 I128 I32 2^24 0.57% -37.56%
I64 I128 I32 2^28 0.16% -38.22%
I128 I8 I32 2^16 1.94% 1.30%
I128 I8 I32 2^20 1.48% -1.07%
I128 I8 I32 2^24 1.21% -13.63%
I128 I8 I32 2^28 0.50% -12.71%
I128 I16 I32 2^16 1.95% 1.09%
I128 I16 I32 2^20 1.69% -5.25%
I128 I16 I32 2^24 1.04% -11.80%
I128 I16 I32 2^28 0.50% -11.57%
I128 I32 I32 2^16 1.69% 1.82%
I128 I32 I32 2^20 0.88% -8.07%
I128 I32 I32 2^24 0.86% -9.96%
I128 I32 I32 2^28 0.40% -12.38%
I128 I64 I32 2^16 1.77% 4.84%
I128 I64 I32 2^20 1.42% -2.86%
I128 I64 I32 2^24 0.80% -10.48%
I128 I64 I32 2^28 0.24% -11.59%
I128 I128 I32 2^16 2.03% 3.20%
I128 I128 I32 2^20 1.27% -26.40%
I128 I128 I32 2^24 0.52% -43.73%
I128 I128 I32 2^28 0.13% -44.75%
F32 I8 I32 2^16 2.15% -7.91%
F32 I8 I32 2^20 1.44% -3.33%
F32 I8 I32 2^24 0.89% -12.17%
F32 I8 I32 2^28 0.53% -14.81%
F32 I16 I32 2^16 2.16% 0.37%
F32 I16 I32 2^20 1.12% -2.07%
F32 I16 I32 2^24 1.08% -12.18%
F32 I16 I32 2^28 0.68% -10.40%
F32 I32 I32 2^16 1.87% 2.26%
F32 I32 I32 2^20 1.19% -0.55%
F32 I32 I32 2^24 1.13% -5.70%
F32 I32 I32 2^28 0.51% -7.20%
F32 I64 I32 2^16 1.99% 4.33%
F32 I64 I32 2^20 1.05% -0.92%
F32 I64 I32 2^24 0.94% -5.89%
F32 I64 I32 2^28 0.50% -8.18%
F32 I128 I32 2^16 1.46% 2.46%
F32 I128 I32 2^20 1.24% -26.84%
F32 I128 I32 2^24 0.62% -43.75%
F32 I128 I32 2^28 0.14% -44.92%
F64 I8 I32 2^16 2.03% -4.06%
F64 I8 I32 2^20 1.51% 2.77%
F64 I8 I32 2^24 0.68% -8.16%
F64 I8 I32 2^28 0.61% -11.42%
F64 I16 I32 2^16 2.04% -4.70%
F64 I16 I32 2^20 1.24% -2.20%
F64 I16 I32 2^24 1.67% -7.64%
F64 I16 I32 2^28 0.56% -6.98%
F64 I32 I32 2^16 1.86% -2.63%
F64 I32 I32 2^20 1.12% 4.88%
F64 I32 I32 2^24 1.08% -5.02%
F64 I32 I32 2^28 0.50% -6.23%
F64 I64 I32 2^16 2.67% -4.96%
F64 I64 I32 2^20 1.00% -2.30%
F64 I64 I32 2^24 0.92% -3.92%
F64 I64 I32 2^28 0.50% -4.88%
F64 I128 I32 2^16 1.62% -0.46%
F64 I128 I32 2^20 1.58% -22.47%
F64 I128 I32 2^24 0.57% -37.77%
F64 I128 I32 2^28 0.14% -38.38%
C64 I8 I32 2^16 3.10% -6.33%
C64 I8 I32 2^20 1.63% 4.84%
C64 I8 I32 2^24 0.65% -7.99%
C64 I8 I32 2^28 0.63% -11.39%
C64 I16 I32 2^16 2.14% -4.71%
C64 I16 I32 2^20 1.10% -0.18%
C64 I16 I32 2^24 1.36% -7.43%
C64 I16 I32 2^28 0.55% -7.00%
C64 I32 I32 2^16 1.44% -0.84%
C64 I32 I32 2^20 1.17% 4.54%
C64 I32 I32 2^24 1.10% -4.87%
C64 I32 I32 2^28 0.50% -6.09%
C64 I64 I32 2^16 1.85% -2.97%
C64 I64 I32 2^20 0.92% -2.87%
C64 I64 I32 2^24 0.96% -3.42%
C64 I64 I32 2^28 0.50% -4.22%
C64 I128 I32 2^16 1.57% -2.90%
C64 I128 I32 2^20 1.56% -21.56%
C64 I128 I32 2^24 0.60% -37.50%
C64 I128 I32 2^28 0.14% -38.15%

@gevtushenko gevtushenko merged commit abec065 into NVIDIA:monorepo Jun 28, 2023
356 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@elstehle elstehle elstehle approved these changes

Assignees
No one assigned
Labels
None yet
Projects
CCCL
Archived in project
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@gevtushenko @elstehle