Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support two tables join PPL command #2950

Open
wants to merge 4 commits into
base: main
Choose a base branch
from

Conversation

LantaoJin
Copy link
Member

@LantaoJin LantaoJin commented Aug 29, 2024

Description

This PR is the part 1 of supporting native join command. Check #2913 to get the whole implementation plan.
This PR includes

  • In logical, support two-tables join PPL command with join type inner join, left join, semi join and anti join.
  • In physical, support hash join operator for equi-join, nested loop join operator for non-equi-join

This PR not includes

Syntax introduced in this PR

source=t1 | [joinType] JOIN t2 ON joinCriteria

joinType: INNER | LEFT [OUTER] | [LEFT] SEMI | [LEFT] ANTI

For example:

source=websites
| inner join access_log on websites.id=access_log.site_id
| fields websites.id, websites.name, access_log.count, access_log.date

source=websites
| left outer join access_log on id=site_id
| fields id, name, count, date

Related Issues

Resolves #2920 (part of #2913)

Check List

  • New functionality includes testing.
  • New functionality has been documented.
  • New functionality has javadoc added.
  • New functionality has a user manual doc added.
  • API changes companion pull request created.
  • Commits are signed per the DCO using --signoff.
  • Public documentation issue/PR created.

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

Signed-off-by: Lantao Jin <ltjin@amazon.com>
Signed-off-by: Lantao Jin <ltjin@amazon.com>
Signed-off-by: Lantao Jin <ltjin@amazon.com>
@LantaoJin
Copy link
Member Author

Current PR is ready for fundamental discussion. It contains basic implementation and unit tests.
Integration tests and full test coverage hasn't been done.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
1 participant