Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix to #15873 - Query: Identifying columns in the case of distinct #21990

Merged
merged 1 commit into from
Sep 1, 2020

Conversation

maumar
Copy link
Contributor

@maumar maumar commented Aug 7, 2020

Added validation step for AddCollectionJoin which checks that if subquery contains Distinct or GroupBy, the projection contains all identifying columns needed to correctly bucket the results during materialization.
Also making sure that identifying columns can be correctly propagated during pushdown and joining - if they are not we mark them as such (by removing identifying columns altogether), so that we can throw exception when these columns are actually needed.

Fixes #15873
Fixes #20184

@maumar maumar requested a review from smitpatel August 7, 2020 23:31
@maumar maumar force-pushed the fix15873_take2 branch 4 times, most recently from 3658b71 to cc7ade7 Compare August 11, 2020 18:43
@maumar
Copy link
Contributor Author

maumar commented Aug 12, 2020

@smitpatel updated

@smitpatel smitpatel changed the base branch from main to release/5.0 August 17, 2020 22:30
@maumar
Copy link
Contributor Author

maumar commented Sep 1, 2020

@Pilchie for RC1 approval.

Added validation step for AddCollectionJoin which checks that if subquery contains Distinct or GroupBy, the projection contains all identifying columns needed to correctly bucket the results during materialization.
Also making sure that identifying columns can be correctly propagated during pushdown and joining - if they are not we mark them as such (by removing identifying columns altogether), so that we can throw exception when these columns are actually needed.

Fixes #15873
Fixes #20184
@Pilchie
Copy link
Member

Pilchie commented Sep 1, 2020

Approved for RC1 pending CI completion if merged before 10am Pacific on 2020-09-01.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Improve correlated collection key matching Query: Identifying columns in the case of distinct
3 participants