Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Change the Parquet writer's default_row_group_size_bytes from 128MB to inf #16750

Merged
merged 15 commits into from
Sep 18, 2024
Merged

Change the Parquet writer's default_row_group_size_bytes from 128MB to inf #16750

merged 15 commits into from
Sep 18, 2024

Commits on Sep 4, 2024

  1. Change the default row group size from 128MB to 1M rows. 

    Signed-off-by: Muhammad Haseeb <mhaseeb@nvidia.com>
    @mhaseeb123
    mhaseeb123 committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    8ad71f8 View commit details
    Browse the repository at this point in the history

  2. Revert doc to int 

    Signed-off-by: Muhammad Haseeb <mhaseeb@nvidia.com>
    @mhaseeb123
    mhaseeb123 committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    6750d75 View commit details
    Browse the repository at this point in the history

  3. Minor doc update 

    Signed-off-by: Muhammad Haseeb <mhaseeb@nvidia.com>
    @mhaseeb123
    mhaseeb123 committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    dd599ce View commit details
    Browse the repository at this point in the history

  4. Doc updates 

    Signed-off-by: Muhammad Haseeb <mhaseeb@nvidia.com>
    @mhaseeb123
    mhaseeb123 committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    3e723b8 View commit details
    Browse the repository at this point in the history

  5. Add comments 

    Signed-off-by: Muhammad Haseeb <mhaseeb@nvidia.com>
    @mhaseeb123
    mhaseeb123 committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    e994116 View commit details
    Browse the repository at this point in the history

Commits on Sep 9, 2024

  1. Expose default_rg_size_bytes to JNI

    @mhaseeb123
    mhaseeb123 committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    01c4a17 View commit details
    Browse the repository at this point in the history

Commits on Sep 10, 2024

  1. Merge branch 'branch-24.10' into fea-pq-writer-refactor-default-rg-size

    @mhaseeb123
    mhaseeb123 committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    e1a6b13 View commit details
    Browse the repository at this point in the history

Commits on Sep 11, 2024

  1. Merge branch 'branch-24.10' into fea-pq-writer-refactor-default-rg-size

    @mhaseeb123
    mhaseeb123 committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    511eb20 View commit details
    Browse the repository at this point in the history

  2. Updates from code reviews

    @mhaseeb123
    mhaseeb123 committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    d2051e7 View commit details
    Browse the repository at this point in the history

  3. Update docstring

    @mhaseeb123
    mhaseeb123 committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    e95b96c View commit details
    Browse the repository at this point in the history

  4. Docstring updates

    @mhaseeb123
    mhaseeb123 committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    26af59f View commit details
    Browse the repository at this point in the history

Commits on Sep 16, 2024

  1. Merge branch 'branch-24.10' into fea-pq-writer-refactor-default-rg-size

    @mhaseeb123
    mhaseeb123 committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    ad1cbac View commit details
    Browse the repository at this point in the history

  2. Revert java changes 

    Signed-off-by: Muhammad Haseeb <14217455+mhaseeb123@users.noreply.github.com>
    @mhaseeb123
    mhaseeb123 committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    c5e81fe View commit details
    Browse the repository at this point in the history

Commits on Sep 17, 2024

  1. Apply suggestions from code reviews.

    @mhaseeb123
    mhaseeb123 committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    135d565 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'branch-24.10' into fea-pq-writer-refactor-default-rg-size

    @mhaseeb123
    mhaseeb123 committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    94fb993 View commit details
    Browse the repository at this point in the history