Skip to content

pylibcudf.Column: add device_buffer_size and register a dask.sizeof function for cudf-polars Column and DataFrame #18602

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 21 commits into from
May 6, 2025

Conversation

madsbk
Copy link
Member

@madsbk madsbk commented Apr 30, 2025

This is used by RAPIDSMPF's approx_spillable_amount.

To simplify, moved all the dask registration (incl. the serializers) into dask_registers.py

@madsbk madsbk added improvement Improvement / enhancement to an existing function non-breaking Non-breaking change cudf.polars Issues specific to cudf.polars labels Apr 30, 2025
@madsbk madsbk self-assigned this Apr 30, 2025
Copy link

copy-pr-bot bot commented Apr 30, 2025

Auto-sync is disabled for draft pull requests in this repository. Workflows must be run manually.

Contributors can view more details about this message here.

@github-actions github-actions bot added the Python Affects Python cuDF API. label Apr 30, 2025
@madsbk madsbk force-pushed the sizeof_polars_dataframe branch from 0a5c342 to 5183e35 Compare May 1, 2025 07:17
@madsbk madsbk force-pushed the sizeof_polars_dataframe branch from 7ba07c8 to a589761 Compare May 1, 2025 10:32
@madsbk madsbk marked this pull request as ready for review May 1, 2025 11:19
@madsbk madsbk requested a review from a team as a code owner May 1, 2025 11:19
@madsbk madsbk requested review from wence- and Matt711 May 1, 2025 11:19
@madsbk madsbk requested a review from wence- May 1, 2025 12:50
@github-actions github-actions bot added the pylibcudf Issues specific to the pylibcudf package label May 2, 2025
@madsbk madsbk changed the title Register a dask.sizeof function for Polars Column and DataFrame pylibcudf.Column: add device_buffer_size and register a dask.sizeof function for cudf-polars Column and DataFrame May 2, 2025
Co-authored-by: Lawrence Mitchell <wence@gmx.li>
madsbk and others added 2 commits May 2, 2025 12:22
@madsbk madsbk requested a review from wence- May 2, 2025 11:15
Co-authored-by: Lawrence Mitchell <wence@gmx.li>
@madsbk madsbk requested a review from wence- May 2, 2025 15:42
@madsbk
Copy link
Member Author

madsbk commented May 6, 2025

/merge

@rapids-bot rapids-bot bot merged commit 545d2a0 into rapidsai:branch-25.06 May 6, 2025
109 checks passed
vyasr added a commit to vyasr/cudf that referenced this pull request May 6, 2025
…k.sizeof function for cudf-polars Column and DataFrame (rapidsai#18602)"

This reverts commit 545d2a0.
@madsbk madsbk deleted the sizeof_polars_dataframe branch May 16, 2025 11:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
cudf.polars Issues specific to cudf.polars improvement Improvement / enhancement to an existing function non-breaking Non-breaking change pylibcudf Issues specific to the pylibcudf package Python Affects Python cuDF API.
Projects
Status: Done
Development

Successfully merging this pull request may close these issues.

2 participants