Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add a bitset validatation gtest for cuco::arrow_filter_policy #633

Merged
merged 5 commits into from
Nov 1, 2024

Conversation

mhaseeb123
Copy link
Contributor

@mhaseeb123 mhaseeb123 commented Nov 1, 2024

This PR adds a gtest to validate the bitset from inserting specific keys to a cuco::bloom_filter with cuco::arrow_filter_policy against the one generated by inserting the same keys to the implementation in Arrow.

Related to #625. Part of rapidsai/cudf#17164. Reference bitset gen with arrow here: https://godbolt.org/z/ebdddezbP

Copy link

copy-pr-bot bot commented Nov 1, 2024

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

@mhaseeb123 mhaseeb123 marked this pull request as ready for review November 1, 2024 01:00
tests/bloom_filter/filter_bitset_test.cu Outdated Show resolved Hide resolved
tests/bloom_filter/filter_bitset_test.cu Outdated Show resolved Hide resolved
tests/bloom_filter/filter_bitset_test.cu Outdated Show resolved Hide resolved
@PointKernel PointKernel added helps: rapids Helps or needed by RAPIDS topic: bloom_filter Issues related to bloom_filter type: improvement Improvement / enhancement to an existing function Needs Review Awaiting reviews before merging labels Nov 1, 2024
tests/bloom_filter/filter_bitset_test.cu Outdated Show resolved Hide resolved
tests/bloom_filter/filter_bitset_test.cu Outdated Show resolved Hide resolved
@PointKernel
Copy link
Member

/ok to test

@PointKernel
Copy link
Member

/ok to test

Copy link
Member

@PointKernel PointKernel left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Great work as always. @mhaseeb123 thank you!

Copy link
Collaborator

@sleeepyjack sleeepyjack left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Awesome work! Thank you!

std::uniform_real_distribution<Key>,
std::uniform_int_distribution<Key>>>;

static constexpr auto seed = 0xf00d;
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lol

@sleeepyjack sleeepyjack merged commit b29b608 into NVIDIA:dev Nov 1, 2024
18 checks passed
@mhaseeb123 mhaseeb123 deleted the fea/gtest-arrow-filter-policy branch November 2, 2024 00:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
helps: rapids Helps or needed by RAPIDS Needs Review Awaiting reviews before merging topic: bloom_filter Issues related to bloom_filter type: improvement Improvement / enhancement to an existing function
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants