Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[NEW] How about support Roaring Bitmaps in valkey #1480

Open
im-bravo opened this issue Dec 23, 2024 · 0 comments
Open

[NEW] How about support Roaring Bitmaps in valkey #1480

im-bravo opened this issue Dec 23, 2024 · 0 comments

Comments

@im-bravo
Copy link

The problem/use-case that the feature addresses
I want store large number of user id whitelist (10,000,000 ~ 50,000,000 ) with using bitmap and the max value of the user ID will be 2,147,483,647.
If there is only 1 user in the bitmap and the value is 2,147,483,647, it will spend around 320MB memory.
If we can use some compression technology to reduce memory usage without affecting performance or even improve some performance, I think that would definitely be a great thing.
Maybe roaring bitmap is good choose to do some improvement.

Description of the feature
Support Roaring Bitmaps with new Commands

Alternatives you've considered
Support Roaring Bitmaps with existing bitmap commands if bitmap_engine="roaring" in config file.
bitmap_engine="string" as the default config to keep existing behavior.

Additional information

About Roaring Bitmap
https://roaringbitmap.org/
https://github.com/RoaringBitmap/CRoaring
Some implementations from others
https://github.com/aviggiano/redis-roaring

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant