-
Notifications
You must be signed in to change notification settings - Fork 1.2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
docs: Adding async data cache configs and ssd cache documentation #11429
base: main
Are you sure you want to change the base?
Conversation
✅ Deploy Preview for meta-velox canceled.
|
a4cfbd1
to
be3fa99
Compare
@majetideepak Can you review this PR when you can? Thanks! |
524893b
to
a1de59d
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks for this. Multiple comments.
- Min SSD savable (in-memory) cache space to start writing SSD savable cache entries into SSD cache. NOTE: we only write to SSD cache when both above conditions are satisfied. | ||
* - async-cache-persistence-interval | ||
- string | ||
- 0s |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
In the explanation do we need to add the allowed units to be specified? Is this mentioned in other configs that use duration units?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Will add units has to be in seconds here.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The unit is part of the string and we can see it is in seconds. But we would allow time based units like hour, day etc to be used as well. Not just seconds and we want to mention this in the description what they are.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Added
The following time units are supported: ns, us, ms, s, m, h, d.
Reference: https://github.com/facebookincubator/velox/blob/main/velox/common/config/Config.cpp#L82
d703bb3
to
dd244bf
Compare
@czentgr to re-review |
Add async data cache configs and ssd cache documentation.
Add instructions on how to setup btrfs filesystem for SSD usage on AWS worker machines of Linux OS.