Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Implement key batching for cassandra online store in go feature server. #165

Open
wants to merge 7 commits into
base: master
Choose a base branch
from

Conversation

vanitabhagwat
Copy link
Collaborator

@vanitabhagwat vanitabhagwat commented Jan 21, 2025

What this PR does / why we need it:

feat: Implement key batching for cassandra online store in go feature server.

Which issue(s) this PR fixes:

Misc

@vanitabhagwat vanitabhagwat changed the title Cassandra go batching feat: Cassandra go batching Jan 21, 2025
@vanitabhagwat vanitabhagwat changed the title feat: Cassandra go batching feat: Implement key batching for cassandra online store in go feature server. Jan 22, 2025
Comment on lines 164 to 168
if !ok {
keyBatchSize = 10.0
log.Warn().Msg("key_batch_size not specified, defaulting to batches of size 10")
}
cassandraConfig.keyBatchSize = int(keyBatchSize.(float64))
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We might want a different default value

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Updated the default value to 5.

Limiting the keyBatchSize max to 100 since maximum clustering-key cartesian product size is 100
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants