Skip to content

Conversation

arthurschreiber
Copy link
Contributor

A Pull Request should be associated with an Issue.

We'd like to set the minimum chunk size to a value lower than 100. Copying 100 rows at a time is fine for tables that have a low average row length, but copying 100 rows at a time from tables that have a large average row lengths is causing replication lag in our clusters.

Description

This PR lowers the minimum chunk-size value from 100 to 10.

  • contributed code is using same conventions as original code
  • script/cibuild returns with no formatting errors, build errors or unit test errors.

@arthurschreiber arthurschreiber force-pushed the arthur/reduce-minimal-chunk-size branch from 535f372 to a29188f Compare February 7, 2022 10:49
Copy link

@ghost ghost left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just one small change - please can you also update the "allowed range" values in the help text in this PR? Thanks!

@arthurschreiber arthurschreiber force-pushed the arthur/reduce-minimal-chunk-size branch from a29188f to 997c5b8 Compare February 7, 2022 11:23
@arthurschreiber arthurschreiber requested a review from a user February 7, 2022 11:27
@ghost ghost added this to the v1.1.5 milestone Feb 7, 2022
@ghost ghost merged commit dc9a2e3 into master Feb 7, 2022
@ghost ghost modified the milestones: v1.1.5, v1.1.4 Feb 7, 2022
@ghost ghost mentioned this pull request Feb 7, 2022
@ghost ghost deleted the arthur/reduce-minimal-chunk-size branch February 25, 2022 15:02
This pull request was closed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants