Skip to content

Shard data balancing #4147

Description

@roman-khimov

Is your feature request related to a problem? Please describe.

I'm always frustrated when disk replacements leave nodes in unbalanced state, new disks store less data than they should. Same thing happens if extending node with new shards, old shards keep old data and never share it with new ones. This makes the load uneven and breaks redundancy assumptions since loss of one drive is not equal to loss of another in terms of lost object count (even though the basic redundancy unit is SN we can assume that shards are equal).

Describe the solution you'd like

Policer has a clear picture of local data balance since #3862 (which is leveraged by #3908), the same data can be used to trigger PUT into more appropriate shard and DELETE from inappropriate one.

Describe alternatives you've considered

This has to be solved anyway.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    I3Minimal impactS3Minimally significantU2Seriously plannedenhancementImproving existing functionalityneofs-storageStorage node application issues

    Type

    No type

    Projects

    No projects

      Milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions