Skip to content

Poor filesystem scanning performance on very large repositories #176

Open

Description

@ArchangelX360

At JetBrains formatting our monorepo takes about 31.8s which is quite slow, maybe we're not configuring it correctly?

We tried some git ls-files approach which takes it down to 5.6s, maybe there are other more hermetic ways (because in our PoC git is resolved from PATH) to reach a similar level of performance 🤔.

Activity

  1. ArchangelX360 commented on Oct 28, 2026

    @ArchangelX360
    ContributorAuthor

    Could be mitigated by bazel-contrib/buildtools#1486 actually

  2. keith commented on Oct 30, 2026

    @keith
    Owner

    yea i matched the original upstream file discovery just to make sure it was 1:1, I think that upstream solution is probably ok but I'm sure faster versions could be done like fd based ones. I wonder if we should provide that as an option (or just do it by default). but probably easiest if we first get excludes into the tool so we don't have to worry about matching that syntax

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions