Skip to content

[Bug] Java metadata scan fails on temporary files created by Python #9026

Description

@zhoulii

Search before asking

  • I searched in the issues and found nothing similar.

Paimon version

1.4

Compute Engine

flink

Minimal reproduce step

  1. PyPaimon writes snapshot-32494 atomically and leaves a temporary file:

snapshot-32494d686aba1-b44a-40a4-a4f1-d854830aa5cb.tmp

  1. Java scans the snapshot directory through SnapshotManager or FileUtils.listVersionedFiles.

  2. Java treats the temporary file as a snapshot and throws:

NumberFormatException: For input string:
"32494d686aba1-b44a-40a4-a4f1-d854830aa5cb.tmp"

Image

What doesn't meet your expectations?

Python and Java should use the same temporary-file naming convention. Temporary
files should not be treated as versioned metadata files, and Java should skip
invalid version filenames instead of throwing NumberFormatException.

Anything else?

No response

Are you willing to submit a PR?

  • I'm willing to submit a PR!

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions