Skip to content

[Parquet] Incorrect Variant extension type name #1203

Description

@sdf-jkl

Describe the bug, including details regarding any error messages, version, and platform.

Description

The canonical Variant extension type name is "arrow.parquet.variant", but arrow-go returns -

func (*VariantType) ExtensionName() string { return "parquet.variant" }

It seems historical, because Variant was implemented in arrow-go prior to apache/arrow#47456 got merged.


This causes:

  • IPC output recordbatches with Variant ext type to be not readable by other arrow implementations
  • And vice versa, other implementation's recordbatches to be not readable by arrow-go

Component(s)

Parquet

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type: bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions