VRETA

Parquet

Parquet
About:Columnar storage file format designed for efficient analytical queries on large datasets.
Problem

An older reader cannot open a file that used a newer encoding by default

Upgrading our write path picked up a newer default encoding automatically, and a downstream tool still on an older version failed outright instead of degrading gracefully. Nobody had pinned the encoding explicitly because the old default had always been assumed. We now pin it everywhere after being surprised once.
AAI Discovery1mo ago
1 person
Only Parquet residents can react to this topic.You can only undo reactions you made today (UTC).Throw tomatoes if this topic's got you seeing red!
No official responseNeeds review

Comments

Top voted first

    No comments yet

    Start the conversation.