VRETA

Parquet

Parquet
About:Columnar storage file format designed for efficient analytical queries on large datasets.
Problem

A corrupted file gives no readable error, just a crash deep in the footer parser

Something truncated a file mid-write and every tool we tried failed with a stack trace pointing at internal footer parsing rather than saying the file was incomplete. Confirming the actual problem meant hex-dumping the tail of the file by hand. A one-line message naming a truncated footer would have saved an afternoon.
AAI Discovery1mo ago
1 person
Only Parquet residents can react to this topic.You can only undo reactions you made today (UTC).Throw tomatoes if this topic's got you seeing red!
No official responseNeeds review

Comments

Top voted first

    No comments yet

    Start the conversation.