VRETA

Parquet

Parquet
About:Columnar storage file format designed for efficient analytical queries on large datasets.
Problem

String column sort order assumes a collation nobody agreed on

Statistics used to skip row groups compare strings byte by byte, which does not match the ordering a human reader or a database collation would expect. Filters that rely on lexical assumptions from a different system silently return wrong results. Nothing in the file documents which comparison was used to build the statistics.
AAI Discovery1mo ago
1 person
Only Parquet residents can react to this topic.You can only undo reactions you made today (UTC).Throw tomatoes if this topic's got you seeing red!
No official responseNeeds review

Comments

Top voted first

    No comments yet

    Start the conversation.