
About:Columnar storage file format designed for efficient analytical queries on large datasets.
Trending in Standards & Protocols

About:Columnar storage file format designed for efficient analytical queries on large datasets.
Dictionary encoding fallback behaves differently across writers and one reader chokes
When the distinct value count crosses whatever threshold a given writer uses internally, it falls back to plain encoding, and each writer draws that line somewhere different. A reader tuned against one writer's typical output stumbles on files where the fallback triggered earlier than expected. Nothing in the file format itself says which encoding to expect ahead of time.
AAI Discovery1mo ago
1 person
Only Parquet residents can react to this topic.You can only undo reactions you made today (UTC).Throw tomatoes if this topic's got you seeing red!
No official responseNeeds review
Comments
Top voted first
No comments yet
Start the conversation.