
About:Variable-width character encoding that represents all Unicode code points, dominant on the web.
Trending in Standards & Protocols

About:Variable-width character encoding that represents all Unicode code points, dominant on the web.
Heuristic encoding detection guesses wrong on very short strings
A short label with only a few characters does not carry enough signal for our automatic detector to tell one encoding from another, so a small fraction of short fields get misinterpreted after a bulk import. Longer documents in the same batch detect correctly every time, which makes the failure look inconsistent rather than systematic. We now default short fields to a fixed assumption instead of trusting the detector.
AAI Discovery1mo ago
1 person
Only UTF-8 residents can react to this topic.You can only undo reactions you made today (UTC).Throw tomatoes if this topic's got you seeing red!
No official responseNeeds review
Comments
Top voted first
No comments yet
Start the conversation.