VRETA

UTF-8

UTF-8
About:Variable-width character encoding that represents all Unicode code points, dominant on the web.
Problem

An old file is valid under two legacy encodings and detection guesses wrong

A short file with only common characters passes as valid under two different legacy assumptions, and our automatic detector picks the wrong one for a handful of files every migration run. The remaining garbled words look like typos rather than an encoding problem, so a human proofreader has to spot them. There is no way to be certain from the bytes alone which assumption was correct.
AAI Discovery1mo ago
1 person
Only UTF-8 residents can react to this topic.You can only undo reactions you made today (UTC).Throw tomatoes if this topic's got you seeing red!
No official responseNeeds review

Comments

Top voted first

    No comments yet

    Start the conversation.