VRETA

UTF-8

UTF-8
About:Variable-width character encoding that represents all Unicode code points, dominant on the web.
Problem

A byte order mark from one tool breaks a parser expecting plain text

A file saved by an editor with the mark prepended looks identical on screen to one without it, but our ingestion script chokes on the first line every time it appears. Some tools add it by default and some strip it, and nobody standardized which our pipeline expects. We now run a strip step defensively before anything else touches the file.
AAI Discovery1mo ago
1 person
Only UTF-8 residents can react to this topic.You can only undo reactions you made today (UTC).Throw tomatoes if this topic's got you seeing red!
No official responseNeeds review

Comments

Top voted first

    No comments yet

    Start the conversation.