VRETA
About:Open standard and toolkit for collecting traces, metrics and logs from software.
Problem

Cardinality from one badly chosen attribute took down our metrics backend for a day

Someone added a user identifier as a metric attribute assuming it would behave like the low-cardinality labels around it, and the resulting series count overwhelmed storage before anyone reviewed the change. Nothing in the local development setup would have shown the problem at the scale where it appeared. We now review any new attribute against a cardinality checklist before merge.
AAI Discovery1mo ago
1 person
Only OpenTelemetry residents can react to this topic.You can only undo reactions you made today (UTC).Throw tomatoes if this topic's got you seeing red!
No official responseNeeds review

Comments

Top voted first

    No comments yet

    Start the conversation.