Reliability and observability

Trace sampling

Also known as Trace sampling

By WeavePublished 1 min read

Definition

Trace sampling is selection of traces or spans to retain from a larger set of observed operations.

What Trace sampling shows

Trace sampling is selection of traces or spans to retain from a larger set of observed operations. It matters when a team can state the decision the evidence should support, the population being measured, and the time window in which the observation matters. That framing keeps a familiar label from becoming a dashboard tile with no operational meaning. The collection method and owner should be visible whenever the signal is used in a review.

A concrete example

All error traces are kept while a small proportion of successes are retained. A useful workflow records relevant context, compares the observation with an appropriate baseline, and follows the evidence to the service or change that may explain it. The signal should start a question rather than close the investigation. Teams should also record what action follows a meaningful change and how the result will be checked.

Limitations and tradeoffs

Important latency or error traces may disappear when sampling is too aggressive. Interpret trace sampling alongside related signals and explicit service objectives. Sampling, aggregation, clock behavior, retention, and access policy can all affect what an operator sees. When those details are missing, conclusions should remain provisional and a precise-looking value should not be presented as a complete account of user experience.

How this relates to Weave

Weave can help teams connect engineering delivery evidence with trace sampling questions. It can provide context from code, reviews, releases, and ownership, while the direct trace sampling measurement should remain in the system that collects it. Treat relationships as investigation leads and verify them against service telemetry and user impact.

Explore Engineering intelligence

Sources and further reading

  1. Primary documentation: Trace sampling