Skip to content

OrganizationPractitioner24 min read

Governing observability

White paper: an observability governance framework in four pillars (organization, standards, costs, compliance), with a RACI matrix, mandatory attributes, a regulatory table, a maturity model, a twelve-month roadmap, indicators, a sample charter and a checklist for bringing a new service on board (onboarding).

For: architects · team managers · finance, risk and compliance · executives and CIOsPrerequisites: None for the summary; chapters 4 and 5 assume familiarity with OpenTelemetry and the Collector.

Reading mode

Observability has become an enterprise asset: it is expensive, it holds sensitive data and it serves as evidence before regulators. Yet in most organizations, nobody owns it. Each team instruments its own way (instrumenting means adding to the code what it needs to produce signals: metrics, logs, traces), each tool imposes its format and the bill arrives without anyone knowing whom to charge it to.

This white paper proposes a governance framework in four pillars, designed to be applied gradually and without depending on a vendor:

  • Organization and roles: who decides, who produces the signals, who uses them and who pays for them.
  • Standards and OpenTelemetry, the open standard used to produce and carry signals: a common vocabulary, mandatory attributes and configuration-driven pipelines (the chains that collect, transform and route signals).
  • Costs and volumes: observability budgets per team, rules on retention (how long data is kept) and sampling (keeping only part of the traces), readable cost allocation.
  • Compliance and sovereignty: logs are personal data and regulatory evidence; their lifecycle must be controlled end to end.

Three messages structure the document. First, governance does not add one more committee: it comes down to a set of rules applied automatically in the pipelines. Second, the open standard is the condition for sovereignty: without OpenTelemetry, changing backends (the tools that store and display the data) remains a migration project. Finally, governance is measured; chapter 9 proposes the indicators that show whether it works. The article Your observability has no owner gives a short version.

1. The finding: observability without an owner

Section titled “1. The finding: observability without an owner”

Most observability platforms were not designed; they accumulated. One tool for infrastructure, another for applications, a SIEM for security (the tool that centralizes security events), then an APM (an application performance monitoring tool) for a strategic project. Each had its logic when it was adopted. Together, they form a system nobody steers.

Five symptoms recur from one organization to the next:

  1. Cost drift. The volume of observability data grows faster than the application estate. Licenses based on ingested volume, meaning the amount of data the tool receives, turn every forgotten debug log into a budget line. The bill is global; allocating it is impossible.
  2. Tool sprawl. Several agents, the small collection programs installed on each machine, run on the same host and collect the same data for different destinations. Skills are scattered, contracts pile up.
  3. Heterogeneous signals. The same service has three names depending on the team. Attributes (the labels attached to each signal) do not match, cross-cutting queries fail and correlation between traces, metrics and logs stays manual.
  4. Sensitive data out of control. Email addresses, customer identifiers or authentication tokens end up in logs. They are then replicated, indexed and kept longer than the business data they describe.
  5. Vendor dependency. Proprietary agents, specific query languages and non-exportable dashboards make any exit costly. The question of reversibility is only raised at renewal time.

These symptoms share a common cause: observability is treated as technical tooling, whereas it is an enterprise data flow. An enterprise data flow is governed: you define what comes in, in what form, for what purpose, for how long and at what cost.

Observability governance is the set of roles, rules and mechanisms that decide which signals are produced, in what form, for which uses, for how long and at what cost. It covers the whole signal lifecycle: instrumentation, collection, transformation, transport, storage, use and deletion.

Governed objectQuestion governance answers
Signals (traces, metrics, logs, resource usage profiles, events)What do we collect and what do we refuse to collect?
Schemas and attributesWhich vocabulary is mandatory, recommended or forbidden?
Pipelines and agentsWho configures the collectors and how are changes validated?
Storage and retentionFor how long, at what level of detail, on which hosting?
AccessWho can read what and how is that access traced?
CostsWho pays, on what basis, with what budget?
ToolsWhich tools are approved, tolerated or being retired?
  • Usefulness: every retained signal must serve an identified use (detection, diagnosis, SLO, meaning a quality-of-service objective with a number on it, security, regulatory evidence, capacity).
  • Consistency: the same concept bears the same name everywhere, which makes correlation automatic.
  • Control: costs and volumes are predictable and attributable.
  • Compliance: legal obligations are met by design, not by after-the-fact audit.
  • Reversibility: the organization can change backends without re-instrumenting its applications.

Governance is not a committee that approves every dashboard. Nor is it a tool choice; it comes before that choice and outlives it. Finally, it is not a constraint imposed on product teams: well designed, it gives them default instrumentation, ready-made dashboards and a readable bill. The guiding principle is the paved road: make the right behavior the easiest one.

The basic rule is simple: the observability platform belongs to a team; the signals belong to the team that emits them. Without this separation, the platform becomes the dumping ground for decisions nobody made.

Three models coexist in organizations. The centralized model entrusts everything to a single team; it guarantees consistency yet quickly becomes a bottleneck. The decentralized model lets each team choose; it is fast at first and ungovernable afterwards. The federated model is the one this white paper recommends: a platform team provides the foundation and the rules; product teams remain responsible for their instrumentation and their alerts.

In the federated model, the platform behaves like an internal product. It has a roadmap, a service catalog, service level commitments and users whose satisfaction it measures.

RoleHeld byMain responsibilities
Executive sponsorCIO, CTO or VP EngineeringArbitrates budgets and priorities, carries the observability policy
Platform leadHead of Observability or Platform LeadOwns the roadmap and the catalog; writes and enforces the observability policy
Platform teamSREs and platform engineersOperates collectors, pipelines and backends; provides instrumentation libraries
Service ownerTech lead of each product teamInstruments the service, defines its SLOs, manages its observability budget
Observability championOne volunteer developer per teamRelays the standards, raises needs, supports peers
Security and CISOSecurity teamDefines required security logs, their integrity and their access
DPOData protection officerValidates the personal data collected and the retention periods
FinOpsIT financial controlAllocates costs, tracks budgets, warns about drift

R: responsible. A: accountable. C: consulted. I: informed.

DecisionSponsorPlatform leadPlatform teamService ownerSecurityDPOFinOps
Observability policyARCCCCC
Choice of backends and toolsARCICIC
Mandatory attributesIARCCCI
Instrumenting a serviceIICA/RIII
Retention rulesIARCCCC
Personal data filteringIARCCCI
Observability budget per teamACCRIIR
SLOs and alerts of a serviceIICA/RIII
Access to observability dataIARCCCI

A light committee meeting once a month is enough. It brings together the platform lead, two or three champions, a security representative, the DPO when needed and FinOps. Its agenda is fixed: schema changes, exception requests, budget overruns, tool retirements. Its decisions are recorded in a versioned register (one that keeps every change), next to the pipeline configuration.

The committee does not approve instrumentation day to day. The rules it adopts are coded into pipelines and CI, the continuous integration that automatically checks every code or configuration change; a rule that cannot be automated should be questioned.

OpenTelemetry is the recommended reference standard for instrumentation and collection. The choice is strategic rather than technological: it separates producing signals from storing them. Applications are instrumented once; the backend becomes a reversible choice.

The OpenTelemetry semantic conventions define attribute names, types and units. They evolve through versions: v1.44.0 was released in August 2026. Each convention has a stability status (Stable, or Development while its names may still change); that status should guide governance. The HTTP conventions have been stable since v1.23.0 (November 2023), the core of the database conventions since v1.33.0 (May 2025, with MariaDB, SQL Server, MySQL and PostgreSQL). The GenAI conventions, on the other hand, remain at Development status and were moved in June 2026 (v1.42.0) to a dedicated repository to evolve faster.

The resulting governance rule: only Stable attributes can be the basis for an alert, an SLO or a cost allocation. Development attributes are allowed for exploration, with version tracking to anticipate renames.

A small number of resource attributes, the ones that describe where the signal comes from (the service, its version, its environment), must be present on every signal admitted to the platform. A signal that lacks them is rejected or quarantined (set aside for review) by the pipeline.

AttributeOriginGovernance use
service.nameOTel conventionService identity, key to any correlation
service.versionOTel conventionBefore and after deployment comparison
service.namespaceOTel conventionGrouping by business domain
deployment.environment.nameOTel conventionSeparating production from non-production, differentiated retention rules
<org>.teamInternal extensionSignal owner, alert routing
<org>.cost_centerInternal extensionCost allocation
<org>.data_classificationInternal extensionSensitivity level, triggers the matching filtering and retention

Internal extensions live in a namespace of the organization’s own (a prefix reserved for it), never in a namespace reserved by OpenTelemetry. They are described in a versioned schema registry, in the same format as the official conventions, which makes it possible to generate documentation and checks automatically.

The reference architecture has two tiers of collectors, the components that receive, transform and forward signals. Agents, as close as possible to the workloads, enrich signals with infrastructure metadata. Gateways, centralized, apply the policies: schema validation, personal data filtering, sampling, routing to backends. Governance becomes executable at the gateway tier.

The configuration of these collectors is treated as code: stored in Git, reviewed, tested in CI and deployed traceably. At scale, a control plane (a central management console) based on the OpAMP protocol, whose specification is still at Beta status, makes it possible to manage a fleet of collectors: inventory, configuration distribution, health status. It answers a question most organizations cannot handle today: which configuration is actually running on each agent?

  • In CI: checking that each service declares the mandatory attributes and uses names that comply with the registry.
  • At ingestion, meaning when the data is received: rejecting or quarantining non-compliant signals, with a counter per team.
  • Continuously: detecting cardinality drift (cardinality is the number of value combinations a metric has, which drives costs up) and unknown attributes, reported to the service owner.

Sources: semantic conventions release notes, HTTP conventions, database conventions, move of the GenAI conventions and their status.

The cost of observability is a decision problem rather than a tool problem: every stored signal results from a choice, often implicit, to keep it. Governance makes these choices explicit and ties them to an owner.

The first step is measurement. The pipeline counts, for each team and each service, the volumes ingested per signal type, metric cardinality and the volume stored per retention tier. These counters are themselves metrics, exposed in a dashboard accessible to all.

Allocation follows the <org>.cost_center attribute. You start with showback: each team sees what it consumes, without being billed. Chargeback, actual billing, only comes once the data is reliable and accepted. Jumping straight to chargeback on disputed figures destroys trust in the approach.

Each team has a budget expressed in volume or monthly cost, negotiated with FinOps and the platform lead. The budget is a trade-off tool rather than a sanction: a team that wants more detail on a critical service can reduce its debug logs elsewhere. Overruns trigger an alert to the owner, then a committee review if they persist.

LeverPrincipleWatch point
Filtering at the sourceRemove signals without an identified use (health checks, the regular calls that verify a service responds, debug logs in production)Document what is removed so as not to lose a signal useful for diagnosis
Log levels per environmentDebug outside production only, except for temporary, traced activationProvide an on-demand activation mechanism with automatic expiry
Head samplingDecision at the start of the trace, at a fixed rateSimple and cheap, yet blind to rare errors
Tail samplingDecision after the full trace: errors and slow traces are keptNeeds memory and consistent routing by trace ID across gateways
Cardinality controlForbid unique identifiers (user, request) as metric labelsPut them in traces or logs, where they cost less
AggregationTurn repetitive logs into metrics at the gatewayKeep a raw sample for diagnosis
Tiered retentionShort hot data, aggregated warm data, compressed cold data on object storageAlign tiers with real uses and legal obligations

Retention is decided by use, not by tool. Diagnostic data loses most of its value within a few days; capacity trends are read on aggregates; security and regulatory evidence logs follow imposed durations (see chapter 6). Each data class receives a minimum and a maximum duration, set in advance and justified.

The maximum duration matters as much as the minimum: keeping data too long costs money and creates legal risk.

Observability data has a dual legal status. It is an obligation: several texts require logging and the ability to reconstruct an incident. It is also a risk: logs contain personal data and must follow the same principles as the data they describe. Governance must hold both requirements at once.

The table cites four texts. The GDPR is the EU regulation on personal data protection, whose application the CNIL, the French data protection authority, spells out. DORA is the EU regulation on digital operational resilience in the financial sector; its RTS are the regulatory technical standards that detail it and ICT risk means risk related to information and communication technology. NIS2 is the EU cybersecurity directive. The AI Act is the EU regulation on artificial intelligence.

TextWhat it requires of observability dataStatus as of 16 October 2026
GDPR and CNIL recommendation on loggingLog the access and actions of authorized users; keep these logs between six months and one year, up to three years when they serve internal controls; protect the logs themselves2021 recommendation (deliberation 2021-122), non-binding yet the reference in case of inspection
DORA, RTS on the ICT risk management framework, Article 12Logging procedures covering access control, capacity management, changes, operations and network traffic; protection against tampering and deletion; detection of logging failures; clock synchronizationApplies to financial entities under the full framework (outside the simplified framework of DORA Article 16)
NIS2Risk management, incident detection and notification, which assumes usable loggingFrench transposition through the Résilience bill: the floor debate planned for 7 October 2026 was withdrawn from the agenda the day before, with no new date as of 16 October; working version of the ReCyF framework (v2.5) published by ANSSI on 17 March 2026
AI Act, Articles 12, 19 and 26Automatic logging of events of high-risk AI systems over their whole lifetime; retention of at least six monthsDigital Omnibus (Regulation 2026/1744): application postponed to 2 December 2027 for Annex III systems and to 2 August 2028 for Annex I systems

These texts converge on four requirements: knowing what is logged, keeping it for a justified period, guaranteeing log integrity, controlling who accesses them. A single governance framework can answer them, rather than one project per regulation.

The data minimization principle applies to observability data. In practice:

  • Classify each service by the sensitivity of the data it handles, through the <org>.data_classification attribute.
  • Filter at the gateway: mask or hash (replace with a non-reversible fingerprint) email addresses, phone numbers, IP addresses, customer identifiers and tokens, with rules tested in CI like the rest of the configuration.
  • Forbid by default capturing request bodies and prompt contents (the instructions sent to an AI model); allow it case by case, after the DPO’s opinion.
  • Align log retention with that of the source data: a log should not long outlive the data it describes.
  • Trace access to the observability platform itself, which becomes a sensitive system.

A log that can be altered has no value as evidence. Security and compliance logs are separated from operational logs and written to immutable storage for their retention period; their collection chain is itself monitored: a source that goes silent must trigger an alert. Timestamps rely on a documented reference time source.

Observability sovereignty plays out on three levels:

  1. Hosting. Logs describe the architecture, potential weaknesses and usage. For sensitive organizations, storing them calls for qualified hosting (SecNumCloud in France, the ANSSI qualification for cloud offerings) or hosting controlled in-house, out of reach of extraterritorial laws.
  2. Format. Signals produced with OpenTelemetry can be routed to any compatible backend. The open format is the technical condition for sovereignty.
  3. Contractual reversibility. Each contract specifies how data, dashboards and alert rules are exported. An exit plan is written and tested before signing, not at the time of the break-up.

These elements do not constitute legal advice; each organization must validate them with its DPO and legal department.

In the field, many organizations sit between levels 1 and 2. The realistic twelve-month goal is level 3 on all four pillars; level 4 is built afterwards; level 5 is only useful for organizations for which observability is a major regulatory or commercial stake.

An organization sits at the level of its weakest pillar: an excellent cost model does not make up for security logs that can be altered.

LevelOrganization and rolesStandards and OTelCosts and volumesCompliance and sovereignty
1. EnduredNo owner; each team chooses its toolsProprietary formats, free namingGlobal bill, not allocatedPersonal data present without control; tools’ default retention
2. TooledOne team operates the tools, without a governance mandateFirst OTel collectors; a few local conventionsVolumes measured globallySecurity logs identified; retention partly documented
3. DefinedFederated model, published RACI, active observability committeeMandatory attributes, schema registry, centralized gatewaysShowback per team, retention policy by usePersonal data filtering at the gateway, durations validated by the DPO
4. ManagedPlatform run as a product, with SLOs and measured satisfactionChecks in CI and at ingestion, configuration in Git, fleet control planeBudgets per team, tail sampling, chargebackImmutable storage for evidence, collection chain monitored, tested exit plan
5. OptimizedGovernance evolves from its own indicatorsContribution to open standards; backends interchangeable in practiceUnit cost tracked (per transaction, per service) and decreasingCompliance demonstrable on demand, without a dedicated audit project

Self-assessment is done pillar by pillar, with evidence: a published document, a pipeline rule, a dashboard. A claim without evidence counts as the level below.

Implementation fits in twelve months and targets level 3 on all four pillars. Each phase ends with a verifiable milestone; you do not move on to the next without reaching it.

PhasePeriodKey actionsExit milestone
1. Lay the foundations0 to 90 daysAppoint sponsor and lead; inventory tools and volumes; observability charter published; mandatory attributes setCharter signed and inventory validated
2. Make it executableMonths 3 to 6Shared OTel gateways; GDPR filtering at the gateway; showback per team; retention validated by the DPOLevel 3 on two pillars
3. SteerMonths 6 to 12CI and ingestion checks; budgets per team; evidence in immutable storage; tested exit planLevel 3 on all four pillars

Phase 1: lay the foundations (0 to 90 days)

Section titled “Phase 1: lay the foundations (0 to 90 days)”

The goal is to create the mandate and measure the existing situation. You appoint the sponsor and the platform lead, then inventory the tools, deployed agents, ingested volumes and current contracts. The observability charter and the list of mandatory attributes are written with two or three pilot teams, then signed. This phase does not yet change anything in production: it produces the baseline without which no progress can be measured.

Phase 2: make the rule executable (months 3 to 6)

Section titled “Phase 2: make the rule executable (months 3 to 6)”

The reference OpenTelemetry gateways are deployed and the pilot teams are connected to them. Personal data filtering and validation of mandatory attributes are applied there. Showback per team is published and the retention policy by use is validated with the DPO and security. The observability committee starts meeting.

Checks move into CI and ingestion for all teams. Observability budgets are allocated and tracked. Security and evidence logs move to immutable storage with their collection monitored. An exit plan is written and tested for each backend. The indicators of chapter 9 become the committee’s agenda.

The main risk of this roadmap is wanting to impose everything from phase 1. Governance that starts with bans before offering a paved road gets bypassed.

Governance that is not measured becomes a ritual. A dozen indicators are enough, reviewed monthly in the observability committee and quarterly with the sponsor. Targets are set by each organization from its initial measurement; this table gives their definition, not their value.

PillarIndicatorDefinitionExpected direction
OrganizationOwnership coverageShare of services whose <org>.team attribute is filled in and validToward 100%
OrganizationPlatform adoptionShare of production services collected by the reference pipelinesRising
OrganizationOnboarding lead timeTime between a team’s request and its first usable dashboardFalling
StandardsSchema complianceShare of ingested signals carrying all mandatory attributesToward 100%
StandardsQuarantined signalsVolume rejected or isolated for non-compliance, per teamFalling
StandardsOff-catalog toolsNumber of observability tools in service that are not approvedFalling
CostsUnit costObservability cost per business unit (transaction, active user, service)Stable or falling
CostsBudget adherenceShare of teams within their observability budgetRising
CostsNever-read dataShare of stored volumes without any query over the periodFalling
CompliancePersonal data leaksDetected occurrences of unfiltered personal data in the backendsToward zero
ComplianceRetention adherenceShare of data classes whose actual retention follows the policyToward 100%
ComplianceSilent critical sourcesNumber and duration of collection interruptions on security logsToward zero

The “never-read data” indicator deserves particular attention: it directly reveals data produced out of habit rather than need. It gives the committee a factual basis for deciding deletions.

This charter fits on one page. It is signed by the sponsor and published next to the schema registry.

  1. Every signal admitted to the platform has an identified owner.
  2. All retained observability data serves a documented use: detection, diagnosis, SLO, security, regulatory evidence or capacity.
  3. Instrumentation uses OpenTelemetry and the semantic conventions; internal extensions are declared in the schema registry.
  4. Mandatory attributes are present on every signal; a non-compliant signal is rejected or quarantined.
  5. Personal data is minimized at the source and filtered at the gateway; any exception is validated by the DPO.
  6. Each data class has a minimum and a maximum retention period, set and justified in advance.
  7. Each team has an observability budget and sees its consumption.
  8. Collector configuration is versioned, reviewed and deployed traceably.
  9. Security and evidence logs are protected against tampering; their collection is monitored.
  10. Every observability tool is approved and has an exit plan.
  • Service owner and team declared
  • Classification of the data handled validated
  • OpenTelemetry SDK (the library built into the code) or automatic instrumentation in place
  • Mandatory attributes filled in and checked in CI
  • Signals routed through the reference gateways
  • Personal data filtering rules tested on real samples
  • Log levels per environment configured
  • Observability budget allocated and consumption dashboard shared
  • At least one SLO defined, with its alerts routed to the team
  • Runbook (procedure sheet) linked to each alert
TermDefinition
CardinalityNumber of distinct combinations of attribute values for a metric; the main cost factor of time series databases
ChargebackActual billing of observability costs to the consuming teams
CollectorOpenTelemetry component that receives, transforms and exports signals; deployed as an agent or a gateway
Semantic conventionsOpenTelemetry registry of standardized attribute names, types and units
Tail samplingDeciding whether to keep a trace after observing it in full
OpAMPOpenTelemetry protocol for remotely managing a fleet of agents
ShowbackDisplaying consumption per team, without billing
SLOService level objective, expressed on a measured indicator (SLI)