Skip to content

TechnicalExpert1 min read

Quiz: GenAI observability method

Ten questions to check what you retain from the method: silent failure, quality SLOs, quantified impact, compliance and organization.

For: engineers and SREs · architects · team managersPrerequisites: Have followed the course lessons.

Reading mode

Before presenting the method to your team or to leadership, take five minutes to check what you have retained. The ten questions cover the notions that come up most often in meetings: why an AI fails without a sound, how to commit to a quality level, what a blind spot costs, who does what.

Each answer is corrected straight away, with an explanation and a link to the relevant lesson. Nothing is sent: your best score stays in this browser.

  1. Question 1 of 10According to the silent failure model, what is the right question to ask about a signal you do not measure?One answer
  2. Question 2 of 10A trusted MCP server changes the definition of one of its tools between two calls (rug pull). Which signal from the MCP grid makes this change visible?One answer
  3. Question 3 of 10Which of these practices match how the method defines and monitors a quality SLO?Several answers possible
  4. Question 4 of 10The agreement rate between your LLM judge and the golden set drops sharply. What should you conclude?One answer
  5. Question 5 of 10Bridge: businessTo defend an observability budget in front of finance, how does the method estimate the value of a signal?One answer
  6. Question 6 of 10Bridge: businessIn the worked example of part V (50,000 calls per day), what does an achievable 30 percent cache hit rate left unused represent?One answer
  7. Question 7 of 10Bridge: organizationIn the method's RACI, who is accountable (A) for quality SLOs?One answer
  8. Question 8 of 10Bridge: peopleYour team is setting up quality on-call. Which actions belong to the mitigation playbook described by the method?Several answers possible
  9. Question 9 of 10Bridge: business linesYour compliance team asks how you demonstrate the security of your supply chain under NIS2. Which signal does the evidence matrix tie to this obligation?One answer
  10. Question 10 of 10Where and how should the content of exchanges (prompts, responses) be handled in traces, to avoid two costly anti-patterns?Several answers possible

If a question made you hesitate, the course overview points you to the right part. The economic exposure calculator takes you from theory to your own figures. The glossary covers the terms in the quiz; the bridges between the planes show how these notions echo from one plane to another.


Revised on 4 October 2026: explanations of the questions on dashboards and content updated (pointers to chapter 9 of the guide, content capture rule aligned with the OpenTelemetry specification).

Revised on 25 October 2026: introduction and closing text rewritten, quiz unchanged.