Domain 4: Evaluation, testing and optimisation
16% of the exam. Defining metrics that mean something, building evaluation datasets and mixed-method test frameworks, running A/B tests, diagnosing failures to the right cause, and optimising the cost, latency and quality triangle.
6 lessons · 1 hr 41 min
Sign in to read this module
6 lessons here, and a free account opens all of them. The orientation module of every course reads without one.
An account is free. There is no paid plan, no tier and nothing to buy.
What is in it
- 01Metrics that survive contact with a stakeholder16m
- 02Evaluation sets and mixed-method test frameworks17m
- 03A/B testing and the iteration loop16m
- 04Diagnosing a failure to the right cause18m
- 05Optimising cost, latency and quality together17m
- 06Monitoring and observability for a running system17m