---
description: >-
  Free Open-source ML observability course for data scientists and ML engineers
  by Evidently AI.
---

# Welcome!

## Welcome!

{% embed url="https://www.youtube.com/watch?v=FI2xDByfXfQ&list=PL9omX6impEuOpTezeRF-M04BW3VfnPBRF&index=2" %}

\
[ML observability course: welcome video](https://www.youtube.com/watch?v=FI2xDByfXfQ\&list=PL9omX6impEuOpTezeRF-M04BW3VfnPBRF\&index=2)

Welcome to the Open-source ML observability course!

## How to participate?

* **Learn at your own pace**. We published all 40 lessons with videos, course notes, and code examples.
* **Join the course cohort**. To submit assignments and earn a certificate of completion, you must enroll in the course cohort. [Sign up](https://www.evidentlyai.com/ml-observability-course) to save your seat and be notified when the next cohort starts.

## Links

* **Newsletter**. [Sign up](https://www.evidentlyai.com/ml-observability-course) to receive course updates and be notified when the next cohort starts.
* **Discord community**. Join the [community](https://discord.gg/PyAJuUD5mB) to ask questions and chat with others.
* **Code examples**. Are published in this GitHub [repository](https://github.com/evidentlyai/ml_observability_course).
* **YouTube playlist**. [Subscribe](https://www.youtube.com/playlist?list=PL9omX6impEuOpTezeRF-M04BW3VfnPBRF) to the course YouTube playlist.

**Enjoying the course?** [Star](https://github.com/evidentlyai/evidently) Evidently on GitHub to contribute back! This helps us create free, open-source tools and content for the community.

## What the course is about

This course is a deep dive into ML model observability and monitoring.

We explore different types of evaluations, from data quality to data drift, and how this fits in the model lifecycle. We also cover the engineering aspect of ML observability and how to integrate it with your ML services and pipelines.

## Course structure

ML observability course is organized into six modules. You can follow the complete course syllabus or pick only the modules that are most relevant to you.

{% content-ref url="ml-observability-course/module-1-introduction" %}
[module-1-introduction](ml-observability-course/module-1-introduction)
{% endcontent-ref %}

{% content-ref url="ml-observability-course/module-2-ml-monitoring-metrics" %}
[module-2-ml-monitoring-metrics](ml-observability-course/module-2-ml-monitoring-metrics)
{% endcontent-ref %}

{% content-ref url="ml-observability-course/module-3-ml-monitoring-for-unstructured-data" %}
[module-3-ml-monitoring-for-unstructured-data](ml-observability-course/module-3-ml-monitoring-for-unstructured-data)
{% endcontent-ref %}

{% content-ref url="ml-observability-course/module-4-designing-effective-ml-monitoring" %}
[module-4-designing-effective-ml-monitoring](ml-observability-course/module-4-designing-effective-ml-monitoring)
{% endcontent-ref %}

{% content-ref url="ml-observability-course/module-5-ml-pipelines-validation-and-testing" %}
[module-5-ml-pipelines-validation-and-testing](ml-observability-course/module-5-ml-pipelines-validation-and-testing)
{% endcontent-ref %}

{% content-ref url="ml-observability-course/module-6-deploying-an-ml-monitoring-dashboard" %}
[module-6-deploying-an-ml-monitoring-dashboard](ml-observability-course/module-6-deploying-an-ml-monitoring-dashboard)
{% endcontent-ref %}

## Course calendar and deadlines for the 2023 cohort

The 2023 cohort has completed. You can learn at your own pace or [sign up](https://www.evidentlyai.com/ml-observability-course) for the next cohort.

| Module                                                                                                                                                                       | Week                                                                        |
| ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | --------------------------------------------------------------------------- |
| [Module 1: Introduction to ML monitoring and observability](https://learn.evidentlyai.com/ml-observability-course/module-1-introduction)                                     | October 16, 2023                                                            |
| [Module 2: ML monitoring metrics: model quality, data quality, data drift](https://learn.evidentlyai.com/ml-observability-course/module-2-ml-monitoring-metrics)             | October 23, 2023                                                            |
| [Module 3: ML monitoring for unstructured data: NLP, LLM and embeddings](https://learn.evidentlyai.com/ml-observability-course/module-3-ml-monitoring-for-unstructured-data) | October 30, 2023                                                            |
| [Module 4: Designing effective ML monitoring](https://learn.evidentlyai.com/ml-observability-course/module-4-designing-effective-ml-monitoring)                              | November 6, 2023                                                            |
| [Module 5: ML pipelines validation and testing](https://learn.evidentlyai.com/ml-observability-course/module-5-ml-pipelines-validation-and-testing)                          | November 13, 2023                                                           |
| [Module 6: Deploying an ML monitoring dashboard](https://learn.evidentlyai.com/ml-observability-course/module-6-deploying-an-ml-monitoring-dashboard)                        | November 20, 2023                                                           |
| Final assignment                                                                                                                                                             | <p>November 27, 2023<br><br>Quizzes and assignment due December 4, 2023</p> |

## Our approach

* **Blend of theory and practice**. The course combines key concepts of ML observability and monitoring with practice-oriented tasks.
* **Practical code examples**. We provide end-to-end deployment blueprints and walk you through the code examples.
* **Focus on open-source**. The course is built upon open-source tools to make ML observability accessible to all.
* **The course is free and open to everyone**. All course videos are public so you can rewatch them anytime.

## Prerequisites

There are both theoretical and code-focused modules that require knowledge of Python. We will walk you through the code, but you can skip these parts and still learn a lot.

## Who is it for

This course is useful to professionals who have dealt with ML models in production and those preparing to deploy ML models:

* Data scientists,
* ML engineers,
* Technical product managers,
* Analysts.

Let’s dive in!
