6.4. ML monitoring with Evidently and Grafana [OPTIONAL CODE PRACTICE]

A code example walkthrough of adding ML monitoring metrics to Grafana using Evidently as an evaluation layer.

Video 4. ML monitoring with Evidently and Grafana [OPTIONAL CODE PRACTICE], by Emeli Dral

In this video, we show how to add ML monitoring metrics to the Grafana dashboard using Evidently as an evaluation layer and storing the metrics in a Postgres database.

Want to go straight to code? Here is the code example to follow along.

Outline: 00:00 Introduction 00:25 Install Grafana and set up the Postgres database 03:18 Script overview, imports, and logging 04:50 Create a table statement 06:30 Load data and simulate production usage 07:30 Connect to a database and create a table 10:32 Calculate metrics and insert them into Postgres 16:00 Write a function to compute metrics in batches 18:58 Run services, execute and debug the script 23:21 Create dashboards in Grafana