6.2. ML model monitoring dashboard with Evidently. Batch architecture [CODE PRACTICE]

A code example walkthrough of creating a live ML monitoring dashboard for batch architecture using Evidently.

Video 2. ML model monitoring dashboard with Evidently. Batch architecture [CODE PRACTICE], by Emeli Dral

In this video, we create a script to generate Reports and Test Suites for several batches of data and design different panels to display on a live ML monitoring dashboard.

Want to go straight to code? Here is the code example to follow along.

Outline: 00:00 Introduction 00:47 Overview of the script 02:27 Imports 03:28 Create global variables 05:41 Load the data 07:19 Implement the function to generate Reports and Test Suites 11:32 Create a Project 13:53 Add a counter panel (dashboard title) 15:10 How to filter which data to display 16:31 Add a line plot panel (target drift) 19:55 Add a bar plot panel (dataset drift) 21:23 Add test suite panels 22:47 Implement the function to generate the Dashboard 23:46 Live script debugging 27:11 Run the script and monitoring service 28:36 View and explore the dashboard in the browser 30:21 View the individual Reports and Test Suites 31:38 Recap and next steps