A code example walkthrough of creating a live ML monitoring dashboard for online architecture using Evidently.
Last updated
Video 3. , by Emeli Dral
In this video, we create a live ML monitoring dashboard for an ML model deployed as a service. We imitate sending the live data directly from the machine learning service to the ML monitoring service and update the dashboard in near real-time.
Want to go straight to code? Here is the to follow along.
Outline: Introduction Script overview and imports Define Collector, Workspace, and Project variables Load data and create mini-batches to simulate production usage Implement the function to generate Test Suites Create the Workspace, Project and add Dashboard panels Set up and configure the Collector service Simulate sending data to the Collector Implement the main function, run and debug the script Run the Collector and view the online Dashboard updates Recap and next steps