3.5. Monitoring text data [CODE PRACTICE]

A code example walkthrough of unstructured data evaluations using the open-source Evidently Python library.

Video 5. Monitoring text data [CODE PRACTICE], by Emeli Dral

In this video, we walk you through the code example of evaluations for unstructured data using the open-source Evidently Python library.

Want to go straight to code? Here is the example notebook to follow along.

Links to docs:

• Text overview

• Embeddings

Outline: 00:00 Import libraries and datasets 02:26 Prepare a multimodal dataset with raw text 08:15 Text data overview report 11:18 Model-based text data drift detection 13:49 Adding custom text descriptors to report 17:50 Custom report with descriptor drift detection 23:55 Embedding drift detection

That’s it! We covered three use cases for evaluating unstructured data – multimodal data with raw text, detecting drift in text data with descriptors, and embedding drift detection – and learned to derive actionable metrics.