How Telepass monitor ML models using the new Vertex AI Model Monitoring
In the rapidly evolving world of toll and mobility services, Telepass has emerged as a leading provider across Italy and numerous European countries. In recent years, Telepass made a strategic decision to accelerate the development of machine learning solutions by embracing MLOps. Within the past year, Telepass has successfully implemented a comprehensive MLOps platform, enabling the robust deployment of various ML use cases.
As of today, the Telepass team has utilized this MLOps framework to develop, test, and seamlessly deploy – through continuous deployment – more than 80 training pipelines that run monthly. These pipelines cover over 10 distinct use cases, including precise churn prediction for forecasting customer attrition, propensity modeling for tailored customer interactions, and data-driven customer clustering strategies.
Despite these achievements, Telepass realized that they lacked a system for identifying feature drift and an event-driven re-training mechanism triggered by anomalies in data distribution. To address this need and integrate monitoring into their existing MLOps framework to automate the re-training process, Telepass partnered with Google Cloud as an early adopter of Vertex AI Model Monitoring.
In the words of Telepass:
“Through strategic integration of the new Vertex AI Model Monitoring alongside our established Vertex AI infrastructure, our team has achieved unparalleled heights in model quality assurance and MLOps efficiency. By facilitating timely retraining, we consistently elevate our performance, delivering impactful outcomes that exceed the expectations of our stakeholders.”
What’s next
Are you struggling in monitoring your AI/ML model at scale?
With the new Vertex AI Model Monitoring, you can manage model monitoring of any of your models and ensure their performance in production.
If you want to know more about the new Vertex AI Model Monitoring , check out the following resources:
- Documentation
- Github samples
Preview Notice
This product or feature is subject to the “Pre-GA Offerings Terms” in the General Service Terms section of the Service Specific Terms. Pre-GA products and features are available “as is” and might have limited support. For more information, see the launch stage descriptions. Though the new Vertex AI Model Monitoring is intended for monitoring production model serving, please wait until it is GA before relying on it for business critical workloads, and/or processing personal or sensitive data.
