FMCG

Centralized GCP MLOps Platform for Cost Efficiency and Streamlined Development

Client

Global FMCG / CPG Company

Date

Services

MLOps

Technologies

GCP, Kubeflow, BigQuery, Kubernetes, Python, Docker, CI/CD with GitHub Actions

Challenge

The client faced significant challenges in developing, deploying, and maintaining multiple ML production-ready use cases across various cloud platforms. This fragmented approach led to inefficiencies in resource utilization and maintenance efforts. They sought a unified solution to centralize ML operations onto a scalable platform while streamlining development and deployment processes through effective CI/CD practices.

Our approach

Our team initiated a comprehensive project to centralize the client's diverse ML use cases onto Google Cloud Platform (GCP). Utilizing GCP's robust infrastructure and services, we designed and implemented a flexible and scalable platform tailored to their operational needs.

Key components of the solution included:

  • Automated CI/CD processes that adhere to organizational standards and best practices.
  • Auto-ticketing system for the operations team, triggering emails and tickets when ML pipelines failed.
  • Resource autoscaling and consumption logging to ensure efficient resource usage.
  • Model versioning, monitoring, and retraining pipelines, which are automatically triggered in response to data or concept drift.

The outcome

Through the strategic application of GCP and innovative tools like Docker, Kubernetes, and CI/CD, we successfully enhanced and standardized the client's ML development lifecycle. The solution provided a centralized platform, enabling cost-efficient and agile operations. This transformation empowered the client to maintain a competitive edge in their fast-paced industry.