An Efficient Model Maintenance Approach for MLOps Article Swipe

MAKE IMPACT

Forough Majidi , Foutse Khomh , Heng Li , Amin Nikanjam · YOU? · · 2024 · Open Access · · DOI: https://doi.org/10.48550/arxiv.2412.04657

In recent years, many industries have utilized machine learning (ML) models in their systems. Ideally, ML models should be trained on and applied to data from the same distributions. However, the data evolves over time in many application areas, leading to concept drift, which in turn causes the performance of the ML models to degrade over time. Therefore, maintaining up-to-date ML models plays a critical role in the MLOps pipeline. Existing ML model maintenance approaches are often computationally resource-intensive, costly, time-consuming, and model-dependent. Thus, we propose an improved MLOps pipeline, a new model maintenance approach and a Similarity-Based Model Reuse (SimReuse) tool to address the challenges of ML model maintenance. We identify seasonal and recurrent data distribution patterns in time series datasets throughout a preliminary study. Recurrent data distribution patterns enable us to reuse previously trained models for similar distributions in the future, thus avoiding frequent unnecessary retrainings. Then, we integrated the model reuse approach into the MLOps pipeline and proposed our improved MLOps pipeline. Furthermore, we develop SimReuse, a tool to implement the new components of our MLOps pipeline to store models and reuse them for inference of data segments with similar data distributions in the future. Our evaluation results on five time series datasets demonstrate that our model reuse approach can maintain the models' performance while significantly reducing maintenance time, costs, and the number of retrainings. Our model reuse approach achieves ML model performance comparable to the best baselines, while reducing the computation time and costs to 1/8th. Therefore, industries and practitioners can benefit from our approach and use our tool to maintain their ML models' performance in the deployment phase to reduce their maintenance time and costs.

Type

preprint

Language

en

Landing Page

http://arxiv.org/abs/2412.04657

PDF

https://arxiv.org/pdf/2412.04657

OA Status

green

Related Works

10

OpenAlex ID

https://openalex.org/W4405173298

Raw OpenAlex JSON

OpenAlex ID

https://openalex.org/W4405173298

Canonical identifier for this work in OpenAlex

DOI

https://doi.org/10.48550/arxiv.2412.04657

Digital Object Identifier

Title

An Efficient Model Maintenance Approach for MLOps

Work title

Type

preprint

OpenAlex work type

Language

en

Primary language

Publication year

2024

Year of publication

Publication date

2024-12-05

Full publication date if available

Authors

Forough Majidi, Foutse Khomh, Heng Li, Amin Nikanjam

List of authors in order

Landing page

https://arxiv.org/abs/2412.04657

Publisher landing page

PDF URL

https://arxiv.org/pdf/2412.04657

Direct link to full text PDF

Open access

Yes

Whether a free full text is available

OA status

green

Open access status per OpenAlex

OA URL

https://arxiv.org/pdf/2412.04657

Direct OA link when available

Concepts

Computer science, Business

Top concepts (fields/topics) attached by OpenAlex

Cited by

0

Total citation count in OpenAlex

Related works (count)

10

Other works algorithmically related by OpenAlex

Full payload