Model Drift
Model drift is the degradation of an AI model's performance over time as the data it sees in production diverges from the distribution it was trained on — the silent failure mode of every deployed ML system.
Full definition
Drift comes in two flavors: data drift (input distribution changes — new product categories, post-COVID consumer behavior, new fraud patterns) and concept drift (the relationship between inputs and outputs changes — what counted as "spam" in 2018 vs 2025). Detection requires continuous monitoring of input statistics, output distributions, and ground-truth feedback. Mitigation is usually retraining, sometimes architectural changes.
Why it matters
Models that worked great in pilot fail silently in production. A 2-3% accuracy drift can erase a year of ROI in fraud detection, demand forecasting, or pricing. Drift monitoring is non-negotiable governance for any model in regulated production use; the EU AI Act explicitly requires it for high-risk systems.
Example
A demand-forecasting model deployed in 2019 collapsed during COVID-19 because consumer behaviour shifted overnight outside its training distribution. Companies with active drift monitoring caught it in days; others discovered it only after stockouts and excess inventory hit P&L.
Related terms
- MLOpsMLOps is the discipline of operating machine-learning and AI systems reliably in production — covering data pipelines, model training, deployment, monitoring, drift detection, governance, and incident response — analogous to DevOps for traditional software.
- Training DataTraining data is the curated dataset used to teach a machine-learning model — every pattern the model can recognize, every bias it inherits, and every limit to its accuracy ultimately traces back to this data.
- AI GovernanceAI governance is the framework of policies, roles, controls, and processes an organization uses to ensure its AI systems are lawful, safe, fair, accountable, and aligned with business intent — across the full lifecycle from problem framing to retirement.
- AI AuditAn AI audit is a structured, evidence-based examination of an AI system or AI program against defined criteria — covering training data, model, deployment context, monitoring, and governance — performed by an internal team, an external firm, or a regulator.
- ModelAn AI model is the trained artifact — a specific set of numerical weights plus an architecture — produced when a learning algorithm runs against training data, and the thing that actually gets deployed and audited.
Source & further reading
Primary source: Gama et al. — "A Survey on Concept Drift Adaptation" (ACM Computing Surveys) (2014).
Citation policy: this entry is part of the AIDOLS AI Implementation Glossary and may be quoted for research, journalism, and education with attribution to aidolsgroup.com/it/glossary/model-drift/.