Modeling the Distribution of Normal Data in Pre-Trained Deep Features\n for Anomaly Detection Article Swipe

MAKE IMPACT

Oliver Rippel , Patrick Mertens , Dorit Merhof · YOU? · · 2020 · Open Access · · DOI: https://doi.org/10.48550/arxiv.2005.14140

Anomaly Detection (AD) in images is a fundamental computer vision problem and\nrefers to identifying images and image substructures that deviate significantly\nfrom the norm. Popular AD algorithms commonly try to learn a model of normality\nfrom scratch using task specific datasets, but are limited to semi-supervised\napproaches employing mostly normal data due to the inaccessibility of anomalies\non a large scale combined with the ambiguous nature of anomaly appearance.\n We follow an alternative approach and demonstrate that deep feature\nrepresentations learned by discriminative models on large natural image\ndatasets are well suited to describe normality and detect even subtle anomalies\nin a transfer learning setting. Our model of normality is established by\nfitting a multivariate Gaussian (MVG) to deep feature representations of\nclassification networks trained on ImageNet using normal data only. By\nsubsequently applying the Mahalanobis distance as the anomaly score we\noutperform the current state of the art on the public MVTec AD dataset,\nachieving an AUROC value of $95.8 \\pm 1.2$ (mean $\\pm$ SEM) over all 15\nclasses. We further investigate why the learned representations are\ndiscriminative to the AD task using Principal Component Analysis. We find that\nthe principal components containing little variance in normal data are the ones\ncrucial for discriminating between normal and anomalous instances. This gives a\npossible explanation to the often sub-par performance of AD approaches trained\nfrom scratch using normal data only. By selectively fitting a MVG to these most\nrelevant components only, we are able to further reduce model complexity while\nretaining AD performance. We also investigate setting the working point by\nselecting acceptable False Positive Rate thresholds based on the MVG\nassumption.\n Code available at https://github.com/ORippler/gaussian-ad-mvtec\n

Type

preprint

Language

en

Landing Page

http://arxiv.org/abs/2005.14140

PDF

https://arxiv.org/pdf/2005.14140

OA Status

green

Related Works

10

OpenAlex ID

https://openalex.org/W4287774492

Raw OpenAlex JSON

OpenAlex ID

https://openalex.org/W4287774492

Canonical identifier for this work in OpenAlex

DOI

https://doi.org/10.48550/arxiv.2005.14140

Digital Object Identifier

Title

Modeling the Distribution of Normal Data in Pre-Trained Deep Features\n for Anomaly Detection

Work title

Type

preprint

OpenAlex work type

Language

en

Primary language

Publication year

2020

Year of publication

Publication date

2020-05-28

Full publication date if available

Authors

Oliver Rippel, Patrick Mertens, Dorit Merhof

List of authors in order

Landing page

https://arxiv.org/abs/2005.14140

Publisher landing page

PDF URL

https://arxiv.org/pdf/2005.14140

Direct link to full text PDF

Open access

Yes

Whether a free full text is available

OA status

green

Open access status per OpenAlex

OA URL

https://arxiv.org/pdf/2005.14140

Direct OA link when available

Concepts

Artificial intelligence, Discriminative model, Pattern recognition (psychology), Normality, Computer science, Anomaly detection, Multivariate normal distribution, Anomaly (physics), Feature (linguistics), Mahalanobis distance, Principal component analysis, Machine learning, Multivariate statistics, Mathematics, Statistics, Physics, Condensed matter physics, Linguistics, Philosophy

Top concepts (fields/topics) attached by OpenAlex

Cited by

0

Total citation count in OpenAlex

Related works (count)

10

Other works algorithmically related by OpenAlex

Full payload