Manara - Qatar Research Repository
Browse
10.1186_s40537-021-00469-z.pdf (4.03 MB)

Unsupervised outlier detection in multidimensional data

Download (4.03 MB)
journal contribution
posted on 2022-11-22, 21:18 authored by Atiq ur Rehman, Samir Brahim Belhaouari

Detection and removal of outliers in a dataset is a fundamental preprocessing task without which the analysis of the data can be misleading. Furthermore, the existence of anomalies in the data can heavily degrade the performance of machine learning algorithms. In order to detect the anomalies in a dataset in an unsupervised manner, some novel statistical techniques are proposed in this paper. The proposed techniques are based on statistical methods considering data compactness and other properties. The newly proposed ideas are found efficient in terms of performance, ease of implementation, and computational complexity. Furthermore, two proposed techniques presented in this paper use transformation of data to a unidimensional distance space to detect the outliers, so irrespective of the data’s high dimensions, the techniques remain computationally inexpensive and feasible. Comprehensive performance analysis of the proposed anomaly detection schemes is presented in the paper, and the newly proposed schemes are found better than the state-of-the-art methods when tested on several benchmark datasets.

Other Information

Published in: Journal of Big Data
License: https://creativecommons.org/licenses/by/4.0
See article on publisher's website: http://dx.doi.org/10.1186/s40537-021-00469-z

History

Language

  • English

Publisher

Springer Science and Business Media LLC

Publication Year

  • 2021

Institution affiliated with

  • Hamad Bin Khalifa University

Usage metrics

    Manara - Qatar Research Repository

    Licence

    Exports

    RefWorks
    BibTeX
    Ref. manager
    Endnote
    DataCite
    NLM
    DC