KNN-Based Algorithm of Hard Case Detection in Datasets for Classification

Okhrimenko, Anton; Kussul, Nataliia

KNN-Based Algorithm of Hard Case Detection in Datasets for Classification

Файли

KNN-Based_Algo.pdf (884.75 KB)

Дата

2023

Автори

Okhrimenko, Anton

Kussul, Nataliia

Анотація

The machine learning models for classification are designed to find the best way to separate two or more classes. In case of class overlapping, there is no possible way to clearly separate such data. Any ML algorithm will fail to correctly classify a certain set of datapoints, which are surrounded by a significant number of another class data points at the feature space. However, being able to find such hardcases in a dataset allows using another set of rules than for normal data samples. In this work, we introduce a KNN-based detection algorithm of data points and subspaces for which the classification decision is ambiguous. The algorithm described in details along with demonstration on artificially generated dataset. Also, the possible usecases are discussed, including dataset quality assessment, custom ensemble strategy and data sampling modifications. The proposed algorithm can be used during full cycle of machine learning model developing, from forming train dataset to real case model inference.

Ключові слова

KNN, Dataset Quality Assessment, Imbalanced Datasets, Hard Cases

Бібліографічний опис

Okhrimenko, A. KNN-Based Algorithm of Hard Case Detection in Datasets for Classification / Anton Okhrimenko, Nataliia Kussul // In Proceedings of International Conference on Applied Innovation in IT, (ICAIIT). – 2023. – Pp. 113-118. – Bibliogr.: 10 ref.