Multimodal EEG and Keystroke Dynamics Based Biometric System Using Machine Learning Algorithms

<p dir="ltr">Electroencephalography (EEG) based biometric systems are gaining attention for their anti-spoofing capability but lack accuracy due to signal variability at different psychological and physiological conditions. On the other hand, keystroke dynamics-based systems achieve very high accuracy but have low anti-spoofing capability. To address these issues, a novel multimodal biometric system combining EEG and keystroke dynamics is proposed in this paper. A dataset was created by acquiring both keystroke dynamics and EEG signals simultaneously from 10 users. Each user participated in 500 trials at 10 different sessions (days) to replicate real-life signal variability. A machine learning classification pipeline is developed using multi-domain feature extraction (time, frequency, time-frequency), feature selection (Gini impurity), classifier design, and score level fusion. Different classifiers were trained, validated, and tested for two different classification experiments - personalized and generalized. For identification and authentication, 99.9% and 99.6% accuracies are achieved, respectively for the Random Forest classifier in 5 fold cross-validation. These results outperform the individual modalities with a significant margin (~5%). We also developed a binary template matching-based algorithm, which gives 93.64% accuracy 6X faster. The proposed method can be considered secure and reliable for any kind of biometric identification and authentication.</p><h2>Other Information</h2><p dir="ltr">Published in: IEEE Access<br>License: <a href="https://creativecommons.org/licenses/by/4.0/legalcode" target="_blank">https://creativecommons.org/licenses/by/4.0/</a><br>See article on publisher's website: <a href="https://dx.doi.org/10.1109/access.2021.3092840" target="_blank">https://dx.doi.org/10.1109/access.2021.3092840</a></p>