Scalability and Efficiency: A Comparative Study of Face Recognition Technologies
Article Sidebar
Face Recognition,
Machine Learning ,
Olivetti dataset
Main Article Content
Mohd Zaki Zakaria
Misinem Misinem
Nyimas Sopiah
Lusiana Efrizoni
Abstract
This article addresses the challenge of selecting the most effective machine learning algorithm for face recognition tasks, a common problem in academic research and practical applications. To tackle this issue, we conducted a comparative analysis of five widely used algorithms: Linear Discriminant Analysis (LDA), Logistic Regression, Naive Bayes, K-Nearest Neighbors (KNN), and Support Vector Machine (SVM). The study involved implementing each algorithm on a standardized dataset, followed by a rigorous evaluation of their performance based on accuracy metrics. The results revealed that LDA, Logistic Regression, and SVM significantly outperformed the other models, each achieving an impressive accuracy of 97%. This high accuracy indicates that these algorithms are well-suited for handling datasets with linearly separable classes. Naive Bayes also showed a strong performance with 90% accuracy, proving effective under the feature independence assumption. However, KNN lagged, with an accuracy of 70%, highlighting its sensitivity to data scale and local structure, which affects its applicability in larger datasets or real-time scenarios. The findings suggest that while LDA, Logistic Regression, and SVM are optimal for datasets with clear class distinctions, the choice of an algorithm should still be guided by specific data characteristics and computational constraints. This study underscores the necessity for carefully considering each algorithm’s strengths and limitations, ensuring that the selected model aligns with the unique demands of the application. Future work could explore ensemble methods and advanced parameter tuning further to enhance the performance and robustness of these models.
Article Details
Copyright (c) 2024 Mohd Zaki Zakaria, Misinem Misinem, Nyimas Sopiah , Lusiana Efrizoni
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
References
Abu Alfeilat, H. A., Hassanat, A. B. A., Lasassmeh, O., Tarawneh, A. S., Alhasanat, M. B., Eyal Salman, H. S., & Prasath, V. B. S. (2019). Effects of Distance Measure Choice on K-Nearest Neighbor Classifier Performance: A Review. Big Data, 7(4), 221–248. https://doi.org/10.1089/big.2018.0175
Adjabi, I., Ouahabi, A., Benzaoui, A., & Taleb-Ahmed, A. (2020). Past, Present, and Future of Face Recognition: A Review. Electronics, 9(8). https://doi.org/10.3390/electronics 9081188
Alizadeh, S. H., Hediehloo, A., & Harzevili, N. S. (2021). Multi independent latent component extension of naive Bayes classifier. Knowledge-Based Systems, 213, 106646. https://doi.org/https://doi.org/10.1016/j.knosys.2020.106646
Cavazos, J. G., Phillips, P. J., Castillo, C. D., & O’Toole, A. J. (2021). Accuracy Comparison Across Face Recognition Algorithms: Where Are We on Measuring Race Bias? IEEE Transactions on Biometrics, Behavior, and Identity Science, 3(1), 101–111. https://doi.org/10.1109/TBIOM.2020.3027269
Cervantes, J., Garcia-Lamont, F., Rodríguez-Mazahua, L., & Lopez, A. (2020). A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing, 408, 189–215. https://doi.org/https://doi.org/10.1016/j.neucom.2019. 10.118
Dumitrescu, E., Hué, S., Hurlin, C., & Tokpavi, S. (2022). Machine learning for credit scoring: Improving logistic regression with non-linear decision-tree effects. European Journal of Operational Research, 297(3), 1178–1192. https://doi.org/https://doi.org/10.1016 /j.ejor.2021.06.053
Fatima, A., Shahid, A. R., Raza, B., Madni, T. M., & Janjua, U. I. (2020). State-of-the-Art Traditional to the Machine- and Deep-Learning-Based Skull Stripping Techniques, Models, and Algorithms. Journal of Digital Imaging, 33(6), 1443–1464. https://doi.org/10.1007/s10278-020-00367-5
Gill, S. S., Wu, H., Patros, P., Ottaviani, C., Arora, P., Pujol, V. C., Haunschild, D., Parlikad, A. K., Cetinkaya, O., Lutfiyya, H., Stankovski, V., Li, R., Ding, Y., Qadir, J., Abraham, A., Ghosh, S. K., Song, H. H., Sakellariou, R., Rana, O., … Buyya, R. (2024). Modern computing: Vision and challenges. Telematics and Informatics Reports, 13, 100116. https://doi.org/https://doi.org/10.1016/j.teler.2024.100116
Halder, R. K., Uddin, M. N., Uddin, Md. A., Aryal, S., & Khraisat, A. (2024). Enhancing K-nearest neighbor algorithm: a comprehensive review and performance analysis of modifications. Journal of Big Data, 11(1), 113. https://doi.org/10.1186/s40537-024-00973-y
Huang, C., Li, Y., Loy, C. C., & Tang, X. (2020). Deep Imbalanced Learning for Face Recognition and Attribute Prediction. IEEE Transactions on Pattern Analysis and Machine Intelligence, 42(11), 2781–2794. https://doi.org/10.1109/TPAMI.2019.2914680
Hussain, S. F. (2019). A novel robust kernel for classifying high-dimensional data using Support Vector Machines. Expert Systems with Applications, 131, 116–131. https://doi.org/https://doi.org/10.1016/j.eswa.2019.04.037
Jelodar, H., Wang, Y., Yuan, C., Feng, X., Jiang, X., Li, Y., & Zhao, L. (2019). Latent Dirichlet allocation (LDA) and topic modeling: models, applications, a survey. Multimedia Tools and Applications, 78(11), 15169–15211. https://doi.org/10.1007/s11042-018-6894-4
Khajenezhad, A., Bashiri, M. A., & Beigy, H. (2021). A distributed density estimation algorithm and its application to naive Bayes classification. Applied Soft Computing, 98, 106837. https://doi.org/https://doi.org/10.1016/j.asoc.2020.106837
Kortli, Y., Jridi, M., al Falou, A., & Atri, M. (2020). Face Recognition Systems: A Survey. Sensors, 20(2). https://doi.org/10.3390/s20020342
Mustafa A. D., & Mohsin A. A. . (2021). Machine Learning Applications based on SVM Classification A Review. Qubahan Academic Journal, 1(2), 81–90. https://doi.org/10.48161/qaj.v1n2a50
Reddy, G. T., Reddy, M. P. K., Lakshmanna, K., Kaluri, R., Rajput, D. S., Srivastava, G., & Baker, T. (2020). Analysis of Dimensionality Reduction Techniques on Big Data. IEEE Access, 8, 54776–54788. https://doi.org/10.1109/ACCESS.2020.2980942
Salehi, F., Abbasi, E., & Hassibi, B. (2019). The Impact of Regularization on High-dimensional Logistic Regression. In H. Wallach, H. Larochelle, A. Beygelzimer, F. d Alché-Buc, E. Fox, & R. Garnett (Eds.), Advances in Neural Information Processing Systems (Vol. 32). Curran Associates, Inc. https://proceedings.neurips.cc/paper_files/paper/2019/file/ab49ef78e2877bfd2c2bfa738e459bf0-Paper.pdf
Schober, P., & Vetter, T. R. (2021). Logistic Regression in Medical Research. Anesthesia & Analgesia, 132(2). https://journals.lww.com/anesthesia-analgesia/fulltext/2021/02000/logistic_regression_in_medical_research.12.aspx
Sharmila, Sharma, R., Kumar, D., Puranik, V., & Gautham, K. (2019). Performance Analysis of Human Face Recognition Techniques. 2019 4th International Conference on Internet of Things: Smart Innovation and Usages (IoT-SIU), 1–4. https://doi.org/10.1109/IoT-SIU.2019.8777610
Sheik M. I. (2017). olivetti. https://www.kaggle.com/datasets/imrandude/olivetti
Zhao, F., Li, J., Zhang, L., Li, Z., & Na, S.-G. (2020). Multi-view face recognition using deep neural networks. Future Generation Computer Systems, 111. https://doi.org/10.1016/j.future.2020.05.002
Zhao, S., Zhang, B., Yang, J., Zhou, J., & Xu, Y. (2024). Linear discriminant analysis. Nature Reviews Methods Primers, 4(1), 70. https://doi.org/10.1038/s43586-024-00346-y
Zaw, H. T., Maneerat, N., & Win, K. Y. (2019). Brain tumor detection based on Naïve Bayes Classification. 2019 5th International Conference on Engineering, Applied Sciences and Technology (ICEAST), 1–4. https://doi.org/10.1109/ICEAST.2019.8802562