Graphology analysis for detecting hexaco personality and character through handwriting images by using convolutional neural networks and particle swarm optimization methods

Authors

  • Alvin Barata Esa Unggul University
  • Habibullah Akbar Esa Unggul University
  • Marzuki Pilliang Esa Unggul University
  • Anwar Nasihin Esa Unggul University

DOI:

https://doi.org/10.12928/ijio.v3i2.6242

Keywords:

Convolutional Neural Network, Particle Swarm Optimization, Handwriting, Personality and Character, Machine Learning Classification

Abstract

Graphology or handwriting analysis can be used to infer the traits of the writers by examining each stroke, space, pressure, and pattern of the handwriting. In this study, we infer a six-dimensional model of human personality (HEXACO) using a Convolutional Neural Network supported by Particle Swarm Optimization. These personalities include Honesty-Humility, Emotionality, eXtraversion, Agreeableness (versus Anger), Conscientiousness, and Openness to Experience. A digital handwriting sample data of 293 different individuals associated with 36 types of personalities were collected and derived from the HEXACO space. A convolutional neural network model called GraphoNet is built and optimized using Particle Swarm Optimization (PSO). The PSO is used to optimize epoch, minibatch, and droupout parameters on the GraphoNet. Although predicting 32 personalities is quite challenging, the GraphoNet predicts personalities with 71.88% accuracy using epoch 100, minibatch 30 and dropout 52% while standard AlexNet only achieves 25%. Moreover, GraphoNet can work with lower resolution (32 x 32 pixels) compared to standard AlexNet (227 x 227 pixels).

Author Biography

Marzuki Pilliang, Esa Unggul University

Faculty of Computer Science

References

F. Rizvi and M. S. H. Khiyal, “Personality prediction through offline handwriting analysis,” J. Multidiscip. Eng. Sci. Stud., vol. 3, no. 1, pp. 1282–1288, 2017.

K. Chaudhari and A. Thakkar, “Survey on handwriting-based personality trait identification,” Expert Syst. Appl., vol. 124, pp. 282–308, 2019.

N. Punetha, A. K. Pal, and V. Sharma, “Behavior Prediction of Human by Signature and Handwriting Analysis Using Matlab,” 2020.

M. Gavrilescu and N. Vizireanu, “Predicting the Big Five personality traits from handwriting,” EURASIP J. Image Video Process., vol. 2018, no. 1, pp. 1–17, 2018.

A. R. Pathak, A. Raut, S. Pawar, M. Nangare, H. S. Abbott, and P. Chandak, “Personality analysis through handwriting recognition,” J. Discret. Math. Sci. Cryptogr., vol. 23, no. 1, pp. 19–33, 2020.

A. U. Rahman, “Towards Development of Computational Methods for Handwriting Analysis with Focus on Writer Identification, Personality Prediction, and Emotion Detection,” Ghulam Ishaq Khan Institute of Engineering Sciences and Technology, 2022.

M. S. Anari, K. Rezaee, and A. Ahmadi, “TraitLWNet: a novel predictor of personality trait by analyzing Persian handwriting based on lightweight deep convolutional neural network,” Multimed. Tools Appl., vol. 81, no. 8, pp. 10673–10693, 2022.

J. E. Valdez-Rodr’iguez, H. Calvo, and E. M. Felipe-Riveron, “Handwritten Texts for personality identification using convolutional neural networks,” in International Conference on Pattern Recognition, 2018, pp. 140–145.

S. H. Fatimah, E. C. Djamal, R. Ilyas, and F. Renaldi, “Personality features identification from handwriting using convolutional neural networks,” in 2019 4th International Conference on Information Technology, Information Systems and Electrical Engineering (ICITISEE), 2019, pp. 119–124.

N. Lemos, K. Shah, R. Rade, and D. Shah, “Personality prediction based on handwriting using machine learning,” in 2018 International Conference on Computational Techniques, Electronics and Mechanical Systems (CTEMS), 2018, pp. 110–113.

A. Chitlangia and G. Malathi, “Handwriting analysis based on histogram of oriented gradient for predicting personality traits using SVM,” Procedia Comput. Sci., vol. 165, pp. 384–390, 2019.

A. A. Elngar, N. Jain, D. Sharma, H. Negi, A. Trehan, and A. Srivastava, “A deep learning based analysis of the big five personality traits from handwriting samples using image processing,” J. Inf. Technol. Manag., vol. 12, no. Special Issue: Deep Learning for Visual Information Analytics and Management., pp. 3–35, 2020.

S. Ghosh, P. Shivakumara, P. Roy, U. Pal, and T. Lu, “Graphology based handwritten character analysis for human behaviour identification,” CAAI Trans. Intell. Technol., vol. 5, no. 1, pp. 55–65, 2020.

S. Thomas, M. Goel, and D. Agrawal, “A framework for analyzing financial behavior using machine learning classification of personality through handwriting analysis,” J. Behav. Exp. Financ., vol. 26, p. 100315, 2020.

W. Ilmini and T. G. I. Fernando, “Computational personality traits assessment: A review,” in 2017 IEEE International Conference on Industrial and Information Systems (ICIIS), 2017, pp. 1–6.

R. K. Samsuryadi and F. S. Mohamad, “Automated handwriting analysis based on pattern recognition: A survey,” Indones. J. Electr. Eng. Comput. Sci., vol. 22, no. 1, pp. 196–206, 2021.

M. Gavrilescu, “Study on determining the Myers-Briggs personality type based on individual’s handwriting,” in 2015 E-Health and Bioengineering Conference (EHB), 2015, pp. 1–6.

B. Fallah and H. Khotanlou, “Identify human personality parameters based on handwriting using neural network,” in 2016 Artificial Intelligence and Robotics (IRANOPEN), 2016, pp. 120–126.

D. Pratiwi, G. B. Santoso, and F. H. Saputri, “Personality type assessment system by using enneagram-graphology techniques on digital handwriting,” Int. J. Comput. Appl., vol. 147, no. 11, 2016.

I. Ramadhan, H. Akbar, G. Firmansyah, and A. Mulyo, “Predictions of Six Personality Characters (HEXACO) from Social Media using Random Forest Classifier and Particle Swarm Optimization,” 2021.

A. Krizhevsky, I. Sutskever, and G. E. Hinton, “Imagenet classification with deep convolutional neural networks,” Adv. Neural Inf. Process. Syst., vol. 25, pp. 1097–1105, 2012.

H. Akbar, N. Anwar, S. Rohajawati, A. Yulfitri, and H. S. Kaurani, “Optimizing AlexNet using Swarm Intelligence for Cervical Cancer Classification,” in 2021 International Symposium on Electronics and Smart Devices (ISESD), 2021, pp. 1–6.

J. Kennedy and R. Eberhart, “Particle swarm optimization,” in Proceedings of ICNN’95-international conference on neural networks, 1995, vol. 4, pp. 1942–1948.

M. C. Ashton and K. Lee, “The HEXACO--60: A short measure of the major dimensions of personality,” J. Pers. Assess., vol. 91, no. 4, pp. 340–345, 2009.

K. Lee and M. C. Ashton, “The Hexaco Personality Inventory - Revised, A Measure Of The Six Major Dimensions Of Personality,” 2009. Available : https://hexaco.org/scaledescriptions

Karpova, V., Popenova, P., Glebko, N., Lyashenko, V., & Perepelkina, O. (2020). “Was It You Who Stole 500 Rubles?” - The Multimodal Deception Detection. Companion Publication of the 2020 International Conference on Multimodal Interaction, 112–119. Available : https://doi.org/10.1145/3395035.3425638

Pletzer, J. L., Bentvelzen, M., Oostrom, J. K., & de Vries, R. E. (2019). A meta-analysis of the relations between personality and workplace deviance: Big Five versus HEXACO. Journal of Vocational Behavior, 112(February), 369–383. Available : https://doi.org/10.1016/j.jvb.2019.04.004

Taghvaei, N., Masoumi, B., & Keyvanpour, M. R. (2021). A Hybrid Framework for Personality Prediction based on Fuzzy Neural Networks and Deep Neural Networks. Technology Journal of Artificial Intelligence and Data Mining, 9(3), 283–294. Available : https://doi.org/10.22044/jadm.2021.10583.2197

Anglim, J., Knowles, E. R. V., Dunlop, P. D., & Marty, A. (2017). HEXACO personality and Schwartz’s personal values: A facet-level analysis. Journal of Research in Personality, 68, 23–31. Available : https://doi.org/10.1016/j.jrp.2017.04.002

de Vries, R. E., Tybur, J. M., Pollet, T. V., & van Vugt, M. (2016). Evolution, situational affordances, and the HEXACO model of personality. Evolution and Human Behavior, 37(5), 407–421. Available : https://doi.org/10.1016/j.evolhumbehav.2016.04.001

Downloads

Published

2022-09-20

How to Cite

Barata, A., Akbar, H., Pilliang, M. ., & Nasihin, A. (2022). Graphology analysis for detecting hexaco personality and character through handwriting images by using convolutional neural networks and particle swarm optimization methods. International Journal of Industrial Optimization, 3(2), 110–120. https://doi.org/10.12928/ijio.v3i2.6242

Issue

Section

Articles