This paper proposes a method for generating comic style Chernoff face with generative adversarial network (GAN) as a first step towards the generation of data comics from multi-dimensional data. The proposed method converts Chernoff face into comic style face images based on the combination of CycleGAN and Pix2Pix. Since both Chernoff face graph and comic images do not have enough information for direct conversion, the Chernoff face graphs are converted into photo style face images and then converted into comic images. A questionnaire asking to rank face images according to the specified impressions is conducted to evaluate the proposed method. The result of the questionnaire shows that the proposed method achieved the same level of consistency among answerers’ judgments as original Chernoff face. It is also confirmed that the proposed method can express the difference in attribute values with mouth parts.

1. [1] M. Côté, P. M. Jodoin, C. Donohue, and V. Ostromoukhov, “Non-photorealistic rendering of hair for animated cartoons,” Proc. of GRAPHICON’04, 2004.
2. [2] X. Chen, C. Xu, X. Yang, L. Song, and D. Tao, “Gated-GAN: Adversarial gated networks for multi-collection style transfer,” IEEE Trans. on Image Processing, Vol.28, No.2, pp. 546-560, 2018. https://doi.org/10.1109/TIP.2018.2869695
3. [3] Z. Wang, H. Dingwall, and B. Bach, “Teaching data visualization and storytelling with data comic workshops,” Extended abstracts of the 2019 CHI Conf. on Human Factors in Computing Systems, 2019. https://doi.org/10.1145/3290607.3299043
4. [4] H. Chernoff, “The use of faces to represent points in k-dimensional space graphically,” J. of the American Statistical Association, Vol.68, No.342, pp. 361-368, 1973. https://doi.org/doi.org/10.2307/2284077
5. [5] P. Isola, J. Y. Zhu, T. Zhou, and A. A. Efros, “Image-to-image translation with conditional adversarial networks,” Proc. of the IEEE Conf. on Computer Vision and Pattern Recognition, pp. 1125-1134, 2017. https://doi.org/10.48550/arXiv.1611.07004
6. [6] J. Y. Zhu, T. Park, P. Isola, and A. A. Efros, “Unpaired image-to-image translation using cycle-consistent adversarial networks,” Proc. of the IEEE Int. Conf. on Computer Vision, pp. 2223-2232, 2017. https://doi.org/10.48550/arXiv.1703.10593
7. [7] Y.-C. Chen, H. Shibata, L.-H. Chen, and Y. Takama, “Synthesis of comic-style portraits using combination of CycleGAN and Pix2Pix,” J. Adv. Comput. Intell. Intell. Inform., Vol.28, No.5, 2024. https://doi.org/10.20965/jaciii.2024.p1085
8. [8] M. G. Kendall and B. B. Smith, “The problem of m rankings,” The Annals of Mathematical Statistics, Vol.10, No.3, pp. 275-287, 1939. https://doi.org/10.1214/aoms/1177732186
9. [9] Y. S. Kim and L. Cooke, “Big data analysis of public library operations and services by using the Chernoff face method,” J. of Documentation, Vol.73, No.3, pp. 466-480, 2017. https://doi.org/10.1108/JD-08-2016-0098
10. [10] M. Rahu, “Graphical representation of cancer incidence data: Chernoff faces,” Int. J. of Epidemiology, Vol.18, No.4, pp. 763-767, 1989. https://doi.org/10.1093/ije/18.4.763
11. [11] G. Terlouw, J. T. van’t Veer, J. T. Prins, D. A. Kuipers, and J. P. E. Pierie, “Design of a digital comic creator (It’s me) to facilitate social skills training for children with autism spectrum disorder: Design research approach,” JMIR Mental Health, Vol.7, No.7, Article No.e17260, 2020. https://doi.org/10.2196/17260
12. [12] J. Chen, G. Liu, and X. Chen, “AnimeGAN: a novel lightweight GAN for photo animation,” Int. Symp. on Intelligence Computation and Applications, pp. 242-256, 2020. https://doi.org/10.1007/978-981-15-5577-0_18
13. [13] H. Fukushima, Y. Uchida, and K. Araki, “Characteristic analysis of onomatopoeia that appears in comic panel images,” Proc. of the 38th Fuzzy System Symp., pp. 576-579, 2022 (in Japanese).
14. [14] S. Watanabe, H. Mochizuki, K. Ninomiya, M. Kajita, and S. Nakamura, “Study on automatic clothing region extraction and impression estimation for impression-based comic search,” Proc. of 4th Conf. on Comic Computing, pp. 38-45 , 2020 (in Japanese). https://doi.org/10.1007/978-3-030-50732-9_88
15. [15] R. Yamashita, B. Park, and M. Matsushita, “Support for exploratory information access based on comic content information,” Trans. of the Japanese Society for Artificial Intelligence, Vol.32, No.1, WII-D_1, 2017 (in Japanese). https://doi.org/10.1527/tjsai.WII-D
16. [16] R. Rombach, A. Blattmann, D. Lorenz, P. Esser, and B. Ommer, “High-resolution image synthesis with latent diffusion models,” Proc. of the IEEE/CVF Conf. on Computer Vision and Pattern Recognition, pp. 10684-10695, 2022. https://doi.org/10.48550/arXiv.2112.10752
17. [17] WOFS (World of Feng Shui), “Nine indications of WEALTH on your FACE,” 2012. https://www.wofs.com/nine-indications-of-wealth-on-your-face/ [Accessed December 26, 2024]
18. [18] R. C. Schmidt, “Managing Delphi surveys using nonparametric statistical techniques,” Decision Sciences, Vol.28, No.3, pp. 763-774, 1997. https://doi.org/10.1111/j.1540-5915.1997.tb01330.x
19. [19] Y. Wang, L. Wang, Y. Li, D. He, T.-Y. Liu, and W. Chen, “A theoretical analysis of NDCG type ranking measures,” Annual Conf. on Learning Theory, pp. 25-54, 2013. https://doi.org/10.48550/arXiv.1304.6480
20. [20] TOPLOG, “What are the eyebrows that make a baby face look sophisticated? How to draw eyebrows and makeup tips,” 2019 (in Japanese). https://toplog.jp/722037 [Accessed December 26, 2024]