PERCEPTION, AND RESONANCE: RESEARCH ON GENERATIVE AI IN DIGITAL PICTURE BOOK DESIGN

Authors

DOI:

https://doi.org/10.32782/2415-8151.2024.34.53

Keywords:

graphic design, generative ai, digital picture book design, stimulation, perception, resonance, project object.

Abstract

Abstract. The purpose. This research aims to the operation and role of generative AI in human-AI co-creation, with digital picture book design as the creative object. Using stimulation, perception, and resonance as the starting point, construct a human- AI collaboration model, and unleash the potential of emotional design in generative AI applications. Меthodology. By analyzing the current application of generative AI technology in story,image,sound and animation creation, summarizing the different work modes between human and generative AI, and using the three stages of emotional design influence the modeling construction. Results. Based on analysing the current situation of humans working with generative AI, this paper constructs a four-step research framework from stimulation, perception to resonance and feedback based on the three levels of emotional design. Through an analysis of the creation process and feedback from the digital picture book 'Umbrella', this study evaluates the advantages and disadvantages of such collaboration. It identifies respective strengths in both humans and AIs during the collaborative process and highlights a gap in generative AI's understanding of human semantics, which impacts emotional resonance. The study suggests that visual and auditory stimuli can enhance mutual understanding between generative AI and humans through repeated exposure. Finally, it constructs an ideal model for human-AI collaboration to guide further research. Scientific novelty. The research focuses on the human-AI collaboration model and how machine creations can understand humans and achieve emotional resonance. Practical significance. This study provides some reference on the communication pathways between generative AI and human work, and how emerging technologies can understand human emotions in the creative field in the future.

References

Hutson J., Lively J., Robertson B., Cotroneo P., Lang M. Creative Convergence: The AI Renaissance in Art and Design. CHAM: Springer Nature Switzerland, 2023. 242 р.

Kress G. Multimodality: A Social Semiotic Approach to Contemporary Communication. New York: Routledge, 2010. 236 р.

Kress G., Leeuwen T. Multimodal Discourse: The Modes and Media of Contemporary Communication. London: Arnold Publishers, 2001. 142 р.

Liu, W., Li, Z., Guo, Q., & Si, Y. Cultural and Creative Product Design Based on Emotional Needs of Generation Z: with Zhaowangcheng Heritage Park as an Example. Packaging Engineering, 2023. № 45 (23). P. 380–416.

Lyu Y., Shi M., Zhang Y., & Lin R. From image to imagination: Exploring the impact of generative AI on cultural translation in jewelry design. Sustainability. 2024. № 16(10). 65. https://doi.org/10.3390/ su16010065

Minsky M. The Emotional Machine. New York: Simon& Schster. 2007. 400 р.

Mootion.com is an intelligent tool for creating 2D/3D animations using AI, which can achieve fast and accurate action generation+creative AI video generation : web-site. URL: https://mootion.com/ (last accepted: 28.08.2024)

Moura F.T. Artificial Intelligence, Co-Creation and Creativity:The New Frontier for Innovation. London and New York: Routledge, 2024. 254 р.

Norman D. Emotional Design: Why We Love (or Hate) Everyday Things. NewYork: Basic books, 2007. 272 р.

Sargeant B. What is an ebook? What is a Book App? And Why Should We Care? An Analysis of Contemporary Digital Picture Books. Child Lit Educ 46, 2015. P. 454–466. https://doi.org/10.1007/ s10583-015-9243-5

Tadashi M. My Picture books. XinJiang: Younger press, 2017. 92 р.

王永(Wang Y.G.). AI动画的表现力与可控性 [Expressive and Controllable AI Animation]. URL: https://mp.weixin.qq.com/s/Izwa16yhjBH5F4iHZGQ9pw (last accepted: 01.07.2024)

刘维尚,李子翔,郭绮涵,等.(Liu Weishang, Li Zixiang, Guo Qihan, etc.). 基于Z世代情感化需求的 文创产品设计研究 – 以赵王城遗址公园为例. [Research on cultural and creative product design based on the emotional needs of Generation Z – Taking Zhaowangcheng Heritage Park as an example]. 包 装工程 – Packaging Engineering, 2023. № 44 (22). P. 368–380.

刘晓杨,夏铭晨 (Liu X., Xia M.). 图像生成式 人工智能Midjourney [Research on the visual narrative of story picture books generated by image-generative artificial intelligence Midjourney]. 包装工程 – Packaging Engineering, 2024. № 50 (28). P. 1–10.

谭力勤 (Tan Liqin). 奇点艺术:未来艺术在科技 奇点冲击下的蜕变.[Singularity Art: The transformation of future art under the impact of technological singularity]. Beijing: China machine press. 2018. 369 p.

肖文芳,黄稚霆,欧俊宏,刘浩鹏 & 黄诗琪 (Xiao Wenfang, Huang Zhiting, Ou Junhong, Liu Haopeng & Huang Shiqi) (2022). 基于人工智能的计算机视觉研究领域 发展现状研究 – 基于多种可视化工具的比较分析 [Research on the development status of computer vision research field based on artificial intelligence – comparative analysis based on various visualization tools].科技创新与 应用 – Technological innovation and application. 2022. № 36. P. 27–30.

张勤 (Zhang Q.). 对新一代人工智能的思 考 [Thoughts on the New Generation of Artificial Intelligence]. 智能系统学报 – Journal of Intelligent Systems. 2022. № 17(4). P. 642–660.

Downloads

Published

2025-02-04

Issue

Section

CULTURE AND ART