DEEP REINFORCEMENT LEARNING FOR REAL-TIME ADAPTIVE USER WEB-INTERFACE CUSTOMIZATION
DOI:
https://doi.org/10.32782/2415-8151.2025.35.33Keywords:
adaptive user interface, reinforcement learning, Markov decision process, web accessibility, user engagement, temporal modelingAbstract
Purpose. The purpose of the work is to develop adaptive web interface design using machine learning with reinforcement methods. Methodology. The research methodology was based on the application of deep reinforcement learning for adaptive customization of the web interface in real time. User interaction with the interface was modeled as a decision-making process. The Markov Decision Process (MDP) technology was used, where the policy determines changes to interface elements based on a reward function that integrates user engagement metrics (click rate, idle time) and compliance with WCAG accessibility standards. Maximum likelihood estimators and gradient optimization were used to determine effective interaction patterns. The analysis of time dependencies of interactions was carried out using the LSTA and LSTM modules, which focus on short-term and long-term user preferences, using convolutional layers and an attention mechanism to extract relevant f eatures. Results. To analyze user behavior patterns, including navigation paths, input methods, and customization options, the framework uses maximum likelihood estimation and gradient-based optimization. This process models user preferences and interactions to efficiently optimize user interface settings. In addition, the architecture integrates a long-short-term memory (LSTM) module to capture temporal dependencies in user interactions. By processing data through convolutional gating layers, the network learns both instantaneous and extended user preferences. Temporal aggregation is further enhanced by adaptive convolutional kernels and attention mechanisms that prioritize critical areas of the interface based on user interaction. The adaptability of the system is improved by incorporating fuzzy logic into the gating mechanisms, where fuzzy rules model the complex dependencies between factors that affect user interaction. This integration facilitates robust decision-making under different conditions, ensuring stability and preventing overfitting. The LSTM module uses convolutional operations on merged cells and hidden states to extract vital features, solve the problem of gradient vanishing, and improve memory retention. Actions generated by the model dynamically update user interface elements, contributing to a seamless and personalized user experience. The backend implementation, built on FastAPI, processes user interaction data in real time, calculates rewards, and predicts actions to optimize user interface settings. The server uses TensorFlow-based models to analyze user metrics and accessibility data, providing useful information for interface customization. The architecture provides efficient communication between the backend and the frontend, allowing for real-time user interface modification. The scientific novelty of the article lies in the development of an adaptive web interface model that uses deep reinforcement learning to personalize user interactions in real time, taking into account temporal dependencies and accessibility metrics. The practical relevance is determined by the possibility of applying the proposed approach to increase user engagement and ensure inclusiveness of web resources, which is relevant for various industries, including e-commerce and educational platforms.
References
Ajaegbu C. C., Iwu C. F. Dawning of progressive web applications (PWA): Edging out the pitfalls of traditional mobile development. International Journal of Computer Applications. 2020. № 68 (1). P. 1–7. DOI: 10.5120/ijca2020920634.
Al-Fedaghi S. Developing web applications. International Journal of Software Engineering and Its Applications. 2011. № 5 (2). P. 1–14. DOI: 10.14257/ijseia.2011.5.2.01.
Bruno V., Al-Qaimari G. Characteristics of web applications that affect usability: A review. Journal of Web Engineering. 2021. № 20 (3). P. 1–18. DOI: 10.13052/jwe1540–9589.2031.
Deng Z., Chen Y., Yu Q., Xu Z., Ye X. An experimental study on web interface design optimization based on user cognitive load: With the Design Intelligence Center (DIC) website as an example. Design Studies and Intelligence Engineering. 2023. Vol. 365. P. 506–518. DOI: 10.3233/FAIA220744.
Dissanayake N., Hewagamage K. Web-based applications: Extending the general perspective of the service of web. International Journal of Advanced Computer Science and Applications. 2020. №8 (10). P. 1–7. DOI: 10.14569/IJACSA.2017.081001.
Hooshyar D., Lee S., Yang Y., Jo J., Lim H. Long-term effects of adaptive customization support on elderly people. Cognition, Technology & Work. 2019. № 21. DOI: 10.1007/s10111-018-0516-9.
Hsu C. C. Factors affecting webpage’s visual interface design and style. Procedia Computer Science. 2011. №3. P. 1315–1320. DOI: 10.1016/j.procs.2011.01.009.
Iqbal J., Best T. Enhanced Augmented Reality with Real-Time Semantic Segmentation and Adaptive Deep Learning Models. ResearchGate : website. DOI: 10.13140/RG.2.2.10817.67682.
LiQun S., Wei W., Liu Y. Customizable WEB UI of based on templates. Information Technology Journal. 2010. № 9. DOI: 10.3923/itj.2010.1677.1681.
Madeyski L., Kawalerowicz M. Architectural design of modern web applications. International Journal of Software Engineering and Knowledge Engineering. 2020. № 30 (5). P. 1–20. DOI: 10.1142/S0218194020500180.
Reips U. D. Developing web applications for psychological research. Behavior Research Methods. 2022. № 54 (2). P. 1–10. DOI: 10.3758/s13428–021–01600–4.
Reips U., Social D. networking services in scientific research: Opportunities and challenges. International Journal of Internet Science. 2023. №18 (1). P. 1–9. DOI: 10.5565/rev/ijis.001.
Ricca F., Tonella P. Analysis and testing of web applications. Proceedings – International Conference on Software Engineering. 2001. P. 25–34. DOI: 10.1109/ICSE.2001.919078..
Shah H. Navigating UI Engineering Architectures: A Deep Dive into Modern Web Application Design. ResearchGate : website. DOI: 10.13140/RG.2.2.30307.77603.
Shahid J., Hameed M., Javed I., Qureshi K., Crespi N. A Comparative Study of Web Application Security Parameters: Current Trends and Future Directions. Applied Sciences. 2022. № 12. 4077. DOI: 10.3390/app12084077.
Tang Z., Tan M., Xia F., Cheng Q., Jiang H., Zhang Y. AutoGameUI: Constructing High-Fidelity Game UIs via Multimodal Learning and Interactive Web-Based Tool. ArXiv : website. DOI: 10.48550/arXiv.2411.03709.
Tangudu A., Chhapola A., Jain S. Leveraging Lightning Web Components for Modern Salesforce UI Development. Innovative Research Thoughts. 2023. № 9. Р. 220–234. DOI: 10.36676/irt.v9.i2.1459.
Wakil K. F., Ismail K. M. Extracting the features of modern web applications based on web engineering methods. International Journal of Advanced Computer Science and Applications. 2020. № 10 (3). P. 1–10. DOI: 10.14569/IJACSA.2019.0100310.
Wakil K. F., Ismail K. M. Intelligent web applications as future generation of web applications. Scientific Journal of Informatics. 2020. № 6 (2). P. 213–222. DOI: 10.15294/sji.v6i2.23214.
Wu M., Wang H., Ren J., Cao Y., Li Y., Jiang A., Ran D., Hu Y., Yang W., Xie T. Skill-Adaptive Imitation Learning for UI Test Reuse. ArXiv : website. DOI: 10.48550/arXiv.2409.13311.










