Creation of RAG Chatbot in Answering Queries Related to Banking Terms Using Microsoft Azure

Cindy Aurora; Tuga Mauritsius

doi:10.34306/ijcitsm.v5i2.209

Authors

Cindy Aurora Bina Nusantara University
Tuga Mauritsius Bina Nusantara University https://orcid.org/0000-0002-5525-5591

DOI:

https://doi.org/10.34306/ijcitsm.v5i2.209

Keywords:

Natural Language Processing, Large Language Model, Retrieval Augmented Generation, Chatbot, Microsoft Azure

Abstract

This study investigates the use of Natural Language Processing (NLP), specifically Large Language Models (LLM), to implement technology intelligence as a solution for supporting developers in understanding information-related terms, abbreviations, and business processes in the banking sector. The aim is to explore the effectiveness of integrating AI-powered chatbots, particularly through Retrieval Augmented Generation (RAG), to enhance software development in banking by providing fast, accurate responses. The methodology involves profiling data analysis and the development of a RAG based AI chatbot using the Microsoft Azure platform, integrating advanced NLP and LLM techniques to assist developers in navigating complex banking terms and processes efficiently. The results demonstrate that the RAG chatbot significantly improves operational efficiency by offering real-time, context-aware responses, enabling faster decision-making and reducing time spent on manual searches for information, which leads to faster software development cycles. This study contributes to the fields of NLP and LLM, particularly in the banking sector, by showcasing the benefits of RAG chatbots in improving operational efficiency and software development quality. The use of AI technologies provides substantial improvements in the development process, leading to enhanced productivity in the banking industry.

References

M. R. Haque and S. Rubya, “An overview of chatbot-based mobile mental health apps: insights from app description and user reviews,” JMIR mHealth and uHealth, vol. 11, no. 1, p. e44838, 2023.

M. A. Kuhail, I. Taj, S. Alimamy, and B. Abu Shawar, “A review on polyadic chatbots: trends, challenges, and future research directions,” Knowledge and Information Systems, vol. 67, no. 1, pp. 109–165, 2025.

B. Zarouali, T. Araujo, J. Ohme, and C. De Vreese, “Comparing chatbots and online surveys for (longitudinal) data collection: an investigation of response characteristics, data quality, and user evaluation,” Communication Methods and Measures, vol. 18, no. 1, pp. 72–91, 2024.

R. Regin, S. S. Rajest, T. Shynu et al., “An automated conversation system using natural language processing (nlp) chatbot in python,” Central Asian Journal of Medical and Natural Science, vol. 3, no. 4, pp. 314–336, 2022.

A. Khamaj, “Ai-enhanced chatbot for improving healthcare usability and accessibility for older adults,” Alexandria Engineering Journal, vol. 116, pp. 202–213, 2025.

U. Rusilowati, F. P. Oganda, R. Rahardja, T. Nurtino, and E. Aimee, “Innovation in smart marketing: The role of technopreneurs in driving educational improvement,” Aptisi Transactions on Technopreneurship (ATT), vol. 5, no. 3, pp. 305–318, 2023.

S. M. Abdullah, A. M. Al-Bakry, and A. K. Farhan, “Conversational health bots for telemedicine services: Survey,” Iraqi Journal for Computers and Informatics, vol. 50, no. 2, pp. 156–172, 2024.

B. of Indonesia. (2024) Tujuan kebijakan moneter. Accessed: Jan. 01, 2024. [Online]. Available: https://www.bi.go.id/id/fungsi-utama/moneter/Default.aspx

B. of Indonesia. (2024) Profil bank indonesia. Accessed: Jan. 01, 2024. [Online]. Available: https://www.bi.go.id/id/tentang-bi/profil/Default.aspx

B. of Indonesia. (2024) Metadata bank indonesia. Accessed: Feb. 01, 2024. [Online]. Available: https://www.bi.go.id/id/statistik/metadata/default.aspx

L. Benaddi, C. Ouaddi, A. Jakimi, and B. Ouchao, “A systematic review of chatbots: Classification, development, and their impact on tourism,” IEEE access, vol. 12, pp. 78 799–78 810, 2024.

A. T. Neumann, Y. Yin, S. Sowe, S. Decker, and M. Jarke, “An llm-driven chatbot in higher education for databases and information systems,” IEEE Transactions on Education, 2024.

C. Borek, “Comparative evaluation of llm-based approaches to chatbot creation,” 2024.

A. A. Search. (2024) Azure ai search documentation. Accessed: Jul. 16, 2024. [Online]. Available: https://learn.microsoft.com/en-us/azure/search/

S. Purnama, C. S. Bangun, and E. P. Mahadewi, “Predicting consumer purchase intention in personal shopper services using big data analytics and sem,” International Journal of Cyber and IT Service Management, vol. 5, no. 1, pp. 105–119, 2025.

R. Hartati and E. B. Manullang, “Implementation of telegram chatbot ai with natural language processing (nlp) in learning creative entrepreneurship to develop students’ creative and innovative competence,” in Talenta Conference Series: Local Wisdom, Social, and Arts (LWSA), vol. 7, no. 2, 2024, pp. 72–79.

A. O. Service. (2024) Azure openai service documentation. Accessed: Jul. 16, 2024. [Online]. Available: https://learn.microsoft.com/en-us/azure/ai-services/openai/

A. Giuliani, R. Savona, S. Carta, G. Addari, and A. S. Podda, “Corporate risk stratification through an interpretable autoencoder-based model,” Computers & Operations Research, vol. 174, p. 106884, 2025.

S. Abror, M. Mutrofin, E. Hardinanto, M. Mintarsih et al., “Reimagining teacher professional development to link theory and practice,” Journal of Teaching and Learning, vol. 1, no. 1, pp. 22–36, 2024.

R. A. Sekarwati, A. Sururi, R. Rakhmat, M. Arifin, and A. Wibowo, “Survey of chatbot testing methods on social media to measure accuracy,” Sisfotenika, vol. 11, no. 2, pp. 172–182, 2021.

E. J. Gordon, J. Gacki-Smith, M. J. Gooden, P. Waite, R. Yacat, Z. R. Abubakari, D. Duquette, A. Agrawal, J. Friedewald, S. K. Savage et al., “Development of a culturally targeted chatbot to inform living kidney donor candidates of african ancestry about apol1 genetic testing: a mixed methods study,” Journal of Community Genetics, vol. 15, no. 2, pp. 205–216, 2024.

A. C. Griffin, S. Khairat, S. C. Bailey, and A. E. Chung, “A chatbot for hypertension self-management support: user-centered design, development, and usability testing,” JAMIA open, vol. 6, no. 3, p. ooad073, 2023.

E. A. Yam, E. Namukonda, T. McClair, S. Souidi, N. Chelwa, N. Muntalima, M. Mbizvo, and B. Bellows, “Developing and testing a chatbot to integrate hiv education into family planning clinic waiting areas in lusaka, zambia,” Global Health: Science and Practice, vol. 10, no. 5, 2022.

K. Boyd, C. Potts, R. Bond, M. Mulvenna, T. Broderick, C. Burns, A. Bickerdike, M. Mctear, C. Kostenius, A. Vakaloudis et al., “Usability testing and trust analysis of a mental health and wellbeing chatbot,” in Proceedings of the 33rd European Conference on Cognitive Ergonomics, 2022, pp. 1–8.

N. P. L. Santoso, R. Nurmala, and U. Rahardja, “Corporate leadership in the digital business era and its impact on economic development across global markets,” IAIC Transactions on Sustainable Digital Innovation (ITSDI), vol. 6, no. 2, pp. 188–195, 2025.

K. Mageira, D. Pittou, A. Papasalouros, K. Kotis, P. Zangogianni, and A. Daradoumis, “Educational ai chatbots for content and language integrated learning,” Applied Sciences, vol. 12, no. 7, p. 3239, 2022.

A. BAIAI and N. F. BENNACER, “Developing a retrieval-augmented generation (rag) chatbot enhanced by knowledge graphs,” Ph.D. dissertation, 2024.

M. A. Quidwai and A. Lagana, “A rag chatbot for precision medicine of multiple myeloma,” MedRxiv, pp. 2024–03, 2024.

J. Siswanto, V. A. Goeltom, I. N. Hikam, E. A. Lisangan, and A. Fitriani, “Market trend analysis and data-based decision making in increasing business competitiveness,” Sundara Advanced Research on Artificial Intelligence, vol. 1, no. 1, pp. 1–8, 2025.