Integrating Deep Learning and Explainable Artificial Intelligence Techniques for Stock Price Predictions: An Empirical Study Based on
DOI:
https://doi.org/10.56830/IJAMS10202401Keywords:
Deep Learning (DL), Explainable Artificial Intelligence (XAI), Long short-term memory (LSTM), Shapely Additive Explanations (SHAP), Stock Price PredictionAbstract
This paper proposes an approach to improving the accuracy of predicting stock prices. The approach is built on integrating Long-Short-Term Memory (LSTM) networks, a Deep Learning (DL) technique, with Shapely Additive Explanations (SHAP), an Explainable Artificial Intelligence (XAI) technique. This integration is expected to improve predictive accuracy and model explainability. Leveraging the strengths of LSTM in capturing complex sequential patterns in financial time series big data, the model incorporates technical indicators to enhance its performance in forecasting stock movements. Deep learning is known to have a “black box” nature, so incorporating XAI techniques aims to offer detailed insights into how input features contribute to model outputs. This integration of XAI enhances the interpretability of predictions and enables users to understand the underlying rationale of the model, fostering greater trust among investors and financial professionals. The study utilized stock price data from the Yahoo Finance Website. The model processed forecasting of Google stock prices. The practical utility of this approach is demonstrated through the decision-making module, which provides actionable buy, sell, or hold recommendations, showcasing its potential in real-world investment scenarios. Our results indicate a balanced synergy between prediction accuracy and explainability, establishing a transparent and reliable AI-driven financial forecasting framework.
References
Abad, C., Thore, S. A., & Laffarga, J. (2004). Fundamental Analysis of Stocks by Two‐Stage DEA. Managerial and Decision Economics, 25(5), 231-241. DOI: https://doi.org/10.1002/mde.1145
Ade, M. (2023). Explainable AI in Financial Time Series Forecasting: Interpretability of Deep Learning
Models Compared to Traditional Techniques. Available at: Explainable-AI-in-Financial-Time-
Series-Forecasting-Interpretability-of-Deep-Learning-Models-Compared-to-Traditional-
Techniques.pdf (researchgate.net)
Ahmed, S. F., Alam, M. S. P Bin, Hassan, M., Rozbu, M. R., Ishtiak, T., Rafa, N., Mofijur, M., Shawkat Ali, A. B. M., & Gandomi, A. H. (2023). Deep Learning Modelling Techniques: Current
Progress, Applications, Advantages, and Challenges. Artificial Intelligence Review, 56(11),
13521–13617. https://doi.org/10.1007/s10462-023-10466-8 DOI: https://doi.org/10.1007/s10462-023-10466-8
Ambasht, A. (2024). Ai-Driven Data Analytics for Enhancing Predictive Accuracy in Financial Markets. Asian Journal of Science and Technology, 15 (05), 13009-13012.
Arsenault, P.D., Wang, S., & Patenande, J.M. (2018). A Survey of Explainable arXiv Preprint. Available
at: http://arxiv.org/abs/2407.15909
Arrieta, B. A., Díaz-Rodríguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., Garcia, S., GilLopez, S., Molina, D., Benjamins, R., Chatila, R., & Herrera, F. (2020). Explainable Artificial
Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges Toward Responsible AI. Information Fusion, 58, 82–115. https://doi.org/10.1016/J.INFFUS.2019.12.012 DOI: https://doi.org/10.1016/j.inffus.2019.12.012
Arrieta, B. A., & Del Ser, J. (2020, July). Plausible Counterfactuals: Auditing Deep Learning Classifiers
with Realistic Adversarial Examples, International Joint Conference on Neural Networks (IJCNN) (pp. 1-7). IEEE.
Bhattacharjee, I., & Bhattacharja, P. (2019, December). Stock Price Prediction: A Comparative Study Between Traditional Statistical Approach and Machine Learning Approach. In 2019 4th DOI: https://doi.org/10.1109/EICT48899.2019.9068850
International Conference ON Electrical Information and Communication Technology (EICT) (pp. 1-6). IEEE.
Billah, B., King, M. L., Snyder, R. D., & Koehler, A. B. (2006). Exponential Smoothing Model Selection DOI: https://doi.org/10.1016/j.ijforecast.2005.08.002
for Forecasting. International Journal of Forecasting, 22(2), 239-247.
Billah, M. M., Sultana, A., Bhuiyan, F., & Kaosar, M. G. (2024). Stock Price Prediction: Comparison of
Different Moving Average Techniques Using Deep Learning Model. Neural Computing and Applications, 36 (11), 5861-5871.
Bryan-Kinns, N., Zhang, B., Zhao, S., & Banar, B. (2024). Exploring Variational Auto-encoder
Architectures, Configurations, and Datasets for Generative Music Explainable AI. Machine Intelligence Research, 21(1), 29-45. http://doi.org/10.1007/s11633-023-1457-1 DOI: https://doi.org/10.1007/s11633-023-1457-1
Bustos, O., & Pomares-Quimbaya, A. (2020). Stock Market Movement Forecast: A Systematic Review. Expert Systems with Applications, 156, 113464. https://doi.org/10.1016/j.eswa.2020.113464 DOI: https://doi.org/10.1016/j.eswa.2020.113464
Chakraborty, S., Tomsett, R., Raghavendra, R., Harborne, D., Alzantot, M., Cerutti, F., & Gurram, P. (2017, August). Interpretability of Deep Learning Models: A Survey of Results. In 2017 IEEE DOI: https://doi.org/10.1109/UIC-ATC.2017.8397411
Smartworld, Ubiquitous Intelligence & Computing, Advanced & Trusted Computed, Scalable
Computing & Communications, Cloud & Big Data Computing, Internet of People and Smart City Innovation (Smartworld/SCALCOM/UIC/ATC/CBDcom/IOP/SCI) (pp. 1-6). IEEE.
Chen, S. H., Lux, T., & Marchesi, M. (2001). Testing for Non-Linear Structure in An Artificial Financial
Market. Journal of Economic Behavior & Organization, 46 (3), 327–342. https://doi.org/10.1016/S0167-2681(01)00181-0 DOI: https://doi.org/10.1016/S0167-2681(01)00181-0
Chopra, R., & Sharma, G. D. (2021). Application of Artificial Intelligence in Stock Market Forecasting: A Critique, Review, And Research Agenda. Journal of Risk and Financial Management, 14 DOI: https://doi.org/10.3390/jrfm14110526
(11), 526.https://doi.org/10.3390/jrfm
Dobrev, D. (2012). A Definition of Artificial Intelligence. arXiv Preprint arXiv:1210.1568.
Duarte, J. M., & Berton, L. (2023). A Review of Semi-Supervised Learning for Text Classification.
Artificial Intelligence Review, 56 (9), 9401–9469. https://doi.org/10.1007/s10462-023-10393-8 DOI: https://doi.org/10.1007/s10462-023-10393-8
Dunsin, D., Ghanem, M. C., Ouazzane, K., & Vassilev, V. (2024). A Comprehensive Analysis of The Role
of Artificial Intelligence and Machine Learning in Modern Digital Forensics and Incident Response. Forensic Science International: Digital Investigation, 48, 301675 https://doi.org/10.1016/j.fsidi.2023.301675 DOI: https://doi.org/10.1016/j.fsidi.2023.301675
Dwivedi, R., Dave, D., Naik, H., Singhal, S., Omer, R., Patel, P., Qian, B., Wen, Z., Shah, T., Morgan, G.,
& Ranjan, R. (2023). Explainable AI (XAI): Core Ideas, Techniques, and Solutions. ACM
Computing Surveys, 55 (9). https://doi.org/10.1145/3561048 DOI: https://doi.org/10.1145/3561048
Ekanayake, I. U., Meddage, D. P. P., & Rathnayake, U. (2022). A Novel Approach to Explain the BlackBox Nature of Machine Learning in Compressive Strength Predictions of Concrete Using Shapley Additive Explanations (SHAP). Case Studies in Construction Materials, 16, e01059. DOI: https://doi.org/10.1016/j.cscm.2022.e01059
Farmer, J. D., Gallegati, M., Hommes, C., Kirman, A., Ormerod, P., Cincotti, S., Sanchez, A., & Helbing, D. (2012). A Complex Systems Approach to Constructing Better Models for Managing Financial Markets and The Economy. European Physical Journal: Special Topics, 214 (1), 295–324. https://doi.org/10.1140/epjst/e2012-01696-9 DOI: https://doi.org/10.1140/epjst/e2012-01696-9
Gandhmal, D. P., & Kumar, K. (2019). Systematic Analysis and Review of Stock Market Prediction
Techniques. Computer Science Review, 34, 100190. https://doi.org/10.1016/J.COSREV.2019.08.001 DOI: https://doi.org/10.1016/j.cosrev.2019.08.001
Integrating Deep Learning and Explainable Artificial ….... M
Guidotti, R., Monreale, A., Ruggieri, S., Turini, F., Giannotti, F., & Pedreschi, D. (2018). A survey of
Methods for Explaining Black Box Models. ACM Computing Surveys, 51(5). https://doi.org/10.1145/3236009 DOI: https://doi.org/10.1145/3236009
Gururaj, V., Shriya, V. R., & Ashwini, K. (2019). Stock Market Prediction Using Linear Regression and Support Vector Machines. Int J Appl Eng Res, 14(8), 1931-1934.
Hussain, J. (2019). Deep Learning Black Box Problem. Master’s Thesis, Uppsala University, Uppsala, Sweden
Illa, P. K., Parvathala, B., & Sharma, A. K. (2022). Stock Price Prediction Methodology Using Random Forest Algorithm and Support Vector Machine. Materials Today: Proceedings, 56, 1776–1782. https://doi.org/10.1016/J.MATPR.2021.10.460 DOI: https://doi.org/10.1016/j.matpr.2021.10.460
Jiang, W. (2021). Applications of Deep Learning in Stock Market Prediction: Recent Progress. Expert
Systems with Applications, 184, 115537. https://doi.org/10.1016/J.ESWA.2021.115537 DOI: https://doi.org/10.1016/j.eswa.2021.115537
Kanaparthi, V. (2024). Transformational Application of Artificial Intelligence and Machine Learning in Financial Technologies and Financial Services: A Bibliometric Review. International Journal of Engineering and Advanced Technology, 13 (3), 71–77. https://doi.org/10.35940/ijeat.D4393.13030224 DOI: https://doi.org/10.35940/ijeat.D4393.13030224
Lee, S. W., & Kim, H. Y. (2020). Stock Market Forecasting with Super-High Dimensional Time-Series Data Using ConvLSTM, Trend Sampling, And Specialized Data Augmentation. Expert Systems with Applications, 161, 113704 DOI: https://doi.org/10.1016/j.eswa.2020.113704
Li, Y., Yang, L., Yang, B., Wang, N., & Wu, T. (2019). Application of Interpretable Machine Learning
Models for The Intelligent Decision. Neurocomputing, 333, 273–283. https://doi.org/10.1016/J.NEUCOM.2018.12.012 DOI: https://doi.org/10.1016/j.neucom.2018.12.012
Lin, C. Y., & Marques, J. A. L. (2024). Stock Market Prediction Using Artificial Intelligence: A Systematic Review of Systematic Reviews. Social Sciences & Humanities Open, 9, 100864. DOI: https://doi.org/10.1016/j.ssaho.2024.100864
Lindemann, B., Müller, T., Vietz, H., Jazdi, N., & Weyrich, M. (2021). A Survey on Long Short-Term Memory Networks for Time Series Prediction. Procedia CIRP, 99, 650–655. https://doi.org/10.1016/J.PROCIR.2021.03.088 DOI: https://doi.org/10.1016/j.procir.2021.03.088
Maarif, M. R., Saleh, A. R., Habibi, M., Fitriyani, N. L., & Syafrudin, M. (2023). Energy Usage Forecasting Model Based on Long Short-Term Memory (LSTM) and eXplainable Artificial Intelligence (XAI). Information (Switzerland), 14 (5). DOI: https://doi.org/10.3390/info14050265
Masri, N., Sultan, Y. A., Akkila, A. N., Almasri, A., Ahmed, A., Mahmoud, A. Y., Zaqout, I. & Abu-Naser, S. S. (2019). Survey of Rule-Based Systems. International Journal of Academic Information Systems Research (IJAISR), 3(7), 1-23.
Moghar, A., & Hamiche, M. (2020). Stock Market Prediction Using LSTM Recurrent Neural Network. Procedia Computer Science, 170, 1168–1173. DOI: https://doi.org/10.1016/j.procs.2020.03.049
Moret-Bonillo, V. (2018). Emerging Technologies In Artificial Intelligence: Quantum Rule-Based DOI: https://doi.org/10.1007/s13748-017-0140-6
Systems. Progress in Artificial Intelligence, 7(2), 155-166. https://doi.org/10.1007/s13748017-0140-6
Naeem, S., Ali, A., Anam, S., & Ahmed, M. M. (2023). An Unsupervised Machine Learning Algorithms:
Comprehensive Review. International Journal of Computing and Digital Systems, 13(1), 911–921. https://doi.org/10.12785/ijcds/130172 DOI: https://doi.org/10.12785/ijcds/130172
Nelson, D. M. Q., Pereira, A. C. M., & de Oliveira, R. A. (2017). Stock Market’s Price Movement
Prediction with LSTM Neural Networks. International Joint Conference on Neural Networks (IJCNN), 1419–1426. https://doi.org/10.1109/IJCNN.2017.7966019 DOI: https://doi.org/10.1109/IJCNN.2017.7966019
Nilsson, N. J. (2009). The Quest for Artificial Intelligence. Cambridge University Press. Web-version DOI: https://doi.org/10.1017/CBO9780511819346
available at: http://www.cambridge.org/us/0521122937
Petrusheva, N., & Jordanoski, I. (2016). Comparative Analysis Between the Fundamental and Technical Analysis of Stocks. Journal of Process Management. New Technologies, 4 (2), 26-31. DOI: https://doi.org/10.5937/JPMNT1602026P
Rane, N., Choudhary, S., & Rane, J. (2023). Explainable Artificial Intelligence (XAI) Approaches for Transparency and Accountability in Financial Decision-Making. Available at SSRN 4640316. DOI: https://doi.org/10.2139/ssrn.4640316
Rane, N. L., Paramesha, M., Choudhary, S. P., & Rane, J. (2024). Artificial Intelligence, Machine
Learning, and Deep Learning for Advanced Business Strategies: A Review. Partners Universal
International Innovation Journal (PUIIJ), 02(03),147-171 https://doi.org/10.5281/zenodo.12208298
Sable, R., Goel, S., & Chatterjee, P. (2023). Techniques for Stock Market Prediction: A Review. In
International Journal on Recent and Innovation Trends in Computing and Communication, 11 (5S), 381–402 https://doi.org/10.17762/ijritcc.v11i5s.7056 DOI: https://doi.org/10.17762/ijritcc.v11i5s.7056
Salih, A. M., Raisi‐Estabragh, Z., Galazzo, I. B., Radeva, P., Petersen, S. E., Lekadir, K., & Menegaz, G. (2024). A Perspective on Explainable Artificial Intelligence Methods: SHAP and LIME. Advanced Intelligent Systems,2400304.https://doi.org/10.1002/aisy.202400304 DOI: https://doi.org/10.1002/aisy.202400304
Saunders, M., Lewis, P., & Thornhill, A. (2009). Research Methods for Business Students. Pearson education.
Schneider, J. (2024). Explainable Generative AI (GenXAI): A Survey, Conceptualization, and Research Agenda. Artificial Intelligence Review, 57(11), 289. DOI: https://doi.org/10.1007/s10462-024-10916-x
Shahroudnejad, A. (2021). A Survey on Understanding, Visualizations, And Explanation of Deep Neural Networks. arXiv Preprint arXiv:2102.01792.
Sharifani, K., & Amini, M. (2023). Machine Learning and Deep Learning: A Review of Methods and
Applications. In World Information Technology and Engineering Journal, 10 (7), 3897- 3904. https://ssrn.com/abstract=4458723
Shen, S., Jiang, H., & Zhang, T. (2012). Stock Market Forecasting Using Machine Learning Algorithms. Department of Electrical Engineering, Stanford University, Stanford, CA, 1-5.
Siami-Namini, S., & Namin, A. S. (2018). Forecasting Economics and Financial Time Series: ARIMA vs. LSTM. arXiv Preprint arXiv:1803.06386.
Strader, T. J., Rozycki, J. J., Root, T. H., & Huang, Y. H. J. (2020). Machine Learning Stock Market Prediction Studies: Review and Research Directions. Journal of International Technology and Information Management, 28(4), 63-83. DOI: https://doi.org/10.58729/1941-6679.1435
Sun, J., Liao, Q. V., Muller, M., Agarwal, M., Houde, S., Talamadupula, K., & Weisz, J. D. (2022, March). Investigating Explainability of Generative Ai for Code Through Scenario-Based DOI: https://doi.org/10.1145/3490099.3511119
Design. In Proceedings of the 27th International Conference on Intelligent User Interfaces (pp. 212-228).
Valensky, D., & Mohaghegh, M. (2023). Evaluating Transparency: A Cross-Model Exploration of Explainable AI in Financial Forecasting. IEEE Asia-Pacific Conference on Computer Science and Data Engineering (CSDE), Nadi, Fiji, pp.1–6. https://doi.org/10.1109/CSDE59766.2023.10487732 DOI: https://doi.org/10.1109/CSDE59766.2023.10487732
Van Den Broeck, G., Lykov, A., Schleich, M., & Suciu, D. (2022). On the Tractability of SHAP Explanations. Journal of Artificial Intelligence Research, 74. 851-886. DOI: https://doi.org/10.1613/jair.1.13283
Vimbi, V., Shaffi, N., & Mahmud, M. (2024). Interpreting Artificial Intelligence Models: A Systematic
Review on The Application of LIME and SHAP in Alzheimer’s Disease Detection. Brain Informatics, 11(10). https://doi.org/10.1186/s40708-024-00222-1 DOI: https://doi.org/10.1186/s40708-024-00222-1
Vora, D. R. & Iyer, K. R. (2020). Deep Learning in Engineering Education: Performance Prediction Using Cuckoo-Based Hybrid Classification. In M. Mahrishi, K. Hiran, G. Meena, & P. Sharma
(Eds.), Machine Learning and Deep Learning in Real-Time Applications (pp. 187-218). IGI
Global. https://doi.org/10.4018/978-1-7998-3095-5.ch009 DOI: https://doi.org/10.4018/978-1-7998-3095-5.ch009
Wang, P. (2019). On Defining Artificial Intelligence. Journal of Artificial General Intelligence, 10(2), 1- DOI: https://doi.org/10.2478/jagi-2019-0002
37.
World Federation of Exchanges. (2023). FY 2023 Market Highlights. Available at: Statistics | The World Federation of Exchanges (world-exchanges.org)
Xiong, Y., Xia, S., & Wang, X. (2020). Artificial Intelligence and Business Applications: An Introduction. International Journal of Technology Management, 84 (1-2), 1-7. DOI: https://doi.org/10.1504/IJTM.2020.112615
Yoo, S., Kyungjoo, S., & John Jongdae, J. I. N. (2007). Neural Network Model Vs. Sarima Model in Forecasting Korean Stock Price Index (KOSPI). Issues in Information Systems, 8(3), 372-378.
