Stock Return Prediction Using Dual-Stage Attention Model with Stock Relation Inference

  • Tanawat Chiewhawan
  • Peerapon VateekulEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 12033)


Deep learning models have become widely accessible for stock prediction tasks. However, most of the research in this area focuses on only a single stock or an index and often formulates the problem to optimize only on the accuracy. Our paper proposed a more profit-oriented framework by formulating the problem into multiple stock returns prediction as well as introducing a relation inference for stock ranking. This setup can diversify investment and eventually enhance trading profits while maintaining the regression accuracy. Moreover, it is become more challenging to process multiple time-series features simultaneously because of the great variety of available information in the financial market. We mitigate this with the state-of-the-art model for time-series forecasting, the Dual-stage attention recurrent neural networks (DA-RNN), and train them with the shared-parameter model setting. The attention layer within DA-RNN helps the model captures the relevance insight among the features. We conducted experiments on major 64 target stocks from the SET market with RMSE, mean reciprocal rank, and annualized profit returns as evaluation metrics. The results show that our proposed model framework (DA-RANK) can predict multiple stock returns in ranking order and able to produce a desirable improvement in profitability over other baseline models.


Deep learning Ranking-aware loss function Long Short-term memory model Dual-stage attention Stock prediction Stock ranking 



Our work is partly supported on the research budget by Capital Market Research Institute (CMRI), The Stock Exchange of Thailand (SET), during Capital Market Research Innovation contest 2019. and permission to use the SET SMART dataset for academic purposes from the Financial Laboratory, Chulalongkorn Business School and Asst. Prof. Tanakorn Likitapiwat.


  1. 1.
    Fama, E.F.: Efficient capital markets: a review of theory and empirical work. J. Financ. 25(2), 383–417 (1970). Scholar
  2. 2.
    Malkiel, B.G.: Reflections on the efficient market hypothesis: 30 years later. Financ. Rev. 40(1), 1–9 (2005)CrossRefGoogle Scholar
  3. 3.
    Qin, Y., Song, D., Chen, H., Cheng, W., Jiang, G., Cottrell, G.: A dual-stage attention-based recurrent neural network for time series prediction. arXiv e-prints (2017)Google Scholar
  4. 4.
    Feng, F., He, X., Wang, X., Luo, C., Liu, Y., Chua, T.-S.: Temporal relational ranking for stock prediction. ACM Trans. Inf. Syst. 37, 1–30 (2019). Scholar
  5. 5.
    Ballings, M., Van den Poel, D., Hespeels, N., Gryp, R.: Evaluating multiple classifiers for stock price direction prediction. Expert Syst. Appl. 42(20), 7046–7056 (2015)CrossRefGoogle Scholar
  6. 6.
    Patel, J., Shah, S., Thakkar, P., Kotecha, K.: Predicting stock and stock price index movement using trend deterministic data preparation and machine learning techniques. Expert Syst. Appl. 42(1), 259–268 (2015)CrossRefGoogle Scholar
  7. 7.
    Fischer, T., Krauss, C.: Deep learning with long short-term memory networks for financial market predictions. Eur. J. Oper. Res. 270(2), 654–669 (2018). Scholar
  8. 8.
    Chen, K., Zhou, Y., Dai, F.: A LSTM-based method for stock returns prediction: a case study of china stock market. In: 2015 IEEE International Conference on Big Data (Big Data), pp. 2823–2824. IEEE (2015)Google Scholar
  9. 9.
    Nelson, D.M., Pereira, A.C., de Oliveira, R.A.: Stock market’s price movement prediction with LSTM neural networks. In: 2017 International Joint Conference on Neural Networks (IJCNN), pp. 1419–1426. IEEE (2017)Google Scholar
  10. 10.
    Hochreiter, S., Schmidhuber, J.: Long short-term memory. Neural Comput. 9(8), 1735–1780 (1997). Scholar
  11. 11.
    Sezer, O.B., Ozbayoglu, A.M.: Algorithmic financial trading with deep convolutional neural networks: time series to image conversion approach. Appl. Soft Comput. 70, 525–538 (2018). Scholar
  12. 12.
    Hollis, T., Viscardi, A., Yi, S.E.: A comparison of LSTMs and attention mechanisms for forecasting financial time series. CoRR abs/1812.07699 (2018)Google Scholar
  13. 13.
    Guo, T., Lin, T.: Multi-variable LSTM neural network for autoregressive exogenous model. arXiv preprint arXiv:1806.06384 (2018)
  14. 14.
    Akita, R., Yoshihara, A., Matsubara, T., Uehara, K.: Deep learning for stock prediction using numerical and textual information. In: 2016 IEEE/ACIS 15th International Conference on Computer and Information Science (ICIS), 26–29 June 2016, pp. 1–6 (2016)Google Scholar
  15. 15.
    Ioffe, S., Szegedy, C.: Batch normalization: accelerating deep network training by reducing internal covariate shift. arXiv preprint arXiv:1502.03167 (2015)
  16. 16.
    Oncharoen, P., Vateekul, P.: Deep learning using risk-reward function for stock market prediction. Paper Presented at the 2018 2nd International Conference on Computer Science and Artificial Intelligence, Shenzhen, China (2018)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  1. 1.Chulalongkorn University Big Data Analytics and IoT Center (CUBIC), Department of Computer Engineering, Faculty of EngineeringChulalongkorn UniversityBangkokThailand

Personalised recommendations