Skip to main content

An Adaptive Box-Normalization Stock Index Trading Strategy Based on Reinforcement Learning

  • Conference paper
  • First Online:
Neural Information Processing (ICONIP 2018)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 11303))

Included in the following conference series:

  • 2452 Accesses

Abstract

Financial time series prediction and stock trading strategy have always been the focus of research due to the generous returns. Stock box theory is a classic investment strategy, which has been studied by investors and scholars for many years. In this paper, we propose an adaptive box-normalization (ABN) stock trading strategy based on reinforcement learning (RL), which improves the original box theory. In our ABN strategy, the stock market data is independently normalized inside each oscillation box. Given the data of each box, support vector regression (SVR) is applied to predict the maximum rise range and maximum fall range within a certain period in the future. Meanwhile, the genetic algorithm (GA) is employed to optimize the input features of SVR via the mean square error (MSE) of prediction. We construct the trading strategies by Q-learning for the trading of single-stock and two-stock portfolio. Finally, the trigger threshold of oscillation box is dynamically adjusted according to the volatility of the stock price. Extensive experiments support that our proposed strategy performs well on different stock indices and achieves promising results.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 79.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 99.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Balvers, R., Wu, Y., Gilliland, E.: Mean reversion across national stock markets and parametric contrarian investment strategies. J. Financ. 55(2), 745–772 (2000)

    Article  Google Scholar 

  2. Chang, C.C., Lin, C.J.: LibSVM: a library for support vector machines. ACM Trans. Intell. Syst. Technol. (TIST) 2(3), 27 (2011)

    Google Scholar 

  3. Chiang, W.C., Enke, D., Wu, T., Wang, R.: An adaptive stock index trading decision support system. Expert Syst. Appl. 59, 195–207 (2016)

    Article  Google Scholar 

  4. Eilers, D., Dunis, C.L., Mettenheim, H.J.V., Breitner, M.H.: Intelligent trading of seasonal effects: a decision support algorithm based on reinforcement learning. Decis. Support. Syst. 64(3), 100–108 (2014)

    Article  Google Scholar 

  5. Enke, D., Thawornwong, S.: The use of data mining and neural networks for forecasting stock market returns. Expert Syst. Appl. 29(4), 927–940 (2005)

    Article  Google Scholar 

  6. Fama, E.F.: The behavior of stock-market prices. J. Bus. 38(1), 34–105 (1965)

    Article  Google Scholar 

  7. Guresen, E., Kayakutlu, G., Daim, T.U.: Using artificial neural network models in stock market index prediction. Expert Syst. Appl. 38(8), 10389–10397 (2011)

    Article  Google Scholar 

  8. Jangmin, O., Lee, J., Lee, J.W., Zhang, B.T.: Adaptive stock trading with dynamic asset allocation using reinforcement learning. Inf. Sci. 176(15), 2121–2147 (2006)

    Article  Google Scholar 

  9. Malagrino, L.S., Roman, N.T., Monteiro, A.M.: Forecasting stock market index daily direction: a Bayesian network approach. Expert Syst. Appl. 105, 11–22 (2018)

    Article  Google Scholar 

  10. Neuneier, R.: Optimal asset allocation using adaptive dynamic programming. In: Advances in Neural Information Processing Systems, pp. 952–958 (1995)

    Google Scholar 

  11. Nicolas, D.: How I Made Two Million Dollars in the Stock Market. BN Publishing (2007)

    Google Scholar 

  12. Oriani, F.B., Coelho, G.P.: Evaluating the impact of technical indicators on stock forecasting. In: 2016 IEEE Symposium Series on Computational Intelligence (SSCI), pp. 1–8. IEEE (2016)

    Google Scholar 

  13. Pendharkar, P.C., Cusatis, P.: Trading financial indices with reinforcement learning agents. Expert Syst. Appl. 103, 1–13 (2018)

    Article  Google Scholar 

  14. Wang, G.J., School, B.: Time series forecast of stock price based on the PSO-LSSVM predict model. Sci. Technol. Ind. 10, 135–140 (2017)

    Google Scholar 

  15. Wen, Q., Yang, Z., Song, Y., Jia, P.: Automatic stock decision support system based on box theory and SVM algorithm. Expert Syst. Appl. 37(2), 1015–1022 (2010)

    Article  Google Scholar 

  16. Zhang, X.D., Li, A., Pan, R.: Stock trend prediction based on a new status box method and AdaBoost probabilistic support vector machine. Appl. Soft Comput. 49, 385–398 (2016)

    Article  Google Scholar 

  17. Zhu, C., Yin, J., Li, Q.: A stock decision support system based on DBNs. J. Comput. Inf. Syst. 10(2), 67–79 (2014)

    Google Scholar 

Download references

Acknowledgements

This work was supported by: (i) National Natural Science Foundation of China (Grant No. 61602314); (ii) The Natural Science Foundation of Guangdong Province of China (Grant No. 2016A030313043); (iii) Fundamental Research Project in the Science and Technology Plan of Shenzhen (Grant No. JCYJ20160331114551175).

Author information

Authors and Affiliations

Authors

Corresponding authors

Correspondence to Jianmin Jiang or Qiang Huang .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Zhu, Y., Yang, H., Jiang, J., Huang, Q. (2018). An Adaptive Box-Normalization Stock Index Trading Strategy Based on Reinforcement Learning. In: Cheng, L., Leung, A., Ozawa, S. (eds) Neural Information Processing. ICONIP 2018. Lecture Notes in Computer Science(), vol 11303. Springer, Cham. https://doi.org/10.1007/978-3-030-04182-3_30

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-04182-3_30

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-04181-6

  • Online ISBN: 978-3-030-04182-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics