Big data framework for quantitative trading system
- 114 Downloads
Massive trading data are produced in securities market every day. Besides, the amount of relevant social media data is also growing fast. It is a vital problem of making use of these data. Facing on the growing amount of data, using big data framework is a necessary and reasonable method. Then, a big data framework for quantitative trading system is proposed in this paper. In the framework, Apache Spark is chosen as the distributed computing framework to process trading data, and Apache HBase as the distributed database is used to store data. After introducing the whole framework, we discussed data sources and the structure of quantitative trading layer in detail.
Key wordsbig data framework quantitative trading Apache Spark
CLC numberF 830.91
Unable to display preview. Download preview PDF.
- ZAHARIA M, CHOWDHURY M, FRANKLIN M J, et al. Spark: Cluster computing with working sets [C]//Proceedings of the 2nd USENIX Conference on Hot Topics in Cloud Computing. Boston, MA: USENIX Association, 2010: 1765–1773.Google Scholar
- SPARK A. Spark programming guide [EB/OL]. (2015-10-4). [2016-11-14]. http://spark.apache.org/ docs/latest/programming-guide.html.Google Scholar
- SPARK A. Apache spark–lightning-fast cluster computing [EB/OL]. (2014-4-21). [2016-11-14]. http:// spark.apache.org/.Google Scholar