Skip to main content
SpringerLink
Log in

Validating an Incremental Rule Management Approach for Financial Market Data Pre-processing

  • Conference paper
  • First Online:
Book cover Enterprise Applications and Services in the Finance Industry (FinanceCom 2014)

Part of the book series: Lecture Notes in Business Information Processing ((LNBIP,volume 217))

  • 632 Accesses

Abstract

Driven by the growth and availability of vast amounts of financial market data, financial studies are becoming increasingly of interest to finance researchers. However, financial market data is normally huge in amount and with data quality issues especially time-related ones, which renders it extremely difficult to generate reliable results and get interesting insights. Data pre-processing is hence necessary to control data quality and have raw data standardised, which is often achieved by using bespoke or commercial tools. In this paper, we first define ACTER criteria (automatability, customisability, time-handleability, evolvability and repeatability) to assess a financial market data pre-processing system. Then we update our previously proposed system (EP-RDR), which uses an incremental rule management approach for building and conducting user-driven event data analysis, with some new features to make it more suitable for financial market data pre-processing. Finally, we apply the ACTER criteria on an EP-RDR prototype as well as some other existing tools in the context of two real-life financial study scenarios to compare the desirability of these tools for financial market data pre-processing.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 34.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 44.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    “epsAmount” denotes the value of the field “EPS Amount” in the “Earning” event, and “EPS_scaling_factor” denotes the value of the field “EPS Scaling Factor”.

References

  1. Han, J., Kamber, M.: Data Mining: Concepts and Techniques, 2nd edn. Morgan Kaufmann Publishers, San Francisco, CA, USA (2006)

    Google Scholar 

  2. Binder, J.: The event study methodology since 1969. In: Review of Quantitative Finance and Accounting, vol. 11, pp. 111–137 1998/09/01 1998

    Google Scholar 

  3. Eventus. (2012). http://www.eventstudy.com/

  4. Compton, P., Jansen, R.: Knowledge in context: a strategy for expert system maintenance. In: 2nd Australian Joint Artificial Intelligence Conference, pp. 292–306 (1988)

    Google Scholar 

  5. Bitterer, A.: Who’s Who in Open-Source Data Quality, 18 January 2012 2012

    Google Scholar 

  6. IBM. (2009). IBM Quality Stage. http://www-01.ibm.com/software/data/infosphere/qualitystage/

  7. SAP (2011). Data Quality Management. www.sap.com

  8. Friedman, T., Bitterer, A.: Magic Quadrant for Data Quality Tools, 28 July 2011 2011

    Google Scholar 

  9. OpenRefine. (2015). http://openrefine.org/

  10. Etzion, O., Niblett, P.: Event Processing in Action. Manning Publications Co, Greenwich (2011)

    Google Scholar 

  11. Esper (2013). http://esper.codehaus.org/

  12. RedHat (2015). Drools Fusion. http://drools.jboss.org/drools-fusion.html

  13. SoftwareAG (2015). Apama. http://www.softwareag.com/corporate/products/apama_webmethods/analytics/overview/default.asp

  14. Deontik (2013). EventSwarm. http://deontik.com/Products/EventSwarm.html

  15. Luckham, D.: (2006). What’s the Difference Between ESP and CEP? http://www.complexevents.com/?p=103

  16. Hinze, A., Sachs, K., Buchmann, A.: Event-based applications and enabling technologies. In: Presented at the Proceedings of the Third ACM International Conference on Distributed Event-Based Systems, Nashville, Tennessee (2009)

    Google Scholar 

  17. Chen, W., Rabhi, F.: An RDR-based approach for event data analysis. In: Presented at the Third Australasian Symposium on Service Research and Innovation (ASSRI 2013), Sydney, Australia (2013)

    Google Scholar 

  18. Richards, D.: Two decades of ripple down rules research. Knowl. Eng. Rev. 24(2), 159–184 (2009)

    Article  Google Scholar 

  19. Compton, P., Peters, L., Edwards, G., Lavers, T.G.: Experience with Ripple-Down Rules. Knowl. Based Syst. 19, 356–362 (2006)

    Article  Google Scholar 

  20. Sirca (2015). http://www.sirca.org.au/

  21. Berry, A., Milosevic, Z.: Real-time analytics for legacy data streams in health: monitoring health data quality. In: Presented at the 17th IEEE International Enterprise Distributed Object Computing Conference (EDOC), 2013, Vancouver, BC (2013)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Computer Science and Engineering, University of New South Wales, Sydney, 2052, Australia

    Weisi Chen & Fethi A. Rabhi

Authors
  1. Weisi Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Fethi A. Rabhi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Weisi Chen .

Editor information

Editors and Affiliations

  1. Curtin University, Perth, West Australia, Australia

    Artur Lugmayr

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Chen, W., Rabhi, F.A. (2015). Validating an Incremental Rule Management Approach for Financial Market Data Pre-processing. In: Lugmayr, A. (eds) Enterprise Applications and Services in the Finance Industry. FinanceCom 2014. Lecture Notes in Business Information Processing, vol 217. Springer, Cham. https://doi.org/10.1007/978-3-319-28151-3_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-28151-3_5

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-28150-6

  • Online ISBN: 978-3-319-28151-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation