Event Processing over a Distributed JSON Store: Design and Performance

  • Miki Enoki
  • Jérôme Siméon
  • Hiroshi Horii
  • Martin Hirzel
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8787)

Abstract

Web applications are increasingly built to target both desktop and mobile users. As a result, modern Web development infrastructure must be able to process large numbers of events (e.g., for location-based features) and support analytics over those events, with applications ranging from banking (e.g., fraud detection) to retail (e.g., just-in-time personalized promotions). We describe a system specifically designed for those applications, allowing high-throughput event processing along with analytics. Our main contribution is the design and implementation of an in-memory JSON store that can handle both events and analytics workloads. The store relies on the JSON model in order to serve data through a common Web API. Thanks to the flexibility of the JSON model, the store can integrate data from systems of record (e.g., customer profiles) with data transmitted between the server and a large number of clients (e.g., location-based events or transactions). The proposed store is built over a distributed, transactional, in-memory object cache for performance. Our experiments show that our implementation handles high throughput and low latency without sacrificing scalability.

Keywords

Events Processing Analytics Rules JSON In-Memory Database 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Miki Enoki
    • 1
  • Jérôme Siméon
    • 2
  • Hiroshi Horii
    • 1
  • Martin Hirzel
    • 2
  1. 1.IBM ResearchTokyoJapan
  2. 2.IBM ResearchNew YorkUSA

Personalised recommendations