Accelerating Online Change-Point Detection Algorithm Using 10 GbE FPGA NIC

  • Takuma IwataEmail author
  • Kohei Nakamura
  • Yuta Tokusashi
  • Hiroki Matsutani
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11339)


In statistical analysis and data mining, change-point detection that identifies the change-points which are times when the probability distribution of time series changes has been used for various purposes, such as anomaly detections on network traffic and transaction data. However, computation cost of a conventional AR (Auto-Regression) model based approach is too high and infeasible for online. In this paper, an AR model based online change-point detection algorithm, called ChangeFinder, is implemented on an FPGA (Field Programmable Gate Array) based NIC (Network Interface Card). The proposed system computes the change-point score from time series data received from 10 GbE (10 Gbit Ethernet). More specifically, it computes the change-point score at the 10 GbE NIC in advance of host applications. This paper aims to reduce the host workload and improve change-point detection performance by offloading ChangeFinder algorithm from host to the NIC. As evaluations, change-point detection in the FPGA NIC is compared with a baseline software implementation and those enhanced by two network optimization techniques using DPDK and Netfilter in terms of throughput. The result demonstrates 16.8x improvement in change-point detection throughput compared to the baseline software implementation. The throughput achieves 83.4% of the 10 GbE line rate.



This work was supported by JST CREST Grant Number JPMJCR1785, Japan.


  1. 1.
  2. 2.
    The NetFPGA Project.
  3. 3.
    Aminikhanghahi, S., Cook, D.J.: A survey of methods for time series change point detection. Knowl. Inf. Syst. 51(2), 339–367 (2017)CrossRefGoogle Scholar
  4. 4.
    Benacek, P., Blazek, R.B., Cejka, T., Kubatova, H.: Change-point detection method on 100 Gb/s ethernet interface. In: Proceedings of the ACM/IEEE Symposium on Architectures for Networking and Communications Systems (ANCS 2014), pp. 245–246, June 2014Google Scholar
  5. 5.
    Guralnik, V., Srivastava, J.: Event detection from time series data. In: Proceedings of the International Conference on Knowledge Discovery and Data Mining (KDD 1999), pp. 33–42, August 1999Google Scholar
  6. 6.
    Hayashi, A., Matsutani, H.: An FPGA-based In-NIC Cache approach for lazy learning outlier filtering. In: Proceedings of the International Conference on Parallel, Distributed, and Network-Based Processing (PDP 2017), pp. 15–22, March 2017Google Scholar
  7. 7.
    Hayashi, A., Tokusashi, Y., Matsutani, H.: A line rate outlier filtering FPGA NIC using 10 GbE interface. ACM SIGARCH Comput. Archit. News 43(4), 22–27 (2015)CrossRefGoogle Scholar
  8. 8.
    Takeuchi, J., Yamanishi, K.: A unifying framework for detecting outliers and change points from time series. IEEE Trans. Knowl. Data Eng. 18(4), 482–492 (2006)CrossRefGoogle Scholar
  9. 9.
    Kawahara, Y., Sugiyama, M.: Change-point detection in time-series data by direct density-ratio estimation. In: Proceedings of the SIAM International Conference on Data Mining (SDM 2009), pp. 389–400, April 2009CrossRefGoogle Scholar
  10. 10.
    Pu, Y., Peng, J., Huang, L., Chen, J.: An efficient KNN algorithm implemented on FPGA based heterogeneous computing system using OpenCL. In: Proceedings of the International Symposium on Field-Programmable Custom Computing Machines (FCCM 2015), pp. 167–170, May 2015Google Scholar
  11. 11.
    Saaid, F., Nur, D., King, R.: Change points detection of vector autoregressive model using SDVAR algorithm. In: Proceedings of the 5th Annual ASEARC Conference, pp. 18–21, February 2012Google Scholar
  12. 12.
    Urabe, Y., Yamanishi, K., Tomioka, R., Iwai, H.: Real-time change-point detection using sequentially discounting normalized maximum likelihood coding. In: Huang, J.Z., Cao, L., Srivastava, J. (eds.) PAKDD 2011. LNCS, vol. 6635, pp. 185–197. Springer, Heidelberg (2011). Scholar
  13. 13.
    Wang, H., Zhang, D., Shin, K.G.: Change-point monitoring for the detection of DoS attacks. IEEE Trans. Dependable Secure Comput. 1(4), 193–208 (2004)CrossRefGoogle Scholar
  14. 14.
    Xilinx: AXI Reference Guide (2011)Google Scholar
  15. 15.
    Yamanishi, K., Takeuchi, J.: A unifying framework for detecting outliers and change points from non-stationary time series data. In: Proceedings of the International Conference on Knowledge Discovery and Data Mining (KDD 2002), pp. 676–681, July 2002Google Scholar
  16. 16.
    YouTube: Accelerating ChangeFinder using 10Gbps FPGA NIC.
  17. 17.
    Zilberman, N., Audzevich, Y., Covington, G.A., Moore, A.W.: NetFPGA SUME: toward 100 Gbps as research commodity. IEEE Micro 34(5), 32–41 (2014)CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  • Takuma Iwata
    • 1
    Email author
  • Kohei Nakamura
    • 1
  • Yuta Tokusashi
    • 1
  • Hiroki Matsutani
    • 1
  1. 1.Keio UniversityKohoku-kuJapan

Personalised recommendations