Skip to main content

Assessment Metrics for Unsupervised Non-intrusive Load Disaggregation Learning Algorithms

  • Conference paper
  • First Online:
Practical Applications of Intelligent Systems

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 279))

  • 1342 Accesses

Abstract

Non-intrusive appliance load monitoring (NILM) is the process for disaggregating total electricity consumption into its contributing appliances. Unsupervised NILM algorithm is an attractive method as the need for data annotation can be eliminated. In order to evaluate the performance of unsupervised NILM learning algorithm, most of the research work evaluates the algorithm performance using accuracy type metrics. These assessment metrics can not only identify total disaggregation error, but also distinguish the disaggregation error of each other single appliance. In order to better quantify the nature of disaggregation algorithm, we propose two assessment metrics: the total disaggregation accuracy and the disaggregation accuracy for a single appliance. In this paper, we evaluate the performance of unsupervised disaggregation methods using these assessment metrics. The experiment results show that our assessment metrics can evaluate the unsupervised algorithms effectively.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Ritchie JB, McDougall GH, Claxton JD (1981) Complexities of household energy consumption and conservation. J Consum Res 8:233–242

    Google Scholar 

  2. Hart GW (1992) Nonintrusive appliance load monitoring. Proc IEEE 80(12):1870–1891

    Article  Google Scholar 

  3. Parson O, Ghosh S, Weal M, Rogers A (2012) Non-intrusive load monitoring using prior models of general appliance types. In: AAAI, Apr 2012

    Google Scholar 

  4. Shao H, Marwah M, Ramakrishnan N (2013) A temporal motif mining approach to unsupervised energy disaggregation: applications to residential and commercial buildings. Power (W) 250(1700):2250

    Google Scholar 

  5. Kim H, Marwah M, Arlitt MF, Lyon G, Han J (2011) Unsupervised disaggregation of low frequency power measurements. In: Proceedings of the 11th SIAM international conference on data mining, pp 747–758

    Google Scholar 

  6. Kolter JZ, Jaakkola T (2012) Approximate inference in additive factorial HMMs with application to energy disaggregation. In: International conference on artificial intelligence and statistics

    Google Scholar 

  7. Zoha A, Gluhak A, Imran MA, Rajasegarar S (2012) Non-intrusive load monitoring approaches for disaggregated energy sensing: a survey. Sensors 12(12):16838–16866

    Google Scholar 

  8. Fawcett T (2006) An introduction to ROC analysis. Pattern Recogn Lett 27(8):861–874

    MathSciNet  Google Scholar 

  9. Parson O, Ghosh S, Weal M, Rogers A (2011) Using hidden markov models for iterative non-intrusive appliance monitoring. In: Neural Information Processing Systems, Workshop on Machine Learning for Sustainability, 2011

    Google Scholar 

  10. Pereira L (2013) Towards automated non-intrusive load monitoring performance evaluation. In: ICT4S 2013: Proceedings of the first international conference on information and communication technologies for sustainability, ETH Zurich, 14–16 Feb 2013

    Google Scholar 

  11. Kolter JZ, Johnson MJ (2011) Redd: a public data set for energy disaggregation research. In: Proceedings of the SustKDD workshop on data mining applications in sustainability, Aug 2011, pp 1–6

    Google Scholar 

  12. Anderson K, Ocneanu A, Benitez D, Carlson D, Rowe A, Bergés M (2012) BLUED: a fully labeled public dataset for event-based non-intrusive load monitoring research. In: Proceedings of the 2nd KDD workshop on data mining applications in sustainability, Beijing, China, Aug 2012, pp 12–16

    Google Scholar 

  13. Barker S, Mishra A, Irwin D, Cecchet E, Shenoy P, Albrecht J (2012) Smart*: an open data set and tools for enabling research in sustainable homes. In: SustKDD, Aug 2012

    Google Scholar 

  14. Reinhardt A, Baumann P, Burgstahler D, Hollick M, Chonov H, Werner M, Steinmetz R (2012). On the accuracy of appliance identification based on distributed load metering data. In: IEEE international conference on Sustainable internet and ICT for sustainability (SustainIT), Oct 2012, pp 1–9

    Google Scholar 

  15. Ghahramani Z, Jordan MI (1997) Factorial hidden Markov models. Mach learn 29(2–3):245–273

    Article  MATH  Google Scholar 

Download references

Acknowledgements

This work was supported by Scientific Research Fund of Zhejiang Provincial Education Department, China (Grant No. Y201327368).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Yangguang Liu .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Zhang, L., Liu, Y., Chen, G., He, X., Guo, X. (2014). Assessment Metrics for Unsupervised Non-intrusive Load Disaggregation Learning Algorithms. In: Wen, Z., Li, T. (eds) Practical Applications of Intelligent Systems. Advances in Intelligent Systems and Computing, vol 279. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-54927-4_19

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-54927-4_19

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-54926-7

  • Online ISBN: 978-3-642-54927-4

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics