Abstract
With the emergence of grid computing, researchers in different fields are making use of the huge computing power of the grid to carry out massive computing tasks that are beyond the power of a single processor. When a computing task (or job) is submitted to the grid, some useful information about the job is logged in the database by the Scheduler. The computing infrastructure that makes up the grid is expensive; hence, it is of great importance to understand the resource usage pattern. In this paper, we propose an incremental attribute-oriented approach that mines data within a given time interval. We test our approach using a real life data of logs of jobs submitted to Western Canada Research Grid (WestGrid). We also develop an incremental attribute-oriented mining tool to implement the proposed approach. Our approach uncovers some hidden patterns and changes that take place over a period of time.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
GRID RESEARCH CENTRE, http://grid.ucalgary.ca/resources.html
Han, J., Fu, Y.: Attribute-Oriented Induction in data Mining. In: Advances in Knowledge Discovery and Data Mining, pp. 399–421 (1996)
WESTERN CANADIAN RESEARCH GRID, http://www.westgrid.ca/home.html
Han, J., Cai, Y., Cercone, N.: Data-Driven Discovery of Quantitative Rules in Relational Databases. IEEE TKDE 5(1), 29–40 (1993)
Chen, M.-S., Han, J., Yu, P.S.: Data Mining: An overview from Database perspective. IEEE TKDE 8(6), 866–883 (1996)
Han, J., et al.: A System for Mining Knowledge in Large Relational Databases. In: Proceedings of ACM-KDD (1996)
Han, J., Kamber, M.: Data Mining Concepts and Techniques. Morgan Kaufmann Series in Data Management Systems. Morgan Kaufmann Publishers, San Francisco (2000)
Han, J., Cai, Y., Cercone, N.: Knowledge Discovery in Databases: An Attribute-Oriented Approach. In: Proceedings of VLDB, Vancouver, pp. 547–559 (1992)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Adewale, I.O., Alhajj, R. (2005). Mining Job Logs Using Incremental Attribute-Oriented Approach. In: Gallagher, M., Hogan, J.P., Maire, F. (eds) Intelligent Data Engineering and Automated Learning - IDEAL 2005. IDEAL 2005. Lecture Notes in Computer Science, vol 3578. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11508069_16
Download citation
DOI: https://doi.org/10.1007/11508069_16
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-26972-4
Online ISBN: 978-3-540-31693-0
eBook Packages: Computer ScienceComputer Science (R0)