Host Load Prediction for Grid Computing Using Free Load Profiles

Abstract

In Order to increase the overall performance, we have studied methods for improving load prediction, which would help improve load balancing in the Grid. Current software designed to handle distributed applications does focus on the problem of forecasting the computer’s future load. The UNIX five-second-host load has been collected and used to predict the host load, but the solution of forecasting can be further improved if CPU historical load data had been collected separately for each login user. Another important aspect of historical data collection is that before submission to the grid, the user separates his HPC program into sizable parallel programs and test runs them supposedly on load free computers. This means the user can obtain the load profile of the parallel program on a load free computer together with other important information. Once the free load profile is known, load behaviour of a job under certain variable background load conditions can be predicted. Thus the forecast can be performed for each user before adding the weighted values towards the final solution of prediction. In this paper we have proved that load prediction using free load profiles provided better results. In fact once the user based load data are collected, the forecasting is somewhat like that of the Stock market.