Springer (part of Springer Nature), Cluster Computing, 2(17), p. 371-387
DOI: 10.1007/s10586-012-0228-5
Full text: Download
The availability of a large number of separate clusters has given rise to the field of multicluster systems in which these resources are coupled to obtain their combined benefits to solve large-scale compute-intensive applications. However, it is challenging to achieve automatic load balanc-ing of the jobs across these participating autonomic systems. We developed a novel user space execution model named DA-TC to address the workload allocation techniques for the applications with large number of sequential jobs in mul-ticluster systems. Through this model, we can achieve dy-namic load balancing for task assignment, and slower re-sources become beneficial factors rather than bottlenecks for application execution. The effectiveness of this strategy is demonstrated through theoretical analysis. This model is also evaluated through extensive experimental studies and the results show that when compared with the traditional method, the proposed DA-TC model can significantly im-prove the performance of application execution in terms of application turnaround time and system reliability in multi-cluster circumstances.