Page, Andrew J. and Keane, Thomas M. and Naughton, Thomas J. (2008) Scheduling in a dynamic heterogeneous distributed system using estimation error. Journal of Parallel and Distributed Computing, 68 (11). pp. 1452-1462. ISSN 0743-7315

Preview

Download (1MB) | Preview

Abstract

In real-world dynamic heterogeneous distributed systems, allocating tasks to processors can be an inefficient process, due to the dynamic nature of the resources, and the tasks to be processed. The information about these tasks and resources is not known a priori, and thus must be estimated online.We utilize the accuracy of these estimates, and when combined with different objectives, such as minimizing makespan and evenly distributing load, naturally gives rise to a family of four different scheduling algorithms. The algorithms have been implemented on a real-world heterogeneous distributed system with up to 90 processors. A set of real-world problems from the areas of cryptography, bioinformatics, and biomedical engineering were used as a test-set to measure the effectiveness of the scheduling algorithms. We have found that considering estimation error when allocating tasks to processors can provide more efficient solutions, than when estimation error is not considered. We have found that using a simple heuristic, combined with estimation error, can in some cases provide solutions approaching the efficiency of complicated well-known evolutionary algorithms.

Item Type:	Article
Keywords:	Scheduling; Error estimation; Heterogeneous; Distributed computing;
Academic Unit:	Faculty of Science and Engineering > Computer Science
Item ID:	8633
Identification Number:	https://doi.org/10.1016/j.jpdc.2008.07.004
Depositing User:	Thomas Naughton
Date Deposited:	18 Aug 2017 14:53
Journal or Publication Title:	Journal of Parallel and Distributed Computing
Publisher:	Elsevier
Refereed:	Yes
Funders:	Irish Research Council for Science Engineering and Technology (IRCSET), European Commission Marie Curie Intra-European Individual Fellowship
URI:	http://www.sciencedirect.com/
Use Licence:	This item is available under a Creative Commons Attribution Non Commercial Share Alike Licence (CC BY-NC-SA). Details of this licence are available here

Repository Staff Only(login required)

Item control page

Downloads

Origin of downloads