Bulk Synchronous Parallelisation of Genetic Programming

Dimitris C. Dracopoulosgif - Simon Kentgif

Abstract:

Genetic Programming (GP) is a relatively new discipline which aims in the automatic discovery of computer programs. It offers a method of solving problems which are difficult, or impossible to solve through conventional methods. Genetic programming [1] is an extension of the genetic algorithm (GA) [3] function optimization method. Both methods are based on the evolutionary process of the Darwinian natural selection.

Despite its advantages, one drawback of Genetic Programming is the considerable execution time which can be required to produce a solution. The nature of the Genetic Programming process lends itself to the possibility of parallelisation. Koza[2] has carried out some work on parallel GP using transputers, however there has generally been relatively little work in this area (unlike genetic algorithms for which several parallel implementations exist).

This paper investigates two implementations of parallel Genetic Programming, using the Bulk Synchronous Parallel (BSP) model of parallel computation. The first uses a global approach where the GP process is explicitly parallelised by dividing the task amongst a number of processors. The second approach adopts a coarse grained approach in which the ratio between communication and computation is reduced. The aim is to speedup the GP process, and to evaluate BSP as to its suitability as a model for use in producing parallel GP implementations.

It is shown that considerable speedup of the GP execution can be achieved and that the BSP model is very suitable for parallelisation of similar algorithms. Using the implemented BSP GP system, higher speedups can be achieved in large problems. In addition, the time required to parallelise evolutionary algorithms with the BSP model is insignificant, compared with the achieved speedups, when the problem is a complex and time consuming. The BSP Oxford library proved to be very suitable and efficient for the parallelisation of the GP process, so as to suggest its use for evolutionary algorithms.

References

1
John R. Koza. Genetic Programming: on the Programming of Computers by means of Natural Selection. MIT Press, 1993.

2
John R. Koza and David Andre. Parallel genetic programming on a network of transputers. Technical Report CS-TR-95-1542, Stanford University, 1995.

3
David E. Goldberg. Genetic Algorithms in Search, Optimization and Machine Learning. Addison Wesley, 1989.
...Dracopoulos
Brunel University, Department of Computer Science and Information Systems, London, UK; Email: Dimitris.Dracopoulos@brunel.ac.uk

...Kent
Brunel University, Department of Computer Science and Information Systems, London, UK; Email: Simon.Kent@brunel.ac.uk



Jerzy Wasniewski
Mon Jun 24 17:46:34 1996