Int. J. Simul. Multisci. Des. Optim.
Volume 5, 2014
|Number of page(s)||6|
|Published online||10 March 2014|
A particle swarm optimization approach for permutation flow shop scheduling problem
Assistant Professor, Department of Mechanical Engineering, National Institute of Technology Calicut, Kozhikode
673601, Kerala, India
2 Senior Lecturer, Department of Mechanical Engineering, MEA Engineering College, Perinthalmanna 679325, Kerala, India
3 Research Scholar, Department of Mechanical Engineering, National Institute of Technology Calicut, Kozhikode 673601, Kerala, India
* e-mail: firstname.lastname@example.org
Accepted: 5 November 2013
Flow shop scheduling problem (FSSP) is a combinatorial optimization problem. This work, with the objective of optimizing the makespan of an FSSP uses a particle swarm optimization (PSO) approach. The problems are tested on Taillard’s benchmark problems. The results of Nawaz, Encore and Ham (NEH) heuristic are initialized to the PSO to direct the search into a quality space. Variable neighbourhood search (VNS) is employed to overcome the early convergence of the PSO and helps in global search. The results are compared with standalone PSO, traditional heuristics and the Taillard’s upper bounds. Five problem set are taken from Taillard’s benchmark problems and are solved for various problem sizes. Thus a total of 35 problems are solved. The experimental results show that the solution quality of FSSP can be improved if the search is directed in a quality space based on the proposed PSO approach (PSO-NEH-VNS).
Key words: Makespan / Flow shop scheduling / Particle swarm optimization / Variable neighbourhood search
© T. Radha Ramanan et al., Published by EDP Sciences, 2014
This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Scheduling is the allocation of resources (e.g., machines) to tasks (e.g., jobs) in order to ensure the completion these tasks in a reasonable amount of time. In a flow shop, the technological constraints demand that the jobs pass between the machines in the same order; i.e., If J1 must be processed on machine Mk before machine Mi then the same is true for all jobs. A permutation schedule is one on which each machine processes the jobs in the same order; i.e., if on machine M1 job Ji is processed before Jk, then the same is true for all machines . The objective is to find a sequence of jobs that minimizes the makespan. i.e., time required to complete all the jobs. This problem is found to be NP-hard .
The complexity of the flow shop scheduling problem renders exact solution methods impractical for instances of more than a few jobs and/or machines. This is the main reason for the various heuristic methods proposed in the literature.
The heuristics can be divided into either constructive heuristics or improvement heuristics, the former are heuristics that build a feasible schedule from scratch and the latter are heuristics that try to improve a previously generated schedule by normally applying some form of specific problem knowledge.
The objective of this work is to find a permutation of jobs that minimizes the makespan. The present study explores the further improvement in the solution quality, if the population in the improvement phase is provided with better initial solutions. The work describes the percentage improvement that the proposed method is able to obtain when compared with some of existing heuristics due to the improvisation in the search space of PSO. This approach can be considered as the significant contribution of this study. This work aims at directing the search space of PSO into certain quality. Then, VNS is employed to make the solution jump out of the local optima. This approach is termed as PSO-NEH-VNS heuristic. The solution thus obtained is compared with the results obtained using the PSO and the upper bounds of Taillard’s  benchmark problems. The approach proves that results approach the optimum faster when the search space is nearer to the optimum.
The rest of the paper is organized as follows. Section 2 discusses the literature survey. The methodology is presented in Section 3. The results and discussions are made in Section 4. Conclusions and future scope is given in the Section 5.
Many constructive heuristic approaches have been proposed in the literature. Johnson’s algorithm is the earliest known heuristic for the permutation flow shop problems. The two machine flow shop problem with the objective of minimizing makespan is also known as Johnson’s  problems. An optimal sequence is found by following a heuristics of finding the minimum machining time and allotting the job to the machine in a preferential order is adopted.
Literature is replete with traditional heuristics [5–7] and nontraditional heuristics (Tabu search [8–10]); Simulated annealing [11–14]. Genetic algorithm [15–17], Ant colony optimization  to name a few.
Contrary to constructive heuristics, improvement heuristics start from an already built schedule and try to improve it by some given procedure. Many improvement heuristic approaches also have been proposed in the research [19–21].
Duda  evaluates a particle swarm optimization with variable neighbourhood search against a standalone VNS algorithm. The results of the conducted experiments indicate that hybridization of a meta-heuristic with a local search algorithms may not always bring additional performance benefit. Ali and Fawaz  address the flow shop scheduling problem with respect a due date-based performance measure, i.e., maximum lateness. Lian et al.  propose a novel particle swarm optimization algorithm to minimize the makespan of a flow shop.
Kuo et al.  propose a flow shop scheduling algorithm based on hybrid particle swarm optimization model. Liu et al.  propose a hybrid particle swarm optimization for flow shop scheduling with stochastic processing time. Chen  proposes an improved particle swarm optimization technique for flow shop scheduling. Sha and Lin  propose a PSO model for multi-objective flow shop scheduling. Zhang et al.  provide a hybrid alternate two phases particle swarm algorithm for flow shop scheduling problems. Deb  discusses about the evolutionary approaches used in solving the multi-objective optimization problems.
The objective of the work is to minimize the makespan of the flow shop scheduling problems. This is attempted by developing a PSO approach. Five problem sets are taken from “Taillard”  benchmark problem and are solved for various sizes. A total of 35 problems are solved.
The results of PSO-NEH-VNS is compared with the upper bound (UB) of Taillard’s benchmark and also compared with the results of CDS, NEH, PSO, PSO-NEH, and PSO-VNS.
The Taillards benchmark problem is first solved using NEH heuristics and a sequence is obtained. The PSO requires a population of sequences to be initialized. In this problem, the PSO is initialized with fifteen randomly generated populations. The sequence that is obtained by NEH heuristic is initialized as one of the initial population. This PSO is referred to as PSO initialized with NEH (PSO-NEH). This initialization is made with the hope that the search space is nearer to optimal solution. The results obtained by the PSO-NEH are further improved with the VNS. The VNS prevents the early convergence of PSO and jump out of local optima. This approach is termed as PSO-NEH-VNS. Hansen et al.  state that Variable neighbourhood search (VNS) is a meta-heuristic, or a framework for building heuristics, based upon systematic changes of neighbourhoods both in descent phase, to find a local minimum, and in perturbation phase to emerge from the corresponding valley.
Particle swarm optimization (PSO), inspired by the motion of a flock of birds searching for food, was developed by Kennedy and Eberhart  for optimization of continuous nonlinear functions. To find the optimal solution each bird called a particle adjusts its searching direction according to two factors, its own best previous experience (pbest) and the best experience of all other members (gbest). The system is initialized with a population of random solutions and searches for optima by updating generations. In PSO potential solutions called particles, fly through the problem space by following the current optimum particles. PSO simulates the behaviors of bird flocking. In PSO each single solution is a “bird” in the search space. We call it “particles”. All the particles have fitness value and velocities which direct the flying of the particles. The particles fly through the problem space by following the current optimum particles. Each particle is updated by following two “best” values. The first value is the best solution it has achieved so far known as “pbest”. Second value is the best value obtained so far by any particle is the population called “gbest”. After finding the two best values the particle updates its velocity and position with the following equations(1)where, V = particle velocity, present  = current particle solution, pbest  = best solution among each particle, gbest  = best among defined as before, w = inertia weights 0.8, c1 and c2 are learning factors. Usually c1 = c2 = 2.
The out line of a PSO algorithm is as follows:
Step 1: (Initialization): randomly generate initial particles,
Step 2: (Fitness): evaluate the fitness of each particle in the population,
Step 3: (Update): calculate the velocity of each particle by the equation,
Step 4: (Construction): for each particle, moves to the next position according to the equation (2),
Step 5: (Termination): stop the algorithm if a specified stopping criterion is satisfied; return to Step 2 otherwise.
The objective of this work is to build a PSO model to solve the flow shop scheduling problems for minimizing the makespan; Five problem set are taken from Taillard benchmark problem and are solved. The problems are 20 jobs, 5, 10 and 20 machines; 50 jobs, 5, 10 and and 20 machines and 100 jobs, 5 machines.
Table 1 shows the results of the five instances of 20 × 5, 20 × 10 and 20 × 20 problems that are solved using the various methods.
Makespan of 20 jobs, 5, 10 and 20 machines.
The proposed PSO-NEH-VNS clearly gives better results than other methods such as CDS, NEH, PSO, PSO-NEH, and PSO-VNS. This is possible because the search space of PSO-NEH-VNS is in the area of superior solution. The search space of PSO is initialized with the results of NEH heuristic; this ensures that the solution space is of certain quality. The VNS helps in the solution of PSO jumping out of the local optima. Thus, the interchange of VNS has helped the PSO to come out of the pre convergence.
In smaller size problems the average difference in makespan between upper bound and PSO-NEH-VNS is less and this difference increases with increasing number of machines. Average difference in makespan between PSO-NEH-VNS and UB for 20 Job 5 machines is 12.6, 20 Job 10 machines is 21 and 20 Job 20 machines is 32.
Table 2 shows the makespan of 50 jobs and 5, 10 and 20 machines problem size. The proposed PSO-NEH-VNS clearly give better results than other methods. The makespan obtained by PSO-NEH-VNS is nearly equal (within 5%) to the upper bound of the Taillard’s benchmark problems and in some cases it is equal to the upper bound. (for 50 × 5, SL No. 1). Similar to the previous problem set, the average difference between upper bound and PSO-NEH-VNS increases with increasing number of machines. (For 50 Job 5 machines is 6.2; 50 job 10 machines is 52.2; 50 Job 20 machines is 139.2.)
Makespan of 50 jobs, 5, 10 and 20 machines.
Makespan values of 100 jobs and 5, 10 and 20 machines are shown in Table 3. For the 100 jobs problem as well the proposed PSO-NEH-VNS method gives better results when compared with other methods. In certain instances (For 100 × 5, SL No. 1), the PSO-NEH-VNS is able to give the makespan values equivalent to the upper bound of the Taillard’s benchmark problems.
Makespan of 100 jobs, 5 machine.
Consistently, the PSO-NEH-VNS is giving better results than the other methods taken for comparison. Hence, it can be stated that with a better search space provided for the PSO, the PSO with the help of VNS is able to avoid early convergence. It can also be inferred that the search is able to converge faster because of the initial quality of the search space.
In order to compare computational time required, various approaches are coded in matlab and run on a 3 G B RAM, 2.19 GHz, Dual Core system with Windows XP operating system. The CPU time for various size problems are shown in Table 4.
It can be observed that computational time for PSO NEH VNS approach is slightly lesser than PSO VNS for larger problem sizes.
Table 5 shows the percentage improvement of results of PSO VNS NEH for a 20 job problem size, when compared with other methods used in this work.
Improvement of makespan using PSO NEH VNS.
It can be observed that PSO do better than PSO-VNS. PSO when initialized with the results of NEH does better than both PSO and PSO-VNS algorithms. The VNS takes the PSO to early convergence. But when the same solution is initialized with quality solution space, obtained from the constructive heuristic (NEH), it is able to perform better.
Table 6 shows the comparison of experimental results from literature The results show the PSO-NEH-VNS is providing results that are comparable to the Kuo et al.  HPSO and in one instance (20 × 10) it is able to provide better result. This indicates the PSO-NEH-VNS model is worth exploring.
Comparison of results.
Though the results show the proposed heuristic performs better than certain PSO models, the percentage deviation from the optimum still persists. VNS has an inherent characteristic that is not taking the results to the optimum. But, the objective of the work is to prove that if the initial solution space is provided with quality solutions, the PSO can be used for obtaining faster results.
A particle swarm optimization algorithm named PSO-NEH-VNS is used to solve the FSSP with the objective of minimizing makespan. The research shows that the PSO initialized with a better solution space obtained from the constructive heuristic (NEH), has the ability to provide solutions that are better than some of the existing heuristics and takes the solution to early convergence of results. The results show that the percentage deviation of the makespan increases with the increasing machine, proving that the complexity of the flow shop problems depends on the increasing machine size. The results also show that the percentage deviation of the makespan with respect to the increasing job is not significant.
The authors wish to thank the anonymous reviewers for giving their valuable suggestions in improving the quality of the paper.
- French S. 1982. Sequencing and scheduling: an introduction to the mathematics of the job-shop. Ellis Horwood Limited: Chichester, West Sussex, England, UK. [Google Scholar]
- Garey MR, Johnson DS, Sethi R. 1976. The complexity of flowshop and jobshop scheduling. Mathematics of Operations Research, 1(2), 117–129. [Google Scholar]
- Taillard E. 1993. Benchmarks for basic scheduling problems. European Journal of Operation Research, 64, 278–285. [CrossRef] [Google Scholar]
- Johnson SM. 1954. Optimal two-and three-stage production schedules with set up times include. Naval Research Logistics Quarterly, 1, 61–68. [Google Scholar]
- Palmer DS. 1965. Sequencing jobs through a multistage process in the minimum total time – a quick method of obtaining near optimum. Operational Research Quarterly, 16, 101–107. [CrossRef] [Google Scholar]
- Campbell HG, Dudek RA, Smith ML. 1970. A heuristic algorithm for the n job m machine sequencing problem. Management Science, 16(10), B630–B637. [CrossRef] [Google Scholar]
- Navaz M, Enscore EE, Ham I. 1983. A heuristic algorithm for the m-machine n-job flow shop sequencing problem. Omega, 11, 91–95. [CrossRef] [Google Scholar]
- Widmer M, Hertz A. 1989. A new heuristic for the flow shop sequencing problem. European Journal of Operational Research, 41, 186–193. [CrossRef] [Google Scholar]
- Nowicki E, Smutnicki C. 1996. A fast Tabu search algorithm for the permutation flow shop problem. European Journal of Operations Research, 91, 160–175. [CrossRef] [Google Scholar]
- Moccellin JV, Santos MO. 2000. An adaptive hybrid meta-heuristic for permutation flow shop scheduling. Control and Cybernetics, 29(3), 761–771. [MathSciNet] [Google Scholar]
- Osman I, Potts C. 1989. Simulated annealing for permutation flow shop scheduling. OMEGA, 17(6), 551–557. [CrossRef] [Google Scholar]
- Chen CL, Vempati VS, Aljaber N. 1995. An application of genetic algorithms for flow shop problems. European Journal of Operational Research, 80, 389–396. [CrossRef] [Google Scholar]
- Low C. 2005. Simulated annealing heuristics for flow shop scheduling problems with unrelated parallel machines. Computers & Operations Research, 32(8), 2013–2025. [CrossRef] [Google Scholar]
- Ishibuchi H, Misaki S, Tanaka H. 1995. Modified simulated annealing algorithms for the flow shop sequencing problem. European Journal of Operational Research, 81(2), 388–398. [CrossRef] [Google Scholar]
- Reeves C. 1995. A genetic algorithm for flow shop sequencing. Computers and Operations Research, 22(1), 5–13. [CrossRef] [Google Scholar]
- Chen CL, Vempati VS, Aljaber N. 1995. An application of genetic algorithms for flow shop problems. European Journal of Operational Research, 80, 389–396. [CrossRef] [Google Scholar]
- Zobolas GI, Tarantilis CD, Ioannou G. 2009. Minimizing makespan in permutation flow shop scheduling problems using a hybrid metaheuristic algorithm. Computers & Operations Research, 36(4), 1249–1267. [CrossRef] [MathSciNet] [Google Scholar]
- Yagmahan B, Yenisey MM. 2008. Ant colony optimization for multi-objective flow shop scheduling problem. Computers & Industrial Engineering, 54, 411–420. [CrossRef] [Google Scholar]
- Rajendran C. 1995. Theory and methodology heuristics for scheduling in flow shop with multiple objectives. European Journal of Operational Research, 82, 540–555. [CrossRef] [Google Scholar]
- Koulamas C. 1998. A new constructive heuristic for the flow shop scheduling problem. European Journal of Operational Research Society, 105, 66–71. [CrossRef] [Google Scholar]
- Suliman S. 2000. A two-phase heuristic approach to the permutation flow-shop scheduling problem. International Journal of Production Economics, 64, 143–152. [CrossRef] [Google Scholar]
- Duda J. 2006. Local search and nature based metaheuristics: a case of flow shop scheduling problem, in Proceedings of the International multiconference on Computer Science and Information Technology, PIPS. p. 17–24, ISSN 1896-7094. [Google Scholar]
- Allahverdi A, Fawaz S, Anzi A. 2006. A PSO and a Tabu search heuristics for the assembly scheduling problem of the two-stage distributed database application. Computers & Operations Research, 33(4), 1056–1080. [CrossRef] [Google Scholar]
- Lian Z, Gu X, Jiao B. 2008. A novel particle swarm optimization algorithm for permutation flow-shop scheduling to minimize makespan. Chaos, Solitons & Fractals, 35(5), 851–861. [CrossRef] [Google Scholar]
- Kuo IH, Horng SJ, Kao TW, Lin TL, Fan P. 2007. An efficient flow-shop scheduling algorithm based on a hybrid particle swarm optimization model, in IEA/AIE 2007, LNAI 4570, Okuno HG, Ali M, Editors. Springer-Verlag: Berlin, Heidelberg. p. 03–312. [Google Scholar]
- Liu B, Wang L, Jin Y. 2005. Hybrid particle swarm optimization for flow shop scheduling with stochastic processing time, in CIS 2005, Part I, LNAI 3801, Hao Y, et al., Editor. Springer-Verlag: Berlin, Heidelberg. p. 630–637. [Google Scholar]
- Chen Q. 2010. Flow shop scheduling using an improved PSO, vol. 2, in International Conference on Measuring Technology and Mechatronics Automation. p. 296–299 . [CrossRef] [Google Scholar]
- Sha DY, Lin HH. 2009. A particle swarm optimization for multi-objective flow shop scheduling. International Journal of Advanced Manufacturing Technology, 45, 749–758. [CrossRef] [Google Scholar]
- Zhang C, Ning J, Ouyang D. 2010. A hybrid alternative two phases particle swarm optimization algorithm for flow shop scheduling problem. Computers & Industrial Engineering, 58(1), 1–11. [CrossRef] [Google Scholar]
- Deb K. 2007. Current trends in evolutionary multi-objective optimization. International Journal for Simulation and Multidisciplinary Design Optimization, 1, 1–8. [CrossRef] [EDP Sciences] [Google Scholar]
- Hansen P, Mladenovíc N. 1997. Variable neighborhood search for the p-median. Location Science, 5, 207–226. [CrossRef] [Google Scholar]
- Kennedy J, Eberhart RC. 1995. Particle swam optimization, in Roc. IEEE International Conference on Neural Networks (Path, Australia). IEEE Service Center: Piscataway, NJ. p. 1942–1948, [Google Scholar]
Cite this article as: Ramanan Radha T, Iqbal M & Umarali K: A particle swarm optimization approach for permutation flow shop scheduling problem. Int. J. Simul. Multisci. Des. Optim., 2014, 5, A20.
Current usage metrics show cumulative count of Article Views (full-text article views including HTML views, PDF and ePub downloads, according to the available data) and Abstracts Views on Vision4Press platform.
Data correspond to usage on the plateform after 2015. The current usage metrics is available 48-96 hours after online publication and is updated daily on week days.
Initial download of the metrics may take a while.