https://orcid.org/0000-0001-5042-4045
Figures
Abstract
A twinning bare bones particle swarm optimization(TBBPSO) algorithm is proposed in this paper. The TBBPSO is combined by two operators, the twins grouping operator (TGO) and the merger operator (MO). The TGO aims at the reorganization of the particle swarm. Two particles will form as a twin and influence each other in subsequent iterations. In a twin, one particle is designed to do the global search while the other one is designed to do the local search. The MO aims at merging the twins and enhancing the search ability of the main group. Two operators work together to enhance the local minimum escaping ability of proposed methods. In addition, no parameter adjustment is needed in TBBPSO, which means TBBPSO can solve different types of optimization problems without previous information or parameter adjustment. In the benchmark functions test, the CEC2014 benchmark functions are used. Experimental results prove that proposed methods can present high precision results for various types of optimization problems.
Citation: Guo J, Shi B, Yan K, Di Y, Tang J, Xiao H, et al. (2022) A twinning bare bones particle swarm optimization algorithm. PLoS ONE 17(5): e0267197. https://doi.org/10.1371/journal.pone.0267197
Editor: Seyedali Mirjalili, Torrens University Australia, AUSTRALIA
Received: January 16, 2022; Accepted: April 4, 2022; Published: May 2, 2022
Copyright: © 2022 Guo et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the paper and its Supporting information files.
Funding: Yi Di was supported by the Natural Science Foundation of Hubei Province, No. 2020CFB306; Jian Yutang was supported by the Natural Science Foundation of Hubei Province, No. 2019CFB778; Yuji Sato was supported by the JSPS KAKENHI Grant Numbers JP19K12162. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
The particle swarm optimizer (PSO) has evolved into a group of algorithms since it was first introduced by Kennedy and Eberhard in 1995. The PSOs belong to the classical evolutionary algorithm, which is inspired by the behavior of birds flocking and fish schooling. Based on the PSOs, more and more swarm evolutionary algorithms are proposed, like as artificial flora algorithm [1], artificial bee colony algorithm [2], fish swarm algorithm [3], firefly algorithm [4], cuckoo search algorithm [5]. The inspiration for these algorithms comes from the migration and reproduction processes of the swarm. In general, the PSO algorithms specialize in solving nonlinear non-stationary problems and have been widely used in parallel computing [6], pattern recognition [7], automatic control [8], transportation engineering [9] and other fields. For example, Shen [10] designs an effective gas cyclone method by using a hybrid PSO and differential evolution algorithm, and shows that the method with higher efficiency and low cost. Sung [11] proposes a method to increase the accuracy of user positioning in indoor environments using wireless-fidelity (Wi-Fi). The core point lies in the PSO algorithm and the selection of its initial weight, and the experiments have demonstrated that the method can achieve higher positioning accuracy. Li [12] presents a novel PSO-based method for hybrid wind turbine towers which is able to reduce the direct investment, labor cost, mechanical cost, and maintenance cost.
Many interesting variants of the standard PSO algorithm have been derived, like the comprehensive learning particle swarm optimizer (CLPSO) [13], the cooperative particle swarm optimizer (CPSO) [14], the hierarchical particle swarm optimizer (HPSO) [15], the unified particle swarm optimizer (UPSO) [16], and the bare bones particle swarm optimizer (BBPSO) [17]. Among them, the BBPSO algorithm as one of its typical mutated versions has also attracted a lot of attention and has been successfully applied to power systems, chemical testing, disease diagnosis, etc. For instance, Zhang [18] presents a hybrid improved BBPSO algorithm to solve dynamic economic dispatch problems. Zhang [19] proposes two evolutionary BBPSO-based feature optimization. Overall, the BBPSO algorithm is simple and easy to implement, just like other swarm algorithms, to find high-precision results for benchmark functions.
The PSO algorithm and its variants have performed relatively well in solving different types of practical problems. However, many researchers still work to overcome the defects of the PSO algorithm like the curse of dimensionality [14], the collapse of the swarm, the premature convergence, the complex multimodal problems, and so on [15]. Meanwhile, in academia and industry areas, a huge number of complex real-world problems are waiting to be solved. Therefore, the variant of PSO algorithms with superior performance is always needed.
Related works
Researchers try to use different evolutionary method like [20–23]. By reviewing the literature, we can summarize that there are roughly three types of variants of PSO algorithms. The first type of variant focus on the initial weights. Since the original PSO algorithm did not have an inertia weight, Shi [24] proposed a modified PSO algorithm by adding an inertia weight and achieving a faster convergence. Subsequently, a constriction factor was added to the convergence behavior of the PSO algorithm [25]. Some references [15, 26] confirmed that this improved approach has effective results on the large collection problems. In the course of engineering practice, the inertia constant is typically taken to be 0.9 [27].
The second type of variant is concerned with the optimal performance of the particles. Angeline [28] proposed an entirely different approach by introducing a form of selection mechanism that allows some good particles to replace some less effective ones. The multiple neighborhoods are applied to the particle population and each neighborhood keeps its own local best solution [29]. This method is not prone to get trapped in local minima but usually has a slow convergence rate. To address this drawback, cooperative methods were introduced into distributed architectures [14]. In [30], Rui and James argued that each individual is influenced not only by the best performer among its neighbors but also by the success of all its neighbors, based on which they designed a fully informed particle swarm optimizer and confirmed its effectiveness using a benchmark function.
The third type of variant centers on making the PSO algorithm simpler. BBPSO is probably the simplest of all PSO variants and has the potential to solve single-objective unconstrained optimization problems. Details can be found in Eq 1 and Algorithm 1.
(1)
where the
is the personal best position of the particle i in (t)th generation, Gbestt is the personal best position of the global best particle in (t)th generation,
is the candidate new position for particle i in (t + 1)th generation, GD(α, β) is the Gaussian distribution with a mean α and a standard deviation β.
Algorithm 1 BBPSO
Require: Max iteration time, T
Require: Fitness function, F
Require: Search Space, R
Require: Particle swarm X = x1, x2, … xn
1: Randomly generate the initial position of X
2: Calculate the Pbest_value, personal best value of particles
3: the Pbest_position, personal best position of particles
4: Record the Gbest_position, global best position of the swarm
5: Record the Gbest_value, global best value of the swarm
6: t = 0, t stands for the iteration times
7: while t < T do
8: t = t + 1
9: for i in range (1, n) do
10: Chose a new position for xi by Eq (1)
11: end for
12: Update Pbest_value
13: Update Pbest_position
14: Update Gbest_value
15: Update Gbest_position
16: end while
17: Output Gbest_value
18: Output Gbest_position
However, it has the disadvantage of being close to collapse. In [31], Tim proved that a collapse-free condition can be obtained by including the motion of the informant, i.e., allowing a small random search over the entire search space at any stage of the optimization. Zhang [18] designed an adaptive interference factor and a new genetic operator was incorporated into the improved BBPSO. Experimental results showed that the improved method has enhanced its searchability. Mauroas [32] proposed a new method that the positions of the particles are chosen from a multivariate t-distribution and obey the rules adapted to their scale matrix. In [33], Li proposed a new BBPSO-based method, in which the behavior of the particles should obey the principle of the first-order difference equation.
Our team has been focused on improving BBPSO. In the beginning, we design BBPSO-based method that two particle work in pair [34]. In this algorithm, two particles form as a pair and are placed in different sets of evolutionary strategies. Then, we combined a local search strategy with the BBPSO in [35]. In the same way, we use a dynamic allocation strategy to enhance the search ability of BBPSO in [36]. In recent research work, we have adopted a fission-fusion strategy aimed at partitioning the search space [37]. Base on it, we proposed a fission-fusion hybrid bare-bone particle swarm optimizer (FHBBPSO) algorithm, which combines the fission strategy and the fusion strategy, and the particles are assigned to different local groups to sample the corresponding regions.
Proposal of the twinning bare bones particle swarm optimization algorithm
In this paper, only minimum problems will be discussed, hence a better position in this paper stands for a position with a smaller fitness value. When several positions are discussed, a position with the smallest fitness value is defined as the best position. The particle with a better position is defined as a better particle.
The twinning bare bones particle swarm optimization algorithm (TBBPSO) is proposed in this section. In TBBPSO, two particles will form a twin and perform collaborative computing across iterations. The TBBPSO is combined by two main operators, a twins grouping operator (TGO) and a merger operator (MO). The TGO aims at dividing the particle swarm into several sub-groups and the merger operator aims at merging the sub-groups. Particles search around the global best particle and their team leaders in different generations.
The twins grouping operator
The TGO is used to divide the particle swarm into several twins. Each twin contains two particles. Inside a twin, the particle with a smaller fitness value will be pointed as the main particle, and the other one will be the side particle. The next position of a main particle is selected by Eq 2.
(2)
where the pbest(maint) is the personal best position of the main particle in (t)th generation, Gbestt is the personal best position of the global best particle in (t)th generation, pbest(maint+1) is the new position for the ZZmain particle in (t + 1)th generation, GD(γ, δ) is the Gaussian distribution with a mean γ and a standard deviation δ, F is the target test function.
The side particle of a twin is designed to search around the main particle, hence the next position of a team member is selected by Eq 3.
(3)
where the pbest(sidet) is the personal best position of the side particle in (t)th generation, the pbest(maint) is the personal best position of the main particle in (t)th generation, pbest(sidet+1) is the new position for the side particle in (t+ 1)th generation, GD(θ, φ) is the Gaussian distribution with a mean θ and a standard deviation φ, F is the target test function. The pseudo code of the TGO is described in Algorithm 2.
Algorithm 2 TBBPSO-Grouping
Require: Fitness function, F
Require: Search Space, R
Require: Particle swarm X = x1, x2, …, xn
Require: Number of particles, n, n should be an even number
1: Randomly generate the initial position of X
2: Calculate the Pbest_value, personal best value of particles
3: Calculate the the Pbest_position, personal best position of particles
4: Record the Gbest_position, global best position of the swarm
5: Record the Gbest_value, global best value of the swarm
6: NLG = 0, NLG is short for number of local group
7: while X ≠ ⌀ do
8: Take two particles xi and xj out of X
9: xi and xj are defied as a twin
10: if Pbest_value(i) < Pbest_value(j) then
11: Chose a NewPosition for xi by Eq 2
12: Chose a NewPosition for xj by Eq 3
13: NLG = NLG+1
14: else
15: Chose a NewPosition for xi by Eq 3
16: Chose a NewPosition for xj by Eq 2
17: NLG = NLG+1
18: if New positions of any particles out of R then
19: Chose a new randon position for them in R
20: end if
21: end if
22: end while
23: for i = 1, i <= n do
24: if F(NewPosition(i)) < Pbest_value(i) then
25: Pbest_value = F(NewPosition(i))
26: Pbest_position = NewPosition(i)
27: if F(NewPosition(i)) < Gbest_value(i)
28: Gbest_value = F(NewPosition(i))
29: Gbest_position = NewPosition(i)
30: i = i + 1
31: end if
32: end if
33: end for
34: Select a twin as the main local group (MLG)
35: Other twins are sub local groups (SLGs)
Merger operator
The merger operator (MO) is proposed in this section. After grouping, particles were gathered into several local groups including one main local group (MLG) and several sub-local groups (SLGs). In each iteration, the MLS will merge one SLG until no SLG exits. During this process, particles will keep playing as the team leader and the team member. In the MLG, the best particle will be the team leader and others will be members. For all particles, leaders and teammates evolve with the same equations from TGO. The pseudo-code of the MO is given in Algorithm 3.
Algorithm 3 TBBPSO-Merger
Require: Fitness function, F
Require: Search Space, R
Require: Particle swarm X = x1, x2, …, xn
Require: Number of local groups, NLG > 1
Require: Main-local-group, MLG
Require: Sub-local-group, SLG
1: while NLG ≠ 1 do
2: Merge one SLG with the MLG
3: Find the main particles in the MLG
4: Other particles in the MLG are side particles
5: In the MLG
6: Chose a NewPosition for xmain by Eq 2
7: Chose a NewPosition for xside by Eq 3
8: In each SLG
9: Chose NewPosition for xmain by Eq 2
10: Chose NewPosition for xside by Eq 3
11: NLG = NLG − 1
12: end while
13: for i = 1, i ≤ n do
14: if F(NewPosition(i)) < Pbest_value(i) then
15: Pbest_value = F(NewPosition(i))
16: Pbest_position = NewPosition(i)
17: if F(NewPosition(i)) < Gbest_value(i) then
18: Gbest_value = F(NewPosition(i))
19: Gbest_position = NewPosition(i)
20: i = i + 1
21: end if
22: end if
23: end for
Complete process of TBBPSO
To describe the TBBPSO more clearly, the schematic diagram of TBBPSO is given in Fig 1, the flowchart of TBBPSO is shown in Fig 2, the pseudo-code of the TBBPSO is given in Algorithm 4.
Phase 1: All particles are in a same group, TGO is used to generate twins; in each twin, one particle is the group leader and the other one is the teammate; one twin will be selected as the MLG; go to Phase2. Phase 2: In each iteration, the MLG will merge one twin using MO. When all twins are in the MLG, go to Phase 1.
Algorithm 4: TBBPSO-main
Require: Fitness function, F
Require: Search Space, R
Require: Particle swarm X = x1, x2, …, xn
Require: Number of local groups, NLG
Require: Main-local-group, MLG
Require: Sub-local-group, SLG
Require: Max iteration times, T
1: t = 1, NLG = 1
2: while t < T do
3: if NLG = 1 then
4: Run Algorithm 2
5: else
6: Run Algorithm 3
7: end if
8: t = t + 1
9: end while
10: Output Gbest_value
11: Output Gbest_position
Experiments and results
Experimental methods
To verify the optimization ability of the TBBPSO, the CEC 2014 benchmark functions (CEC2014BF) [38] are used in the experiments. Details of the CEC2014BF can be found in Table 1. The, BBPSO [17], PBBPSO [34] and DLS-BBPSO [35] are selected into the control group. To make a fair competition, all algorithms use the same population size, iteration times, and best parameters in their original papers. All tests are repeated 31 times and the average results are recorded to reduce accidental errors,. The population size for all algorithms is 100, dimension is 50, max generation time is 1.000E+4. The Measurement Error (ME) is defined as |final gbest value − Theoretically optimal|.
Experiments with top BBPSO-based method
The FHBBPSO [37], one of the top BBPSO-based methods is selected to compare with TBBPSO. These two methods run on the Rotaten High Conditioned Elliptic Function 31 times, the population size of the two methods is 100, dimension is 50, max iteration times is 1000, and the mean MEs are shown in Table 2. It can be seen that at 100 and 200 iterations, the results of the two methods are very close. After one 1000 iterations, the result of TBBPSO is 22.16% smaller than that of FHBBPSO. It can be assumed that TBBPSO has a clear advantage in this set of experiments.
Experimental results with complete set of benchmark functions
MEs are displayed in Tables 3 and 4. In 30 benchmark functions, TBBPSO ranked first in 12 functions and ranked second in 12 functions. In each benchmark function, the algorithm with the first rank will get 1 point, the second rank will get 2 points, the third rank will get 3 points and the fourth rank will get 4 points. The average rank point of TBBPSO is 1.900, the best of the four optimization algorithms. The Friedman statistic test [22] is also implemented and average rank results are shown in Table 4.
Mean is the mean value from 31 independent runs, STD is the standard deviation of the 31 runs, Rank is the rank of 4 algorithms.
Mean is the mean value from 31 independent runs, STD is the standard deviation of the 31 runs, Rank is the rank of 4 algorithms. Average rank point is at the bottom of the table.
Specifically, numerical analyses are listed below:
- In f1, TBBPSO gains the first rank, the results of TBBBOS are 12.88% better than results from DLS-BBPSO, the second-best algorithm.
- In f2, TBBPSO gains the second rank, the results of TBBBOS are 44.87% worse than results from PBBPSO, the best algorithm.
- In f3, TBBPSO gains the second rank, the results of TBBBOS are 86.22% worse than results from BBPSO, the best algorithm.
- In f4, TBBPSO gains the fourth rank, the results of TBBBOS are 25.40% worse than results from BBPSO, the best algorithm.
- In f5, TBBPSO gains the first rank, the results of TBBBOS are 0.04% better than results from DLS-BBPSO, the second-best algorithm.
- In f6, TBBPSO gains the second rank, the results of TBBBOS are 9.68% worse than results from BBPSO, the best algorithm.
- In f7, TBBPSO gains the second rank, the results of TBBBOS are 71.43% worse than results from DLS-BBPSO, the best algorithm.
- In f8, TBBPSO gains the first rank, the results of TBBBOS are 1.01% better than results from PBBPSO, the second-best algorithm.
- In f9, TBBPSO gains the second rank, the results of TBBBOS are 8.63% worse than results from DLS-BBPSO, the best algorithm.
- In f10, TBBPSO gains the third rank, the results of TBBBOS are 12.87% worse than results from PBBPSO, the best algorithm.
- In f11, TBBPSO gains the first rank, the results of TBBBOS are 2.70% better than results from BBPSO, the second-best algorithm.
- In f12, TBBPSO gains the first rank, the results of TBBBOS are 15.77% better than results from BBPSO, the second-best algorithm.
- In f13, TBBPSO gains the first rank, the results of TBBBOS are 8.03% better than results from DLS-BBPSO, the second-best algorithm.
- In f14, TBBPSO gains the first rank, the results of TBBBOS are 19.11% better than results from BBPSO, the second-best algorithm.
- In f15, TBBPSO gains the second rank, the results of TBBBOS are 0.68% worse than results from DLS-BBPSO, the second-best algorithm.
- In f16, TBBPSO gains the third rank, the results of TBBBOS are 3.13% worse than results from BBPSO, the best algorithm.
- In f17, TBBPSO gains the first rank, the results of TBBBOS are 13.63% better than results from PBBPSO, the second-best algorithm.
- In f18, TBBPSO gains the fourth rank, the results of TBBBOS are 18.13% worse than results from BBPSO, the best algorithm.
- In f19, TBBPSO gains the second rank, the results of TBBBOS are 5.39% worse than results from DLS-BBPSO, the best algorithm.
- In f20, TBBPSO gains the second rank, the results of TBBBOS are 43.42% worse than results from BBPSO, the best algorithm.
- In f21, TBBPSO gains the first rank, the results of TBBBOS are 13.02% better than results from BBPSO, the second-best algorithm.
- In f22, TBBPSO gains the first rank, the results of TBBBOS are 3.78% better than results from DLS-BBPSO, the second-best algorithm.
- In f23, four algorithms give the same results, which means 4 algorithms are trapped by the local minimal and unable to escape.
- In f24, TBBPSO gains the fourth rank, the results of TBBBOS are 1.18% worse than results from PBBPSO, the best algorithm.
- In f25, TBBPSO gains the first rank, the results of TBBBOS are 0.06% better than results from PBBPSO, the second-best algorithm.
- In f26, TBBPSO gains the second rank, the results of TBBBOS are 0.01% worse than results from BBPSO, the best algorithm.
- In f27, TBBPSO gains the third rank, the results of TBBBOS are 13.05% worse than results from BBPSO, the best algorithm.
- In f28, TBBPSO gains the second rank, the results of TBBBOS are 0.587% worse than results from DLS-BBPSO, the best algorithm.
- In f29, TBBPSO gains the second rank, the results of TBBBOS are 0.32% worse than results from BBPSO, the best algorithm.
- In f30, TBBPSO gains the second rank, the results of TBBBOS are 3.61% worse than results from DLS-BBPSO, the best algorithm.
Compared with traditional methods, TBBPSO is more reliable and more robust. The MO and the TGO work together to cross the local minimal and search for high precision results. To perform the convergence situation across iterations, the ME in different iterations for BBPSO, PBBPSO, DLS-BBPSO, and TBBPSO is shown in Figs 3–32. The scale on the vertical axis represents the value of ME. The scale on the horizontal axis represents iteration times, 100 on the horizontal axis represents 10,000 iterations.
Comparison of convergence speed between BBPSO, PBBPSO, DLS-BBPSO and TBBPSO, f1, (a) iteration 0–6000, (b) iteration 6000–10000 the unit is 100 iteration.
Comparison of convergence speed between BBPSO, PBBPSO, DLS-BBPSO and TBBPSO, f2, (a) iteration 0–6000, (b) iteration 6000–10000 the unit is 100 iteration.
Comparison of convergence speed between BBPSO, PBBPSO, DLS-BBPSO and TBBPSO, f3, (a) iteration 0–6000, (b) iteration 6000–10000 the unit is 100 iteration.
Comparison of convergence speed between BBPSO, PBBPSO, DLS-BBPSO and TBBPSO, f4, (a) iteration 0–6000, (b) iteration 6000–10000 the unit is 100 iteration.
Comparison of convergence speed between BBPSO, PBBPSO, DLS-BBPSO and TBBPSO, f5, (a) iteration 0–6000, (b) iteration 6000–10000 the unit is 100 iteration.
Comparison of convergence speed between BBPSO, PBBPSO, DLS-BBPSO and TBBPSO, f6, (a) iteration 0–6000, (b) iteration 6000–10000 the unit is 100 iteration.
Comparison of convergence speed between BBPSO, PBBPSO, DLS-BBPSO and TBBPSO, f7, (a) iteration 0–6000, (b) iteration 6000–10000 the unit is 100 iteration.
Comparison of convergence speed between BBPSO, PBBPSO, DLS-BBPSO and TBBPSO, f8, (a) iteration 0–6000, (b) iteration 6000–10000 the unit is 100 iteration.
Comparison of convergence speed between BBPSO, PBBPSO, DLS-BBPSO and TBBPSO, f9, (a) iteration 0–6000, (b) iteration 6000–10000 the unit is 100 iteration.
Comparison of convergence speed between BBPSO, PBBPSO, DLS-BBPSO and TBBPSO, f10, (a) iteration 0–6000, (b) iteration 6000–10000 the unit is 100 iteration.
Comparison of convergence speed between BBPSO, PBBPSO, DLS-BBPSO and TBBPSO, f11, (a) iteration 0–6000, (b) iteration 6000–10000 the unit is 100 iteration.
Comparison of convergence speed between BBPSO, PBBPSO, DLS-BBPSO and TBBPSO, f12, (a) iteration 0–6000, (b) iteration 6000–10000 the unit is 100 iteration.
Comparison of convergence speed between BBPSO, PBBPSO, DLS-BBPSO and TBBPSO, f13, (a) iteration 0–6000, (b) iteration 6000–10000 the unit is 100 iteration.
Comparison of convergence speed between BBPSO, PBBPSO, DLS-BBPSO and TBBPSO, f14, (a) iteration 0–6000, (b) iteration 6000–10000 the unit is 100 iteration.
Comparison of convergence speed between BBPSO, PBBPSO, DLS-BBPSO and TBBPSO, f15, (a) iteration 0–6000, (b) iteration 6000–10000 the unit is 100 iteration.
Comparison of convergence speed between BBPSO, PBBPSO, DLS-BBPSO and TBBPSO, f16, (a) iteration 0–6000, (b) iteration 6000–10000 the unit is 100 iteration.
Comparison of convergence speed between BBPSO, PBBPSO, DLS-BBPSO and TBBPSO, f17, (a) iteration 0–6000, (b) iteration 6000–10000 the unit is 100 iteration.
Comparison of convergence speed between BBPSO, PBBPSO, DLS-BBPSO and TBBPSO, f18, (a) iteration 0–6000, (b) iteration 6000–10000 the unit is 100 iteration.
Comparison of convergence speed between BBPSO, PBBPSO, DLS-BBPSO and TBBPSO, f19, (a) iteration 0–6000, (b) iteration 6000–10000 the unit is 100 iteration.
Comparison of convergence speed between BBPSO, PBBPSO, DLS-BBPSO and TBBPSO, f20, (a) iteration 0–6000, (b) iteration 6000–10000 the unit is 100 iteration.
Comparison of convergence speed between BBPSO, PBBPSO, DLS-BBPSO and TBBPSO, f21, (a) iteration 0–6000, (b) iteration 6000–10000 the unit is 100 iteration.
Comparison of convergence speed between BBPSO, PBBPSO, DLS-BBPSO and TBBPSO, f22, (a) iteration 0–6000, (b) iteration 6000–10000 the unit is 100 iteration.
Comparison of convergence speed between BBPSO, PBBPSO, DLS-BBPSO and TBBPSO, f23, (a) iteration 0–6000, (b) iteration 6000–10000 the unit is 100 iteration.
Comparison of convergence speed between BBPSO, PBBPSO, DLS-BBPSO and TBBPSO, f24, (a) iteration 0–6000, (b) iteration 6000–10000 the unit is 100 iteration.
Comparison of convergence speed between BBPSO, PBBPSO, DLS-BBPSO and TBBPSO, f25, (a) iteration 0–6000, (b) iteration 6000–10000 the unit is 100 iteration.
Comparison of convergence speed between BBPSO, PBBPSO, DLS-BBPSO and TBBPSO, f26, (a) iteration 0–6000, (b) iteration 6000–10000 the unit is 100 iteration.
Comparison of convergence speed between BBPSO, PBBPSO, DLS-BBPSO and TBBPSO, f27, (a) iteration 0–6000, (b) iteration 6000–10000 the unit is 100 iteration.
Comparison of convergence speed between BBPSO, PBBPSO, DLS-BBPSO and TBBPSO, f28, (a) iteration 0–6000, (b) iteration 6000–10000 the unit is 100 iteration.
Comparison of convergence speed between BBPSO, PBBPSO, DLS-BBPSO and TBBPSO, f29, (a) iteration 0–6000, (b) iteration 6000–10000 the unit is 100 iteration.
Comparison of convergence speed between BBPSO, PBBPSO, DLS-BBPSO and TBBPSO, f30, (a) iteration 0–6000, (b) iteration 6000–10000 the unit is 100 iteration.
Discussion and future works
The main reason that TBBPSO can provide high precision results for test functions is that the TGO divides the original swarm into several local groups. This process increases the diversity of the swarm and enhances exploration. The MO makes the main local group merge one local group per iteration while the rest local groups can keep doing a local search. These processes increase the exploitation.
The overall effectiveness (OE) [21] of TBBPSO and other algorithms in the control group is computed by results in Tables 3 and 4. The OE is calculated by Eq 4.
(4)
where N is the number of test functions, L is the number of times the target algorithm loses in the competition. Results pf OE is shown in Table 5. Four algorithms tie in f23. It can be seen that TBBPSO has the best performance.
In the last iteration, all the particles are concentrated at one point, so it is impossible to find a solution with a better position. How to maintain the diversity of the particle population even after very long iterations will be the main direction of future work. The TGO-MO corporation pattern works well in single-objective optimizations. Another direction of the future work is to apply this work pattern to multi-objective optimization problems.
Conclusions
A TBBPSO is proposed in this paper to solve single-objective optimization problems. The TBBPSO works by re-organizing the structure of the particle swarm. The TGO and MO cooperate to prevent the particle swarm from losing diversity too fast. The TBBPSO presents high-precision results when handling CEC 2014 benchmark functions. The main reason is the cooperation of the TGO and the MO. The TGO divides the particle swarm into several calculation units, the twins. Each twin contains two particles playing different roles. The particle with a better personal best position plays as the team leader, the other one plays as the team member. Different evolution strategies apply to different roles. Then one twin will be selected as the main local group (MLG) and the other twins will be sub-local groups (SLGs). This strategy can increase the diversity of the particle swarm and give the swarm more chance to escape from local minimums. In the MO, the MLG will merge one SLG in every iteration. With the increase of the population, the local search capability of the MLG is increased. At the same time, other SLGs will search independently of each other to ensure the swarm keeps the ability to escape from local minimums. When all SLGs are merged by the MLS, all particles are in the same group and the algorithm goes to the TGO. This process is simple and fast, no parameter, congestion, or threshold is needed, and the time complexity is o(n).
References
- 1. Cheng L, Wu XH, Wang Y. Artificial Flora (AF) Optimization Algorithm. Applied Sciences. 2018;8(3):329.
- 2. Pan QK, Tasgetiren MF, Suganthan PN, Chua TJ. A discrete artificial bee colony algorithm for the lot-streaming flow shop scheduling problem. Information Sciences. 2011;181(12):2455–2468.
- 3. Wang HB, Fan CC, Tu XY. AFSAOCP: A novel artificial fish swarm optimization algorithm aided by ocean current power. Applied Intelligence. 2016;45(4):1–16.
- 4. Sun , Hui , Wang , Wenjun , Cui , Zhihua , et al. Firefly algorithm with neighborhood attraction. Information Sciences: An International Journal. 2017.
- 5. Gandomi AH, Yang XS, Alavi AH. Cuckoo search algorithm: a metaheuristic approach to solve structural optimization problems. Engineering with Computers. 2013.
- 6. Torabi AJ, Er MJ, Li X, Lim BS, Zhai L, Oentaryo RJ, et al. A Survey on Artificial Intelligence-Based Modeling Techniques for High Speed Milling Processes. IEEE Systems Journal. 2015;9(3):1069–1080.
- 7. Nebti S, Boukerram A. Swarm intelligence inspired classifiers for facial recognition. Swarm and Evolutionary Computation. 2017;32:150–166.
- 8. Jain C, Verma HK, Arya LD. A novel statistically tracked particle swarm optimization method for automatic generation control. Journal of Modern Power Systems and Clean Energy. 2014;2(4):396–410.
- 9. Teodorovic D. Swarm intelligence systems for transportation engineering: Principles and applications. Transportation Research Part C. 2008;16(6):651–667.
- 10. Shen X, Ihenacho DC. Design of Gas Cyclone Using Hybrid Particle Swarm Optimization Algorithm. Applied Sciences. 2021;11(20).
- 11. Oh SH, Kim JG. WiFi Positioning in 3GPP Indoor Office with Modified Particle Swarm Optimization. Applied Sciences. 2021;11(20).
- 12. Li Z, Chen H, Xu B, Ge H. Hybrid Wind Turbine Towers Optimization with a Parallel Updated Particle Swarm Algorithm. Applied Sciences. 2021;11(18). pmid:34671486
- 13. Liang JJ, Qin AK, Suganthan PN, Baskar S. Comprehensive learning particle swarm optimizer for global optimization of multimodal functions. IEEE Transactions on Evolutionary Computation. 2006;10(3):281–295.
- 14. Bergh FVD, Engelbrecht AP. A Cooperative Approach to Particle Swarm Optimization. IEEE Transactions on Evolutionary Computation. 2004;8(3):225–239.
- 15. Ratnaweera A, Halgamuge SK, Watson HC. Self-Organizing Hierarchical Particle Swarm Optimizer With Time-Varying Acceleration Coefficients. IEEE Transactions on Evolutionary Computation. 2004;8(3):240–255.
- 16. Parsopoulos KE, Vrahatis MN. A unified particle swarm optimization scheme. lecture. 2004.
- 17.
Kennedy J. Bare bones particle swarms. In: Swarm Intelligence Symposium; 2003.
- 18. Zhang Y, Gong DW, Geng N, Sun XY. Hybrid bare-bones PSO for dynamic economic dispatch with valve-point effects. Applied Soft Computing. 2014;18:248–260.
- 19. Zhang Li, Neoh Siew Chin, Srisukkham , et al. Intelligent leukaemia diagnosis with bare-bones PSO based feature optimization. Applied Soft Computing. 2017.
- 20. Nadimi-Shahraki MH, Fatahi A, Zamani H, Mirjalili S, Abualigah L, Elaziz MA. Migration-based moth-flame optimization algorithm. Processes. 2021;9(12).
- 21. Nadimi-Shahraki MH, Fatahi A, Zamani H, Mirjalili S, Abualigah L. An improved moth-flame optimization algorithm with adaptation mechanism to solve numerical and mechanical engineering problems. Entropy. 2021;23(12). pmid:34945943
- 22. Zamani H, Nadimi-Shahraki MH, Gandomi AH. CCSA: Conscious Neighborhood-based Crow Search Algorithm for Solving Global Optimization Problems. Applied Soft Computing Journal. 2019;85.
- 23. Zamani H, Nadimi-Shahraki MH, Gandomi AH. QANA: Quantum-based avian navigation optimizer algorithm. Engineering Applications of Artificial Intelligence. 2021;104.
- 24.
Shi Y. A Modified Particle Swarm Optimizer. In: Proc of IEEE Icec Conference; 1998.
- 25.
Fan BH, Shi Y. Study on Vmax of particle swarm optimization. In: Workshop on Particle Swarm Optimization Indianapolis; 2001.
- 26.
Eberhart RC. Comparing inertia weights and constriction factors in particle swarm optimization. In: Proceedings of the 2000 IEEE Congress on Evolutionary Computation, La Jolla, CA; 2002.
- 27. Valle YD, Venayagamoorthy GK, Mohagheghi S, Hernandez JC, Harley RG. Particle Swarm Optimization: Basic Concepts, Variants and Applications in Power Systems. IEEE Transactions on Evolutionary Computation. 2008;12(2):171–195.
- 28.
Angeline PJ. Using selection to improve particle swarm optimization. In: Evolutionary Computation Proceedings, 1998. IEEE World Congress on Computational Intelligence., The 1998 IEEE International Conference on; 1998.
- 29.
Kennedy J. Stereotyping: Improving particle swarm performance with cluster analysis. In: Evolutionary Computation, 2000. Proceedings of the 2000 Congress on; 2000.
- 30. Mendes R, Kennedy J, Neves J. The fully informed particle swarm: simpler, maybe better. IEEE Transactions on Evolutionary Computation. 2004;8(3):204–210.
- 31. Blackwell T. A Study of Collapse in Bare Bones Particle Swarm Optimization. IEEE Transactions on Evolutionary Computation. 2012;16(3):354–372.
- 32. Campos M, Krohling RA, Enriquez I. Bare Bones Particle Swarm Optimization With Scale Matrix Adaptation. IEEE Transactions on Cybernetics. 2014;44(9):1567–1578. pmid:25137686
- 33. Li R, Peng Y, Shi H, Wu H, Kwok N. First-Order Difference Bare Bones Particle Swarm Optimizer. IEEE Access. 2019;PP(99):1–1.
- 34. Jia G, Sato Y. A Pair-wise Bare Bones Particle Swarm Optimization Algorithm for Nonlinear Functions. International Journal of Networked and Distributed Computing. 2017;5(3):143.
- 35.
Jia G, Sato Y. A Bare Bones Particle Swarm Optimization Algorithm with Dynamic Local Search. In: International Conference in Swarm Intelligence; 2017.
- 36. Guo J, Sato Y. A dynamic allocation bare bones particle swarm optimization algorithm and its application. Artificial Life and Robotics. 2018;23(3):1–6.
- 37. Guo J, Sato Y. A fission-fusion hybrid bare bones particle swarm optimization algorithm for single-objective optimization problems. Applied Intelligence. 2019;49(5).
- 38.
Liang JJ, Qu BY, Suganthan PN. Problem Definitions and Evaluation Criteria for the CEC 2014 Special Session and Competition on Single Objective Real-Parameter Numerical Optimization. 2014.