DEoptim {DEoptim}R Documentation

Differential Evolution Optimization

Description

Performs evolutionary optimization via the Differential Evolution algorithm.

Usage

DEoptim(FUN, lower, upper, control = list(), ...)

Arguments

FUN A function to be minimized, with first argument the vector of parameters over which minimization is to take place. It should return a scalar result. NA values are not allowed.
lower, upper Bounds on the variables.
control A list of control parameters. See *Details*.
... Further arguments to be passed to FUN.

Details

DEoptim performs minimization of FUN.

The control argument is a list that can supply any of the following components:

VTR
The value to be reached. The optimization process will stop if either the maximum number of iterations itermax is reached or the best parameter vector bestmem has found a value FUN(bestmem) <= VTR. Defaults to -Inf.
itermax
The maximum iteration (population generation) allowed. Defaults is 200.
NP
Number of population members. Defaults to 50.
F
Stepsize from interval [0,2]. Defaults to 0.8.
CR
Crossover probability from interval [0,1]. Defaults to 0.5.
strategy
Defines the DE-strategy used in the optimization process:
1
best/1/exponential
2
rand/1/exponential
3
rand-to-best/1/exponential
4
best/2/exponential
5
rand/2/exponential
6
best/1/binomial
7
rand/1/binomial
8
rand-to-best/1/binomial
9
best/2/binomial
10
rand/2/binomial

Experiments suggest that binomial likes to have a slightly larger CR than exponential. By default strategy is 7.

refresh
The frequency of reports. Defaults to every 10 iterations.

Value

A list of class DEoptim with the attributes optim and member.

attr(,"optim") contains the followings:
bestmem: the best set of parameters found.
bestval: the value of FUN corresponding to bestmem.
nfeval: number of function evaluations.
iter: number of procedure iterations.

attr(,"member") contains the followings:
lower: the lower boundary.
upper: the upper boundary.
bestvalit: the best value at each iteration.
bestmemit: the best member at each iteration.

Note

DEoptim is a R-vectorized variant of the Differential Evolution algorithm initialy developed by Rainer Storn storn@icsi.berkeley.edu, International Computer Science Institute (ICSI), 1947 Center Street, Suite 600, Berkeley, CA 94704.

If you experience misconvergence in the optimization process you usually have to increase the value for NP, but often you only have to adjust F to be a little lower or higher than 0.8. If you increase NP and simultaneously lower F a little, convergence is more likely to occur but generally takes longer, i.e. DEoptim is getting more robust (there is always a convergence speed/robustness tradeoff).

DEoptim is much more sensitive to the choice of F than it is to the choice of CR. CR is more like a fine tuning element. High values of CR like CR=1 give faster convergence if convergence occurs. Sometimes, however, you have to go down as much as CR=0 to make DEoptim robust enough for a particular problem.

If you choose binomial crossover like, rand/1/binomial, CR is usually higher than in the exponential crossover variant (in this example rand/1/exponential). Still, F and CR are both generally in the range [0.5,1] for most problems we have encountered. Keep in mind that different problems usually require different settings for NP, F and CR.

If you still get misconvergence you might want to try a different method. We mostly use rand/1/... or best/2/... (for the latter F=0.5 is the standard choice). The crossover method is not so important although Ken Price claims that binomial is never worse than exponential. In case of misconvergence also check your choice of objective function. There might be a better one to describe your problem. Any knowledge that you have about the problem should be worked into the objective function. A good objective function can make all the difference.

The R-adaptation DEoptim has properties which differ from the original DE version:

1.
The random selection of vectors is performed by shuffling the population array. Hence a certain vector cannot be chosen twice in the same term of the perturbation expression.
2.
Due to the vectorized expressions DEoptim executes fairly fast.
3.
The parameters are constrained within boundaries.

To perform a maximization (instead of minimization) of a given function, simply define a new function which is the opposite of the function to maximize and apply DEoptim to it.

To integrate additional constraints on the parameters x of FUN(x), for instance x[1] + x[2]^2 < 2, integrate the constraint within the function to optimize, for instance:

    FUN <- function(x){
      if (x[1] + x[2]^2 < 2){
        r <- Inf
      else{
        ...
      }
      return(r)
    }

Note that DEoptim does not support NA values for flexibility. I suggest that you replace eventual NA values by Inf in your function's output.

Author(s)

David Ardia david.ardia@unifr.ch for the R-port; Rainer Storn storn@icsi.berkeley.edu for the Differential Evolution algorithm.

References

Differential Evolution homepage :

http://www.icsi.berkeley.edu/~storn/code.html

Some useful books:

Price, K. V., Storn, R. M. and Lampinen J. A. (2005) Differential Evolution - A Practical Approach to Global Optimization. Springer. ISBN 3540209506.

Nocedal, J. and Wright, S. J. (1999) Numerical Optimization. Springer. ISBN 0387987932.

See Also

DEoptim-methods for methods on DEoptim object; optim or constrOptim for constrained optimization.

Examples

  ## Rosenbrock Banana function
  Rosenbrock <- function(x){
    x1 <- x[1]
    x2 <- x[2]
    100 * (x2 - x1 * x1)^2 + (1 - x1)^2
  }

  lower <- c(-10,-10)
  upper <- -lower
  DEoptim(Rosenbrock, lower, upper)
  DEoptim(Rosenbrock, lower, upper, 
    control = list(NP = 100, refresh = 1))
  DEoptim(Rosenbrock, lower, upper, 
    control = list(NP = 50, itermax = 200, F = 1.5, 
    CR = 0.2, refresh = 1))
  DEoptim(Rosenbrock, lower, upper,
    control = list(NP = 80, itermax = 400, F = 1.2,
    CR = 0.7, refresh = 1))

  ## 'Wild' function, global minimum at about -15.81515
  Wild <- function(x)
    10 * sin(0.3*x) * sin(1.3*x^2) + 
       0.00001 * x^4 + 0.2 * x + 80
  plot(Wild, -50, 50, n = 1000, 
    main = "DEoptim minimizing 'Wild function'")
  DEoptim(Wild, lower = -50, upper = 50,
      control = list(NP = 50, refresh = 1))

[Package DEoptim version 1.1-8 Index]