1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
/* L-BFGS-B is released under the "New BSD License" (aka "Modified BSD License" */
/* or "3-clause license") */
/* Please read attached file License.txt */
/*
DRIVER 1 in Fortran 77
--------------------------------------------------------------
SIMPLE DRIVER FOR L-BFGS-B (version 3.0)
--------------------------------------------------------------
L-BFGS-B is a code for solving large nonlinear optimization
problems with simple bounds on the variables.
The code can also be used for unconstrained problems and is
as efficient for these problems as the earlier limited memory
code L-BFGS.
This is the simplest driver in the package. It uses all the
default settings of the code.
References:
[1] R. H. Byrd, P. Lu, J. Nocedal and C. Zhu, ``A limited
memory algorithm for bound constrained optimization'',
SIAM J. Scientific Computing 16 (1995), no. 5, pp. 1190--1208.
[2] C. Zhu, R.H. Byrd, P. Lu, J. Nocedal, ``L-BFGS-B: FORTRAN
Subroutines for Large Scale Bound Constrained Optimization''
Tech. Report, NAM-11, EECS Department, Northwestern University,
1994.
(Postscript files of these papers are available via anonymous
ftp to eecs.nwu.edu in the directory pub/lbfgs/lbfgs_bcm.)
* * *
March 2011 (latest revision)
Optimization Center at Northwestern University
Instituto Tecnologico Autonomo de Mexico
Jorge Nocedal and Jose Luis Morales, Remark on "Algorithm 778:
L-BFGS-B: Fortran Subroutines for Large-Scale Bound Constrained
Optimization" (2011). To appear in ACM Transactions on
Mathematical Software,
--------------------------------------------------------------
DESCRIPTION OF THE VARIABLES IN L-BFGS-B
--------------------------------------------------------------
n is an INTEGER variable that must be set by the user to the
number of variables. It is not altered by the routine.
m is an INTEGER variable that must be set by the user to the
number of corrections used in the limited memory matrix.
It is not altered by the routine. Values of m < 3 are
not recommended, and large values of m can result in excessive
computing time. The range 3 <= m <= 20 is recommended.
x is a DOUBLE PRECISION array of length n. On initial entry
it must be set by the user to the values of the initial
estimate of the solution vector. Upon successful exit, it
contains the values of the variables at the best point
found (usually an approximate solution).
l is a DOUBLE PRECISION array of length n that must be set by
the user to the values of the lower bounds on the variables. If
the i-th variable has no lower bound, l(i) need not be defined.
u is a DOUBLE PRECISION array of length n that must be set by
the user to the values of the upper bounds on the variables. If
the i-th variable has no upper bound, u(i) need not be defined.
nbd is an INTEGER array of dimension n that must be set by the
user to the type of bounds imposed on the variables:
nbd(i)=0 if x(i) is unbounded,
1 if x(i) has only a lower bound,
2 if x(i) has both lower and upper bounds,
3 if x(i) has only an upper bound.
f is a DOUBLE PRECISION variable. If the routine setulb returns
with task(1:2)= 'FG', then f must be set by the user to
contain the value of the function at the point x.
g is a DOUBLE PRECISION array of length n. If the routine setulb
returns with taskb(1:2)= 'FG', then g must be set by the user to
contain the components of the gradient at the point x.
factr is a DOUBLE PRECISION variable that must be set by the user.
It is a tolerance in the termination test for the algorithm.
The iteration will stop when
(f^k - f^{k+1})/max{|f^k|,|f^{k+1}|,1} <= factr*epsmch
where epsmch is the machine precision which is automatically
generated by the code. Typical values for factr on a computer
with 15 digits of accuracy in double precision are:
factr=1.d+12 for low accuracy;
1.d+7 for moderate accuracy;
1.d+1 for extremely high accuracy.
The user can suppress this termination test by setting factr=0.
pgtol is a double precision variable.
On entry pgtol >= 0 is specified by the user. The iteration
will stop when
max{|proj g_i | i = 1, ..., n} <= pgtol
where pg_i is the ith component of the projected gradient.
The user can suppress this termination test by setting pgtol=0.
wa is a DOUBLE PRECISION array of length
(2mmax + 5)nmax + 11mmax^2 + 8mmax used as workspace.
This array must not be altered by the user.
iwa is an INTEGER array of length 3nmax used as
workspace. This array must not be altered by the user.
task is a CHARACTER string of length 60.
On first entry, it must be set to 'START'.
On a return with task(1:2)='FG', the user must evaluate the
function f and gradient g at the returned value of x.
On a return with task(1:5)='NEW_X', an iteration of the
algorithm has concluded, and f and g contain f(x) and g(x)
respectively. The user can decide whether to continue or stop
the iteration.
When
task(1:4)='CONV', the termination test in L-BFGS-B has been
satisfied;
task(1:4)='ABNO', the routine has terminated abnormally
without being able to satisfy the termination conditions,
x contains the best approximation found,
f and g contain f(x) and g(x) respectively;
task(1:5)='ERROR', the routine has detected an error in the
input parameters;
On exit with task = 'CONV', 'ABNO' or 'ERROR', the variable task
contains additional information that the user can print.
This array should not be altered unless the user wants to
stop the run for some reason. See driver2 or driver3
for a detailed explanation on how to stop the run
by assigning task(1:4)='STOP' in the driver.
iprint is an INTEGER variable that must be set by the user.
It controls the frequency and type of output generated:
iprint<0 no output is generated;
iprint=0 print only one line at the last iteration;
0<iprint<99 print also f and |proj g| every iprint iterations;
iprint=99 print details of every iteration except n-vectors;
iprint=100 print also the changes of active set and final x;
iprint>100 print details of every iteration including x and g;
When iprint > 0, the file iterate.dat will be created to
summarize the iteration.
csave is a CHARACTER working array of length 60.
lsave is a LOGICAL working array of dimension 4.
On exit with task = 'NEW_X', the following information is
available:
lsave(1) = .true. the initial x did not satisfy the bounds;
lsave(2) = .true. the problem contains bounds;
lsave(3) = .true. each variable has upper and lower bounds.
isave is an INTEGER working array of dimension 44.
On exit with task = 'NEW_X', it contains information that
the user may want to access:
isave(30) = the current iteration number;
isave(34) = the total number of function and gradient
evaluations;
isave(36) = the number of function value or gradient
evaluations in the current iteration;
isave(38) = the number of free variables in the current
iteration;
isave(39) = the number of active constraints at the current
iteration;
see the subroutine setulb.f for a description of other
information contained in isave
dsave is a DOUBLE PRECISION working array of dimension 29.
On exit with task = 'NEW_X', it contains information that
the user may want to access:
dsave(2) = the value of f at the previous iteration;
dsave(5) = the machine precision epsmch generated by the code;
dsave(13) = the infinity norm of the projected gradient;
see the subroutine setulb.f for a description of other
information contained in dsave
--------------------------------------------------------------
END OF THE DESCRIPTION OF THE VARIABLES IN L-BFGS-B
--------------------------------------------------------------
*/
/* Main program */
//int MAIN__(void)
int /* MAIN__ */
///* Main program alias */ int driver_ () { MAIN__ (); return 0; }