# Inner approximation algorithm for generalized linear multiplicative programming problems

- 219 Downloads

## Abstract

An efficient inner approximation algorithm is presented for solving the generalized linear multiplicative programming problem with generalized linear multiplicative constraints. The problem is firstly converted into an equivalent generalized geometric programming problem, then some magnifying-shrinking skills and approximation strategies are used to convert the equivalent generalized geometric programming problem into a series of posynomial geometric programming problems that can be solved globally. Finally, we prove the convergence property and some practical application examples in optimal design domain, and arithmetic examples taken from recent literatures and GLOBALLib are carried out to validate the performance of the proposed algorithm.

## Keywords

Generalized multiplicative programming Inner approximation algorithm Geometric programming## 1 Introduction

Algorithms for solving the special form of problem (GLMP) emerged endlessly. They are mainly classified as primal-based algorithms that directly solve the primal problem, dual-based algorithms that solve the dual problem, and adapted general nonlinear programming methods [13, 14, 15]. Recently, many works aimed at globally solving special forms of (GLMP) are presented, for example, global algorithms for signomial geometric programming problems, branch and bound algorithms for multiplicative programming with linear constraints, branch and reduction methods for quadratic programming problems, and sum of ratios problems are all in this category [16, 17, 18, 19, 20, 21]. Despite these various contributions to their special forms, however, optimization algorithms for solving the general case of (GLMP) are still scarce. As far as we know, only [9] consider this general case, but only for (GLMP) with geometric constraints.

In this paper, we present an inner approximation algorithm for solving generalized linear multiplicative programming problem described as (GLMP). The (GLMP) is first converted into a generalized geometric programming problem, then the inner approximation algorithm relying on arithmetic-geometric mean inequality and magnifying-shrinking techniques is established. The algorithm works by solving a series of posynomial geometric programming problems. This strategy can be realized owing to the fact that recently developed solution methods can solve even large-scale posynomial geometric programming problems extremely efficiently and reliably [22]. The convergence property is proved and some examples taken from practical applications and recent literatures are performed to verify the efficiency of the presented algorithm. The experimental results show that the presented algorithm has a better capability to solve the (GLMP).

The remainder of this paper is organized in the following way. In Sect. 2, the equivalent generalized geometric programming problem is established and the inner approximation algorithm for solving (GLMP) is designed by utilizing arithmetic-geometric mean inequality and condensation techniques. The convergence property and error analysis of the algorithm are discussed in Sect. 3. Section 4 computationally investigates the performance of the inner approximation algorithm by solving some selective test examples. Some concluding remarks are proposed in the last section.

## 2 Equivalent problem and algorithm development

In this section, the original problem (GLMP) is first transformed into an equivalent generalized geometric programming problem (EGGP) through variable substitution. And for convenience, problem (EGGP) will be further converted into generalized geometric programming with standard form described as formulation (Q). Then our focus will be shifted to solving the equivalent problem (Q). By utilizing the arithmetic-geometric mean inequality and condense techniques based on first order Taylor expansion, we can construct a posynomial geometric programming auxiliary problem (AQ) of the reformulated problem (Q) at each iterative point. Based on this, the proposed algorithm will be developed. The proposed algorithm works by solving a sequence of posynomial geometric programming problems.

### 2.1 Equivalent problem

*z*and an initial box \(Z^{0}\) as follows:

### Theorem 1

\(y^{*}\)*is an optimal solution for the* (GLMP) *if and only if*\((y^{*} ,z^{*})\)*is an optimal solution of* (EP), *where*\(z^{*}_{ijt}=f_{ijt}(y^{*})\), \(i=0,1,\ldots,M\), \(j=1,2,\ldots,p_{i}\), \(t=1,2,\ldots,T_{ip_{j}}\).

### Proof

This theorem is quite easy to verify from the constructing process of problem (EP), thus the proof is omitted here. □

### 2.2 Implementable algorithm

In this part, we concentrate on how to design the inner approximation algorithm for solving the (EGGP). For this, we will perform some transformation and condensation strategies so that problem (EGGP) can be converted into a series of posynomial geometric programming problems which can be easily solved by using computer tools (such as CVX, GPLab).

*τ*is that it will force the succedaneous objective function \(\psi _{0}(x)+\tau >0\), and it is convenient for reformulating the following equivalent optimization problem:

*y*[22]. Based on this, the unallowable constraints of posynomial ratios form \(\frac{\varPsi (x)}{\varPhi (x)}\le 1\) can be approximated with \(\frac{ \varPsi (x)}{\hat{\varPhi }(x)}\le 1\). Applying this skill into all inapposite constraints of problem (Q), we can obtain the following auxiliary problem (AQ) which can be efficiently solved globally [22]:

- Step 1.
(Initialization) Reformulate the initial problem as the equivalent form described in problem (Q), then choose a feasible point \(x^{(0)}\) and \(x_{0}^{(0)}\) (if necessary) as the starting point, give out the solution accuracy \(\vartheta \ge 0\), and set iteration counter \(k:=0\).

- Step 2.
(Inner approximation) At the \(k_{th}\) iteration, replace each constraint with its inner approximation by computing the value of \(\lambda _{i}(y)\) at \((x_{0}^{(k-1)},x^{(k-1)})\), if necessary.

- Step 3.
(Posynomial condensation) Construct the auxiliary problem (AQ) and solve it to obtain \((x_{0}^{(k)},x^{(k)})\).

- Step 4.
(Termination) If \(\Vert x_{0}^{k}-x_{0}^{k-1} \Vert \le \vartheta \), then the algorithm can be terminated. Otherwise, set \(k:=k+1\) and return to Step 2.

### Remark 1

When performing the algorithm described above, one should choose a feasible interior point as the starting point. However, in the practical implementation, we often select an arbitrary point as the starting point when it is difficult to find a feasible interior point for some large-scale (GLMP) problems. This is mainly because the tool (GGPLab) we used for solving (AQ) can quickly produce a feasible interior point of problem (Q) [22].

## 3 Convergence property analysis

In this section, we will briefly take into account the convergence properties of the above algorithm and evaluate the errors in objective and constraint functions produced by monomial approximation.

### Theorem 2

*The proposed algorithm either terminates within finite iterations with an KKT point for problem* (GLMP) *to be found*, *or the limit of any convergent sequence is a KKT point of the* (GLMP).

### Proof

### Remark 2

Although the above algorithm can only obtain a KKT point for problem (Q), according to the special structure of the objective function of problem (Q) and the distinctive characteristics described in [23], we find that the KKT point found by the proposed algorithm is always a global optimal solution for problem (Q).

### Remark 3

## 4 Computational experiments

To test the proposed algorithm in terms of efficiency and solution quality, we performed some computational examples on a personal computer with Intel Xeon(R) CPU 2.40 Ghz and 4 GB memory. The code base is written in matlab 2014a and interfaces GGPLab for the standard geometric programming problems.

We consider some instances of problem (MIQQP) from some recent literature [9, 24, 25, 26, 27] and MINLPLib [28]. Among them, Examples 1, 3, and 4 are three practical applications of (GLMP). Examples 2, 5, 6, 7, 8, and 9 are taken from recent literature for comparison analysis. Example 10 is an example for testing the influence of the numerical experiments for different initial points. Examples 11–13 are three examples from GLOBALLib [29], a collection of nonlinear programming models. The last example is a generalized linear multiplicative programming problem with randomized objective and constraint functions.

### Example 1

(see [24])

This special instance of (GLMP) is first proposed to deal with the optimal design of heat exchanger networks [30]. When performing the algorithm for solving this instance, we choose \((500, 500, 4200, 500, 400, 340, 300, 600)\) as the starting point, the termination error was set to be \(\vartheta =1\times 10^{-6}\). The proposed algorithm terminates after 3.74 seconds (CPU time) with solution \((579.326059, 1359.9445, 5109.977472, 182.019317, 295.600901, 217.980682, 286.418416, 395.600901)\) and optimal value 6944.248031 to be found, and the number of iterations is 21. While the method of Tsai and Lin [24] takes nearly one hour and forty minutes for solving this example, and they obtain a solution \((578.973143, 1359.572730, 5110.701048, 181.9898, 295.5719,218.0101, 286.4179, 395.5719)\) with the optimal value 7049.24682.

### Example 2

(see [9])

In this example, both the objective function and the constraint function are generalized linear multiplicative functions. This example is taken from Jiao, Liu, and Zhao [9]. For solving this problem with the branch and bound algorithm, quite a lot of CPU times need to be consumed; however, we only expend less than two seconds for solving it to global optimality. In the iteration process, we select \((1.5,1.5)\) as the starting point, the termination error was also set to be \(\vartheta =1\times 10^{-6}\).

### Example 3

(see [25])

This example is a signomial geometric programming problem (special case of (GLMP)) which is used to optimize the design of a membrane separation process [25]. Lin and Tsai solved it with a range reduction method and obtained an optimal solution with optimal value −83.249728. For obtaining this solution, the range reduction method spend about 22 second (CPU time). Here, our algorithm terminated after 11 iterations and obtained the optimal solution \((87.614446,8.754375,1.413643,19.311410)\) with optimal value −85.68859, the algorithm implementation took about 0.942 seconds. In the algorithm implementation, we choose the initial upper bound \((100,100,100)\) as the starting point, the termination error was set to be \(\vartheta =1\times 10^{-6}\).

### Example 4

(see [24])

This example is a mathematical model born from optimal design of a reactor. For solving it, we select \((7,7,7,7,7,7,7,7)\) as the starting point, the termination error was set to be \(\vartheta =1\times 10^{-6}\). The proposed algorithm terminates after 7.123 seconds (CPU time) with solution \((6.350802, 2.365111, 0.670723, 0.597563, 5.951950, 5.537204,1.042703,0.415594)\) and optimal value 3.908619 to be found, and the number of iterations is 44. While Tsai and Lin [24] spent nearly 56 minutes and 312 seconds for solving this example and obtained a solution \((6.473164, 2.238234, 0.664955, 0.591012, 5.930263,5.523595,1.011611,0.397171)\) with the optimal value 3.95109.

### Example 5

(see [9])

### Example 6

(see [9])

### Example 7

(see [27])

### Example 8

(see [26])

### Example 9

### Example 10

### Example 11

(st-qpk1)

### Example 12

(ex8-1-7)

### Example 13

(ex4-1-9)

### Example 14

(Small random test)

*n*-dimensional row vectors randomly generated in \([0,1]\), \(m_{1}\), \(m_{2}\), \(r_{1}\), \(r_{2}\), \(s_{1}\), \(s_{2}\), \(t_{1}\), \(t_{2}\) are all random real numbers between 0.001 and 1.001, \(\alpha _{1}\), \(\alpha _{2}\), \(\beta _{1}\), \(\beta _{2}\), \(\gamma _{1}\), \(\gamma _{2}\), \(\theta _{1}\), \(\theta _{2}\) are real numbers randomly generated in \([0,1]\), and we choose

*n*-dimensional vector \((0.5,0.5,\ldots,0.5)\) as the starting point in each instance. The computational results of this problem are listed in Table 3.

Example | Start point | Iterations | Error in objective | Error constraint |
---|---|---|---|---|

(500,500,4200,500,400,340,300,600) | 21 | 0 | 2.2204 × 10 | |

(1.5,1.5) | 5 | 0 | 8.8818 × 10 | |

(100,100,100) | 11 | 2.5070 × 10 | 0 | |

(7,7,7,7,7,7,7,7) | 44 | 0 | 0 | |

(3,400) | 15 | 0 | 0 | |

(0.7,0.7,0.7,0.7) | 8 | 0 | 0 | |

(100,40,30,30,30) | 5 | 0 | 2.2204 × 10 | |

(1.5,1) | 4 | 9.0949 × 10 | 0 | |

(2,1.5) | 6 | 3.5527 × 10 | 7.1054 × 10 |

Example | Methods | Optimal value | Optimal solution | CPU time |
---|---|---|---|---|

[9] | 11.9541 | (11.9604,0.8105,442.344) | 0.416 | |

Ours | 11.3497 | (11.9604,0.681143,436.918047) | 0.13252 | |

[9] | −5.7416 | (8.1244,0.6027,0.5660,5.6352) | 42.3259 | |

Ours | −9.2952 | (9.6867,0.5585,0.1000,5.3252) | 0.8273 | |

[27] | 10,127.13 | (78,32.999,29.995,45,36.7753) | 1 | |

Ours | 10,122.49325 | (78,33,29.9957,45,36.775327) | 0.331298 | |

[26] | −15.0 | (2,1) | 120.580 | |

Ours | −15.0 | (2,1) | 0.3556 | |

[9] | 1.177081 | (1.77091,2.17715) | 0.2260 | |

[27] | 1.1771243 | (1.17712,2.17712) | 0.26069 | |

Ours | 1.177124 | (1.177124,2.177124) | 0.18726 |

Computational results of random Example 14

Dimension | Iterations | CPU time | Error in objective | Error in constraint |
---|---|---|---|---|

| 23 | 9.082938 | 0 | 4.4409 × 10 |

| 20 | 14.92016 | 3.5527 × 10 | 2.6645 × 10 |

| 17 | 36.85216 | 0 | 6.2172 × 10 |

| 53 | 239.0432 | 3.5527 × 10 | 5.3291 × 10 |

| 25 | 257.7263 | 0.7698 × 10 | 1.5395 × 10 |

| 35 | 740.6696 | 8.8818 × 10 | 3.5527 × 10 |

| 56 | 1583.152 | 1.7764 × 10 | 1.7764 × 10 |

| 69 | 2043.238 | 0 | 3.1086 × 10 |

## 5 Concluding remarks

In this paper, an inner approximation algorithm is presented for solving the generalized linear multiplicative programming problem. Local convergence property is proved and some numerical examples taken from application domain and recent literature are performed to verify the efficiency of the algorithm and quality of the solutions obtained. Results of the numerical tests show that this algorithm can effectively solve most generalized linear multiplicative problems to global optimality although it just has local convergence property.

## Notes

### Acknowledgements

Thanks for all the referenced authors.

### Authors’ contributions

Both authors contributed equally to the manuscript, and they read and approved the final manuscript.

### Funding

This paper is supported by the Science and Technology Key Project of Education Department of Henan Province (14A110024).

### Competing interests

The authors declare that there is no conflict of interest regarding the publication of this paper.

## References

- 1.Seido, A.A., Nowak, B., Chu, C.: Fitted Elmore delay: a simple and accurate interconnect delay model. IEEE Trans. Very Large Scale Integr. (VLSI) Syst.
**12**(7), 691–696 (2004) CrossRefGoogle Scholar - 2.Abuo-El-Ata, M., Fergany, H., El-Wakeel, M.: Probabilistic multi-item inventory model with varying order cost under two restrictions: a geometric programming approach. Int. J. Prod. Econ.
**83**(3), 223–231 (2003) CrossRefGoogle Scholar - 3.Boche, H., Stanczak, S.: Optimal QoS tradeoff and power control in CDMA systems. In: Proceedings of the 23rd IEEE Iinfocom, pp. 477–486 (2004) Google Scholar
- 4.Boyd, S., Kim, S.J., Patil, D., Horowitz, M.: Digital circuit optimization via geometric programming. Oper. Res.
**53**(6), 899–932 (2005) MathSciNetzbMATHCrossRefGoogle Scholar - 5.Chiang, M.: Balancing transport and physical layers in wireless multihop networks: jointly optimal congestion control and power control. IEEE J. Sel. Areas Commun.
**23**(1), 104–116 (2005) CrossRefGoogle Scholar - 6.Dorneich, M.C., Sahinidis, N.V.: Global optimization algorithms for chip design and compaction. Eng. Optim.
**25**, 131–154 (1995) CrossRefGoogle Scholar - 7.Ciric, A.R., Floudas, C.A.: A retrofit approach for heat exchanger networks. Comput. Chem. Eng.
**13**(6), 703–715 (1989) CrossRefGoogle Scholar - 8.Greenberg, H.: Mathematical programming models for environmental quality control. Oper. Res.
**43**(4), 578–622 (1995) zbMATHCrossRefGoogle Scholar - 9.Jiao, H.W., Liu, S.Y., Zhao, Y.F.: Effective algorithm for solving the generalized linear multiplicative problem with generalized polynomial constraints. Appl. Math. Model.
**39**, 7568–7582 (2015) MathSciNetCrossRefGoogle Scholar - 10.Zhou, X.G., Wu, K.: A method of acceleration for a class of multiplicative programming problems with exponent. J. Comput. Appl. Math.
**223**, 975–982 (2009) MathSciNetzbMATHCrossRefGoogle Scholar - 11.Wang, C.F., Liu, S.Y., Shen, P.P.: Global minimization of a generalized linear multiplicative programming. Appl. Math. Model.
**36**, 2446–2451 (2012) MathSciNetzbMATHCrossRefGoogle Scholar - 12.Shen, P.P., Li, X.A.: Branch-reduction-bound algorithm for generalized geometric programming. J. Glob. Optim.
**56**, 1123–1142 (2013) MathSciNetzbMATHCrossRefGoogle Scholar - 13.Ecker, J.G.: Geometric programming: methods, computations and applications. SIAM Rev.
**22**(3), 338–362 (1980) MathSciNetzbMATHCrossRefGoogle Scholar - 14.Kortanek, K.O., Xu, X.J., Ye, Y.Y.: An infeasible interior-point algorithm for solving primal and dual geometric programs. Math. Program.
**76**, 155–181 (1996) MathSciNetzbMATHGoogle Scholar - 15.Passy, U.: Generalized weighted mean programming. SIAM J. Appl. Math.
**20**, 763–778 (1971) MathSciNetzbMATHCrossRefGoogle Scholar - 16.Xu, G.X.: Global optimization of signomial geometric programming problems. Eur. J. Oper. Res.
**233**, 500–510 (2014) MathSciNetzbMATHCrossRefGoogle Scholar - 17.Jiao, H.W., Liu, S.Y.: A practicable branch and bound algorithm for sum of linear ratios problem. Eur. J. Oper. Res.
**243**, 723–730 (2015) MathSciNetzbMATHCrossRefGoogle Scholar - 18.Shen, P.P., Wang, C.F.: Global optimization for sum of linear ratios problem with coefficients. Appl. Math. Comput.
**176**, 219–229 (2006) MathSciNetzbMATHGoogle Scholar - 19.Wang, Y.J., Shen, P.P., Liang, Z.A.: A branch-and-bound algorithm to globally solve the sum of several linear ratios. Appl. Math. Comput.
**168**, 89–101 (2005) MathSciNetzbMATHGoogle Scholar - 20.Jiao, H.W.: A branch and bound algorithm for globally solving a class of nonconvex programming problems. Nonlinear Anal.
**70**, 1113–1123 (2009) MathSciNetzbMATHCrossRefGoogle Scholar - 21.Phuong, N.T.H., Tuy, H.: A unified monotonic approach to generalized linear fractional programming. J. Glob. Optim.
**26**, 229–259 (2003) MathSciNetzbMATHCrossRefGoogle Scholar - 22.Boyd, S., Kim, S.J., Vandenberghe, L., Hassibi, A.: A tutorial on geometric programming. Optim. Eng.
**8**, 67–127 (2007) MathSciNetzbMATHCrossRefGoogle Scholar - 23.Marks, B.R., Wright, G.P.: A general inner approximation algorithm for nonconvex mathematical programs. Oper. Res.
**26**(4), 681–683 (1978) MathSciNetzbMATHCrossRefGoogle Scholar - 24.Lin, M.H., Tsai, J.F.: Range reduction techniques for improving computational efficiency in global optimization of signomial geometric programming problems. Eur. J. Oper. Res.
**216**(1), 17–25 (2012) MathSciNetzbMATHCrossRefGoogle Scholar - 25.Dembo, R.S., Avriel, M.: Optimal design of a membrane separation process using signomial programming. Math. Program.
**15**(1), 12–25 (1978) MathSciNetzbMATHCrossRefGoogle Scholar - 26.Shen, P.P., Duan, Y.P., Ma, Y.: A robust solution approach for nonconvex quadratic programs with additional multiplicative constraints. Appl. Math. Comput.
**201**, 514–526 (2008) MathSciNetzbMATHGoogle Scholar - 27.Shen, P.P., Zhang, K.C.: Global optimization of signomial geometric programming using linear relaxation. Appl. Math. Comput.
**150**(1), 99–114 (2004) MathSciNetzbMATHGoogle Scholar - 28.MINLP, http://www.minlplib.org
- 29.GLOBALLib, http://www.gamsworld.org/global/globallib.htm (2016). Vision: 334
- 30.Avriel, M., Williams, A.C.: An extension of geometric programming with applications in engineering optimization. J. Eng. Math.
**5**(3), 187–194 (1971) CrossRefGoogle Scholar

## Copyright information

**Open Access** This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.