In applied mathematics, weak duality is a concept in optimization which states that the duality gap is always greater than or equal to 0. This means that for any minimization problem, called the primal problem, the solution to the primal problem is always greater than or equal to the solution to the dual maximization problem.: 225 Alternatively, the solution to a primal maximization problem is always less than or equal to the solution to the dual minimization problem.
Weak duality is in contrast to strong duality, which states that the primal optimal objective and the dual optimal objective are equal. Strong duality only holds in certain cases.
Many primal-dual approximation algorithms are based on the principle of weak duality.
Consider a linear programming problem,
maximize x ∈ R n c ⊤ x subject to A x ≤ b , x ≥ 0 , {\displaystyle {\begin{aligned}{\underset {x\in \mathbb {R} ^{n}}{\text{maximize}}}\quad &c^{\top }x\\{\text{subject to}}\quad &Ax\leq b,\\&x\geq 0,\end{aligned}}} | (1) |
where A {\displaystyle A} 1) is
is m × n {\displaystyle m\times n} and b {\displaystyle b} is m × 1 {\displaystyle m\times 1} . The dual problem of (
minimize y ∈ R m b ⊤ y subject to A ⊤ y ≥ c , y ≥ 0. {\displaystyle {\begin{aligned}{\underset {y\in \mathbb {R} ^{m}}{\text{minimize}}}\quad &b^{\top }y\\{\text{subject to}}\quad &A^{\top }y\geq c,\\&y\geq 0.\end{aligned}}} | (2) |
The weak duality theorem states that c ⊤ x ∗ ≤ b ⊤ y ∗ {\displaystyle c^{\top }x^{*}\leq b^{\top }y^{*}} 1) and every solution y ∗ {\displaystyle y^{*}} to the dual problem (2).
for every solution x ∗ {\displaystyle x^{*}} to the primal problem (Namely, if ( x 1 , x 2 , . . . . , x n ) {\displaystyle (x_{1},x_{2},....,x_{n})} linear program and ( y 1 , y 2 , . . . . , y m ) {\displaystyle (y_{1},y_{2},....,y_{m})} is a feasible solution for the dual minimization linear program, then the weak duality theorem can be stated as ∑ j = 1 n c j x j ≤ ∑ i = 1 m b i y i {\displaystyle \sum _{j=1}^{n}c_{j}x_{j}\leq \sum _{i=1}^{m}b_{i}y_{i}} , where c j {\displaystyle c_{j}} and b i {\displaystyle b_{i}} are the coefficients of the respective objective functions.
is a feasible solution for the primal maximizationProof: cTx = xTc ≤ xTATy ≤ bTy
More generally, if x {\displaystyle x}
is a feasible solution for the primal maximization problem and y {\displaystyle y} is a feasible solution for the dual minimization problem, then weak duality implies f ( x ) ≤ g ( y ) {\displaystyle f(x)\leq g(y)} where f {\displaystyle f} and g {\displaystyle g} are the objective functions for the primal and dual problems respectively.