Method
Regular perturbation expansions
Adapted
Expands the unknown of a problem carrying a small parameter in powers of and solves the resulting hierarchy order by order: the unit gives the non-degeneracy condition that makes every coefficient computable, the recipe, and the secular terms that destroy the approximation after a time of order .
Prerequisites: Taylor's theorem, Implicit and inverse function theorems, Constant-coefficient equations, Variation of parameters, The damped and driven harmonic oscillator, Asymptotic series
Many problems of physics come as a family indexed by a real parameter , in which the member can be solved and the member of interest has small but non-zero. Stakgold and Holst write such a family out for a boundary-value problem; Strogatz writes one for an initial-value problem. In either case the unknown is a function , and the base problem is with its known solution .
A regular perturbation expansion of order is the ansatz
in which the coefficients do not depend on and are to be found from itself. Strogatz calls the technique regular perturbation theory. Three things are being assumed, and each has to be checked rather than hoped for.
- The limit is of the same type. Setting in must leave a problem of the same kind — same order of equation, same number of boundary conditions, same number of roots — and not a degenerate one. When it does not, the family is singularly perturbed and this unit's method fails; see Singular perturbations and boundary layers.
- The limit solution is non-degenerate. The base solution must be isolated in a sense made precise in the next block, so that is the unique starting point of a branch and not one of several merging ones.
- The expansion is uniform on the region of interest. The error terms must be small uniformly in the independent variable over the whole interval or domain where the answer is wanted. For an initial-value problem posed on this is the assumption that fails most often, and the
remarkbelow says how.
Nothing in the ansatz requires the series to converge. In many problems the coefficients grow so fast that the series diverges for every and is useful only as an asymptotic series, truncated at a finite order.
Let be open, let , and let be of class . Suppose and
Then:
- (Existence of the branch.) There are and and exactly one function with and for all ; moreover is of class .
- (The expansion exists.) For every there are constants with namely .
- (The coefficients are computable in order.) Substitute the truncated expansion into , expand in powers of by Taylor's theorem about , and set the coefficient of to zero. For each the resulting equation has the form where depends only on the earlier coefficients and on partial derivatives of at . Hence are determined successively and uniquely.
Stakgold and Holst use exactly this device — a scalar equation with at the origin, resolved by the implicit function theorem — to show that a simple eigenvalue of a compact self-adjoint operator moves along a well-defined branch when the operator is perturbed. The statement above is the scalar case on its own, stripped of the operator setting.
Order-by-order bookkeeping looks like an act of faith: one writes down a series whose terms are unknown, substitutes it into the problem, and reads off equations. It works for one reason only. The unknown enters at first order through , so when the powers of are collected, the new coefficient appears in the equation linearly, multiplied by the single number , and everything else in that equation is already known. If that number is not zero, each equation is a one-line division. If it is zero, the equation says nothing about , and the whole scheme collapses at the first order where this happens. Everything else — existence of the branch, smoothness, and the fact that the numbers produced really are the Taylor coefficients of a genuine solution — is the implicit function theorem.
-
The branch. Apply the implicit function theorem to at , solving for in terms of . The hypothesis is precisely its non-degeneracy condition, and gives a solution function of class , unique within a neighbourhood. This proves (1).
-
The expansion. Since on , Taylor's theorem gives, for each ,
with . This is (2), with .
-
The shape of the equation. Write and expand about by Taylor's theorem in two variables to total order :
the constant term being absent because . Now put , which is , so that . Collect the coefficient of for a fixed . A term with can contribute, and the coefficient can appear in it only through a factor of carrying the power ; since , that requires and . Every other contribution to the coefficient is built from and from derivatives of at . Writing those contributions as , the coefficient of is
-
Why that coefficient vanishes. By (1), identically on . Hence the function , which is , has all derivatives zero at up to order , so its Taylor polynomial of order is identically zero and every coefficient of , , vanishes.
-
Solving. Combining steps 3 and 4, for . Because — the hypothesis used a second time, now not for existence but for solvability — this determines uniquely from its predecessors, by induction on . This is (3).
The condition carries the whole statement, and it does so twice: once in the implicit function theorem, to produce a branch at all, and once at every order, to solve for . Both failures are visible in two-line examples.
- A double root. has and . The roots are : there are two branches for and none for , and neither branch has an expansion in powers of , because is not differentiable at . The order- equation of the method confirms the diagnosis without any knowledge of the answer: it reads , which has no solution. The cure is to change the gauge, expanding in powers of instead of .
- A root that escapes. loses a root at : the quadratic has two roots for , the linear limit only one. The surviving branch is regular, . The other root is and runs off to infinity as ; no expansion in non-negative powers of can reach it. This is the algebraic model of the degeneracy that produces boundary layers in differential equations, where setting lowers the order and a solution is lost; see Singular perturbations and boundary layers.
- Finite smoothness. bounds the number of terms. With merely the branch exists and is differentiable, so is meaningful, but need not exist.
Nothing above claims convergence. Even for real-analytic, where the branch is analytic and the series converges for small , the radius of convergence is set by the nearest value of at which two branches collide, which is usually not known in advance. For differential equations convergence is the exception; the expansion is normally an asymptotic series and the honest statement is the of the theorem, for fixed as .
- Non-dimensionalise first, then name . Scale the variables so that the small parameter is a dimensionless ratio. Without this step "small" has no meaning and the ordering of terms is arbitrary.
- Inspect the limit problem. Set and ask whether what remains is a problem of the same type with a solvable, isolated solution. If the order of the differential equation drops, a boundary condition becomes unenforceable, or roots disappear, stop: the problem is singular, and Singular perturbations and boundary layers is the relevant method.
- Insert the ansatz. Write and substitute. Expand every nonlinear function of in a Taylor series about , and expand every coefficient that depends on as well.
- Collect powers of and equate each coefficient to zero. This is legitimate because the equation is to hold for a range of , not one value: a function of that vanishes identically has all Taylor coefficients zero.
- Distribute the data. Initial or boundary data that do not depend on are carried entirely by ; every higher coefficient gets the corresponding homogeneous data. If the data do depend on , expand them too and give the part to .
- Solve the hierarchy downwards. The problem is the base problem. Every later problem has the same linear operator — the linearisation of the base problem about — with a right-hand side assembled from the coefficients already found. One linear solve per order, in order.
- Watch for a kernel. If that common operator has a non-trivial kernel, the order- problem is solvable only if its right-hand side satisfies a solvability condition (orthogonality to the kernel of the adjoint; see The Fredholm alternative and modified Green's functions). That condition is not an obstacle but the point: it determines a parameter left free at lower order, such as an eigenvalue or a frequency. In initial-value problems on an unbounded interval the same kernel shows up instead as resonant forcing and a secular term; see the next remark.
- State the range of validity. Compare the first term dropped with the last term kept. The truncation at order is informative only where , and the coefficients often grow with the independent variable, which turns this into a restriction on the variable as well as on .
A body on an elliptical orbit of eccentricity has eccentric anomaly related to the mean anomaly (which grows linearly in time) by Kepler's equation
This is transcendental in and has no closed-form inverse, but is small for most planets, so expand in it. Take fixed and set . At the root is , and
so the statement above applies: there is a unique smooth branch with . (In fact for all whenever , so the root is unique and the branch is global in ; only the expansion in powers of is a local statement.)
Order by order. Write and expand about :
Substituting and collecting powers of in :
- : , so .
- : , so .
- : , so .
Note the shape promised by part 3 of the statement: at every order the new coefficient appears alone, multiplied by , and everything else is already known. Hence
A number to check. Take (radian) and , close to Mercury's eccentricity. Solving numerically gives to six decimals. The truncations are
| order kept | value | error |
|---|---|---|
The first two corrections each cut the error by about an order of magnitude, as a series in should. The third does less, because the coefficient happens to be large at ; adding it gives , error . This is normal behaviour and not a sign of failure: the error after keeping terms is as for fixed , which says nothing about the ordering of individual terms at a fixed . (Kepler's equation is the rare case where the convergence question is settled: the series in converges for below the Laplace limit, about .)
On a bounded interval of the independent variable, a regular expansion with smooth coefficients is as good as its last term. On an unbounded interval it usually is not, and the reason is visible in the hierarchy of step 6 of the method.
Consider an oscillatory base problem, so that the common linear operator of the hierarchy is and the leading solution oscillates at frequency . The right-hand side of the order- problem is built out of , so it generally contains a component at that same frequency . That is resonant forcing of an undamped oscillator, and its response grows linearly: contains a term proportional to or . Strogatz calls such a term, one that grows without bound in , a secular term.
A secular term does not mean the calculation is wrong. The bound in the theorem is an estimate at fixed as , and it holds. What a secular term destroys is uniformity: the two-term approximation is a genuine improvement on only while , that is while
Beyond that the "correction" is larger than the thing it corrects, and the formula is worse than useless — it can predict amplitudes the exact solution provably cannot reach, as the next example shows.
Strogatz makes two further observations about what has gone wrong, both worth keeping. First, a secular term is often the first Taylor coefficient of something perfectly bounded: , so a slow exponential decay of amplitude shows up in a truncated -expansion as linear growth, with the wrong sign and the wrong qualitative behaviour. Recovering the decay from the series would need infinitely many terms, which defeats the purpose. Second, a small shift in frequency, , also appears as a secular term, because ; the phase error accumulates and becomes an error after . Both diagnoses say the same thing: the solution has two time scales, a fast one of order and a slow one of order , and a series in with coefficients depending on alone cannot represent the slow one. The standard repairs — rescaling the frequency before expanding, or treating and as independent variables, which Strogatz calls two-timing (§7.6, p. 218) — build the slow scale into the ansatz from the start. They are not developed here.
Take the Duffing equation (Strogatz, §7.6, Eq. (3), p. 215) with a soft start from rest:
The hierarchy. Put and expand . The initial data do not depend on , so by step 5 they go entirely to :
The base solution is . For the forcing, use :
The first term on the right is at the natural frequency of the operator on the left — exactly the resonance described in the remark. Solving by variation of parameters (or by the standard resonant trial ) and imposing ,
so the two-term approximation is
The first bracketed term is secular; the second is a bounded third-harmonic correction, the signature of a nonlinearity.
Numbers. Take and . Integrating the equation numerically to twelve-digit tolerance and comparing:
| numerical | two-term formula | error | |
|---|---|---|---|
At the formula is good to four decimals. At it is not merely inaccurate but impossible: energy conservation gives
and since while is strictly increasing for , this forces , that is , for all . The two-term formula reports . The crossover is where the remark predicts it: at , and the error has grown to a few per cent by and to order one by , where .
What the secular term was trying to say. Guess instead that the nonlinearity only shifts the frequency, with . Expanding in at fixed reproduces the secular term exactly:
So the growth was the expansion of a phase, not of an amplitude — the second of the two diagnoses in the remark. The frequency-shifted formula, with , gives at against the numerical , an error of rather than , and it stays bounded for all time. Finding the shift without guessing is what the methods named at the end of the remark do.
The single most used consequence of this method in physics is the first-order shift of an eigenvalue, and it is a case where step 7 of the method — the solvability condition — does the work.
Stakgold and Holst take the Sturm-Liouville family
At the eigenvalues are simple, , with normalised eigenfunctions . Differentiating the problem with respect to and setting gives an inhomogeneous problem for whose operator is , and that operator annihilates . So the problem is solvable only if its right-hand side is orthogonal to — and that condition, which at first looks like an obstruction, is what determines the unknown :
The first-order shift is computable without knowing how the eigenfunction moves. For this example , so
For and this predicts ; a finite-difference computation of the eigenvalue gives , an agreement to five decimals, and for the prediction against the computed is still good to three decimals.
In quantum mechanics the same formula is the first thing one reaches for. Riley, Hobson and Bence quote it in the form a physicist uses: if a Hamiltonian acquires an extra small term , then to first order the ground state's energy moves by the expectation value , evaluated in the unperturbed ground state. That is the display above with read as and as : Stark and Zeeman shifts, fine structure and the anharmonic corrections to a vibrational spectrum are all computed this way, and the unperturbed eigenfunctions suffice.
Two further standing uses are worth naming. Celestial mechanics is where the method began: the expansion of Kepler's equation in the eccentricity, as in the example above, together with expansions of planetary orbits in the mass ratios, is how ephemerides were computed for two centuries. And in fluid and plasma problems the same scheme appears as a stability calculation — expand about a known equilibrium in the amplitude of a disturbance and read the growth rate off the order- problem — in which the solvability condition of step 7 becomes the dispersion relation.