Application
The Lorenz equations
Adapted
Collects what can be established about the Lorenz system by the standard tools — its symmetry, its constant rate of phase-volume contraction, a trapping ellipsoid, the three equilibria and their eigenvalues, global stability of the origin for by a Liapunov function, and the threshold at which the convective equilibria lose stability — and shows why, for , , , these results together leave no possibility except a strange attractor.
Prerequisites: Lyapunov functions, Linearization and the Hartman-Grobman theorem, The Hopf bifurcation, Bifurcations in one dimension, The divergence theorem, Eigenvalues and eigenvectors
The Lorenz system is the three-dimensional autonomous system
with parameters . Here is the Prandtl number and the Rayleigh number; has no name and is fixed by the geometry of the convection cell. Hirsch, Smale and Devaney assume throughout, in addition, that , and so do we wherever the stability of the convective equilibria is in question. Write for the vector field, so that the system is .
Where it comes from. Lorenz obtained the system in 1963 by truncating a model of a fluid layer heated from below and cooled from above to three Fourier amplitudes: measures the strength of the convective overturning, the horizontal and the vertical temperature variation. The same three equations describe, exactly rather than approximately, the Malkus-Howard waterwheel — a wheel with leaky cups on its rim, fed with water from above — in which the mass distribution around the rim is expanded in a Fourier series and all but three amplitudes decouple. In that model is again a Rayleigh number, measuring the driving (gravity and inflow) against the dissipation (leakage and damping).
Attractors. Following Strogatz, a closed set in phase space is an attractor if
- is invariant: every trajectory starting in remains in for all time;
- attracts an open set: there is an open such that the distance from to tends to as for every (the largest such is the basin of attraction); and
- is minimal: no proper subset of has both properties.
An attractor is strange if the motion on it shows sensitive dependence on initial conditions, as that is defined in Lyapunov exponents and sensitive dependence.
Let .
-
Symmetry. The reflection maps solutions to solutions: if solves the system, so does . The -axis is invariant, and on it , so every solution starting on it tends to the origin.
-
Volume contraction. , a negative constant. Hence if is a region with smooth boundary and is the volume of its image under the flow,
Every phase volume shrinks to zero exponentially, at a rate independent of position.
-
A trapping region. Put , whose level sets are ellipsoids centred at . There is a such that on every level set with . Consequently every solution enters the solid ellipsoid in finite time and stays there.
-
Equilibria. The origin is an equilibrium for all parameter values. For there are two more,
which are exchanged by the symmetry and which coalesce with the origin in a pitchfork bifurcation as .
-
The origin. Its eigenvalues are and
For both are negative, so the origin is a sink; for one is positive, so the origin is a saddle with a two-dimensional stable surface and a one-dimensional unstable curve.
-
Global stability for . If , every solution tends to the origin. In particular there are no closed orbits and no chaos below .
-
The convective equilibria. Assume . The eigenvalues at are the roots of
and are sinks for
At a Hopf bifurcation occurs. It is subcritical: the limit cycles involved are unstable and exist for , so for slightly above there is no attractor near .
-
What volume contraction excludes. The system has no quasiperiodic solutions, no repelling equilibria and no repelling closed orbits. Hence for no equilibrium and no closed orbit can be an attractor near , while by part 3 no trajectory can escape to infinity.
Parts 1, 2, 4 and 5 are direct computations. The two that carry the argument are the Liapunov function and the trapping ellipsoid, and both work the same way: choose a positive definite quadratic form, differentiate it along the flow, and watch the cubic terms cancel. They cancel because the only nonlinearities are in and in , and the single product they generate appears twice with opposite signs whenever and are weighted equally. What is left is a quadratic form, and the whole question becomes whether that form is definite — an exercise in completing the square. Part 7 then locates the stability boundary not by finding the roots of the cubic but by asking when a purely imaginary root is possible, which splits the cubic into two real equations for one unknown and leaves one condition on .
-
Symmetry. Substituting into the right-hand side gives , which is ; so the reflected curve satisfies the same system. On the first two equations give , so the -axis is invariant, and there has solution .
-
Volume contraction. Adding the three diagonal derivatives,
By Liouville's theorem, , and since the integrand is the constant this is . Integrating the resulting linear equation gives the stated exponential. (Liouville's theorem is itself the divergence theorem applied to the volume swept out by the boundary: in time a patch of the boundary sweeps , so ; see the divergence theorem.)
-
The trapping ellipsoid. Differentiate along the flow:
The terms contribute , and the cubic terms contribute . What remains is
by completing the square in . So at every point outside the solid ellipsoid . The function is continuous and is compact, so attains a maximum on ; let exceed it. Then the level set with lies entirely outside , so there: no trajectory crosses it outwards, and the solid region is positively invariant. Outside it, is bounded above by a negative constant (again by compactness, applied to the region for any ), so decreases to in finite time.
-
Equilibria. Setting gives ; then gives , and gives . Either , forcing and the origin; or and , which has real solutions precisely for and gives . The symmetry maps to . As both merge with the origin, and by part 5 the origin changes from sink to saddle there, which is a pitchfork bifurcation (see Bifurcations in one dimension for the name).
-
The origin. The Jacobian of , whose eigenvalues decide stability by linearization, is
which at the origin is block diagonal: the row and column decouple, contributing the eigenvalue , and the upper block has trace and determinant , whence the stated . For the determinant is positive and the trace negative, so both roots have negative real part; moreover the discriminant , so they are real and the origin is a stable node. For the determinant is negative, so the roots are real of opposite sign and the origin is a saddle; counting the decoupled , it has two stable directions and one unstable one.
-
Global stability for . Take the positive definite function
Along a solution,
the cubic terms cancelling as in part 3. Write . Its discriminant as a quadratic form is , which is negative exactly when ; a binary quadratic form with positive leading coefficient and negative discriminant is positive definite, so for . Hence except at the origin, where it vanishes: is a strict Liapunov function on all of , and by the Liapunov stability theorem the origin is asymptotically stable with basin all of . (Strogatz uses , which is the same function rescaled.)
-
The convective equilibria. At we have and , so
Expanding and using gives the stated cubic, whose coefficients depend only on and so are the same at and .
At the cubic is , with roots , , , which are distinct because gives . For slightly above the roots move continuously; the constant term is now positive and the polynomial is positive for every , so no root is real and non-negative, and all three roots are real and negative.
A root can acquire a non-negative real part only by crossing the imaginary axis, and since no root is ever for , the crossing must be at with . Substituting and separating real and imaginary parts:
The second gives ; substituting into the first and cancelling ,
Since , this is positive and finite, and it is the smallest at which a root reaches the imaginary axis; below it all roots keep negative real parts, so are sinks for .
That the bifurcation at is a genuine Hopf bifurcation is stated without proof by Hirsch, Smale and Devaney; that it is subcritical — so that the bifurcating cycles are unstable and lie on the side — is a separate calculation that Strogatz also does not reproduce, attributing it to Marsden and McCracken (1976). We follow both and do not prove it here.
-
Consequences of contraction. A quasiperiodic solution would lie on an invariant torus, and the volume enclosed by that torus would be constant in time, contradicting part 2. A repelling equilibrium can be enclosed in a small sphere of initial conditions, and a repelling closed orbit in a thin tube around it; in either case the enclosed volume grows, again contradicting part 2.
- Positivity of , , is used throughout; it is that makes in part 6 positive definite, and that makes the -axis contracting in part 1.
- , strictly, is the whole of part 6: at the form becomes , which is only positive semi-definite, and vanishes on the whole line , . The conclusion survives at by a further argument, but not by this one.
- is used only in part 7, twice: to separate the three roots at , and to make positive. If the formula for is negative or undefined, and do not lose stability this way. The standard parameters , satisfy it with room to spare.
- Volume contraction does not by itself produce chaos. It gives a limiting set of zero volume, which could perfectly well be a point or a curve; indeed for it is a point. Part 8 is what removes the simple alternatives, and only in combination with part 7.
- Two definitions of "attractor". We have followed Strogatz, whose third condition is minimality. Hirsch, Smale and Devaney instead require to be compact and invariant, to satisfy for some open with , and to be transitive: any two points of have neighbourhoods joined by a single solution curve. The two conditions have the same purpose — to stop a union of several attractors from counting as one — and both reject the same standard example, the interval for , . They are not equivalent in general, and we do not use either beyond that purpose.
- What is not proved here or anywhere in our sources. Nothing above shows that the set seen in simulations at , , is an attractor in either sense. Strogatz, writing in 1994, records that no one had proved it. Hirsch, Smale and Devaney analyse instead a geometric model built to imitate the flow, prove that the model has a chaotic attractor, and report that the model was proved to describe the equations themselves only in 1999.
The sequence of steps above is not special to Lorenz's equations; it is the standard opening for any polynomial system in .
- Look for symmetries. A linear involution with halves the work: equilibria and orbits come in pairs, and any bifurcation creating a pair of equilibria from one is a pitchfork rather than a saddle-node.
- Compute . If it is a negative constant , all volumes decay like , and you may immediately rule out quasiperiodicity and all repelling invariant sets.
- Find a trapping region. Try a positive definite quadratic centred where the flow seems to live, differentiate along the flow, and choose the weights so that the cubic terms cancel. Complete the square in the remaining quadratic; the region where should come out bounded, and any sufficiently large sublevel set of then traps the flow.
- Find the equilibria and linearise. Where the Jacobian is block triangular, read the eigenvalues off the blocks.
- Try the same quadratic as a Liapunov function near the parameter value where the first equilibrium loses stability; this often gives global, not merely local, stability on one side of the threshold.
- Locate the stability boundary of the remaining equilibria by substituting into the characteristic polynomial rather than solving it. Real and imaginary parts give two equations in and the parameter; eliminating gives the threshold.
- Count what is left. If no equilibrium and no closed orbit can attract, and nothing escapes to infinity, the long-time behaviour has to be something else.
Take Lorenz's values , . Then , so the standing assumption holds, and
Volume. The contraction rate is , so phase volumes shrink by the factor per unit of time; the half-life of a volume is time units. A blob of initial conditions of diameter has shrunk in volume by six orders of magnitude after one time unit, which is roughly one and a half circuits of the attractor.
At , above . The equilibria are the origin and
At the origin the eigenvalues are and
a saddle with one unstable direction, as part 5 predicts for .
At the cubic of part 7 is
Its roots, computed numerically, are
The complex pair has positive real part, confirming that lies above . So each of is a saddle-focus with a one-dimensional stable manifold and a two-dimensional unstable one, and a trajectory near it spirals outwards within that unstable surface, taking time units per turn. (As a check on the cubic: the sum of its roots is , and the product is .)
Putting the parts together. At these parameters: no trajectory escapes, by part 3; the origin is a saddle and are saddle-foci, so no equilibrium attracts; there is no attracting closed orbit near , because the Hopf bifurcation at is subcritical; there are no quasiperiodic motions and no repellers, by part 8; and every volume shrinks to zero. The only possibility left is that almost every trajectory approaches a set of zero volume on which the motion is aperiodic — the strange attractor, whose sensitive dependence is quantified in Lyapunov exponents and sensitive dependence and whose fractional dimension is the subject of Fractals and dimension.
Convection and the waterwheel. The system's first use is as a caricature of Rayleigh-Benard convection: is pure conduction with the fluid at rest, is steady convection in rolls of one handedness or the other (the two being exchanged by the symmetry , which is why the bifurcation at is a pitchfork), and is the irregular regime. Every statement above has a mechanical counterpart in the Malkus-Howard waterwheel, where is the angular velocity: at low inflow the wheel sits still, at moderate inflow it settles into steady rotation one way or the other, and above threshold it turns a few times, stalls, and reverses, erratically and forever. The same equations arise for a laser (the Maxwell-Bloch equations transform into them) and in models of geomagnetic dynamos, which is one reason the irregular reversals are suggestive.
Why the parameter repays study. Holding , and varying shows that the chaotic regime is neither the only nor the final behaviour. Below but above a strange attractor coexists with the two stable equilibria, so the outcome depends on the initial condition and the system shows hysteresis as is swept. Below that, down to a homoclinic bifurcation near , there is transient chaos: trajectories rattle around irregularly for a long and unpredictable time before settling on or . This is worth separating from chaos proper, because it shows that a system with only simple attractors can still be effectively unpredictable — the reason a thrown die is a fair randomiser although it has six stable resting positions. For large the dynamics simplify again, to a globally attracting limit cycle for above a few hundred, corresponding to a waterwheel that rocks regularly back and forth.
Chaos as a carrier. A striking engineering use turns the sensitivity into an advantage. Cuomo and Oppenheim built two identical Lorenz circuits in the rescaled variables , , , for which the equations read , , . The transmitter runs freely; the receiver runs the same equations except that the transmitted scalar is substituted for its own first coordinate wherever that coordinate multiplies something in the last two equations. The error between the two states then obeys
a linear system with a chaotic time-dependent coefficient. Take . The two terms carrying are and , which cancel, leaving
away from . So is a strict Liapunov function and the receiver locks onto the transmitter from any initial state, reconstructing all three coordinates from one. A message buried under a much louder chaotic signal can then be recovered by subtraction. The cancellation of the terms in , which is the same small algebraic accident as in parts 3 and 6 above, is what makes this work.