Mathematical Methods Handbook

Chaos

Sensitive dependence, maps, strange attractors and fractals.

In this chapter 7

Tick a unit to add it to your PDF basket.

  1. Chaotic dynamics

Chaotic dynamics

7

Application

The Lorenz equations

Adapted

Collects what can be established about the Lorenz system by the standard tools — its symmetry, its constant rate of phase-volume contraction, a trapping ellipsoid, the three equilibria and their eigenvalues, global stability of the origin for r<1r < 1 by a Liapunov function, and the threshold r=σ(σ+b+3)/(σ−b−1)r = \sigma(\sigma+b+3)/(\sigma-b-1) at which the convective equilibria lose stability — and shows why, for σ=10\sigma = 10, b=8/3b = 8/3, r=28r = 28, these results together leave no possibility except a strange attractor.

Prerequisites: Lyapunov functions, Linearization and the Hartman-Grobman theorem, The Hopf bifurcation, Bifurcations in one dimension, The divergence theorem, Eigenvalues and eigenvectors

Definition(The Lorenz system, attractors and strange attractors)AdaptedAdapted from Strogatz (1994), §9.0, p. 301, §9.2, p. 311, and §9.3, pp. 324-325; Hirsch, Smale & Devaney (2013), §14.1, p. 306, and §14.3, p. 312

The Lorenz system is the three-dimensional autonomous system

x˙=σ(y−x),y˙=rx−y−xz,z˙=xy−bz,\dot x = \sigma(y - x), \qquad \dot y = r x - y - x z, \qquad \dot z = x y - b z,

with parameters σ,r,b>0\sigma, r, b > 0. Here σ\sigma is the Prandtl number and rr the Rayleigh number; bb has no name and is fixed by the geometry of the convection cell. Hirsch, Smale and Devaney assume throughout, in addition, that σ>b+1\sigma > b + 1, and so do we wherever the stability of the convective equilibria is in question. Write LL for the vector field, so that the system is X˙=L(X)\dot X = L(X).

Where it comes from. Lorenz obtained the system in 1963 by truncating a model of a fluid layer heated from below and cooled from above to three Fourier amplitudes: xx measures the strength of the convective overturning, yy the horizontal and zz the vertical temperature variation. The same three equations describe, exactly rather than approximately, the Malkus-Howard waterwheel — a wheel with leaky cups on its rim, fed with water from above — in which the mass distribution around the rim is expanded in a Fourier series and all but three amplitudes decouple. In that model rr is again a Rayleigh number, measuring the driving (gravity and inflow) against the dissipation (leakage and damping).

Attractors. Following Strogatz, a closed set AA in phase space is an attractor if

  1. AA is invariant: every trajectory starting in AA remains in AA for all time;
  2. AA attracts an open set: there is an open U⊇AU \supseteq A such that the distance from X(t)X(t) to AA tends to 00 as t→∞t \to \infty for every X(0)∈UX(0) \in U (the largest such UU is the basin of attraction); and
  3. AA is minimal: no proper subset of AA has both properties.

An attractor is strange if the motion on it shows sensitive dependence on initial conditions, as that is defined in Lyapunov exponents and sensitive dependence.

Application(Elementary properties of the Lorenz system)AdaptedAdapted from Strogatz (1994), §9.2, pp. 311-316; Hirsch, Smale & Devaney (2013), §14.2, pp. 308-311

Let σ,b,r>0\sigma, b, r > 0.

  1. Symmetry. The reflection S(x,y,z)=(−x,−y,z)S(x, y, z) = (-x, -y, z) maps solutions to solutions: if (x(t),y(t),z(t))(x(t), y(t), z(t)) solves the system, so does (−x(t),−y(t),z(t))(-x(t), -y(t), z(t)). The zz-axis is invariant, and on it z˙=−bz\dot z = -bz, so every solution starting on it tends to the origin.

  2. Volume contraction. ∇⋅L=−(σ+1+b)\nabla \cdot L = -(\sigma + 1 + b), a negative constant. Hence if DD is a region with smooth boundary and V(t)V(t) is the volume of its image under the flow,

    V˙=−(σ+1+b) V,soV(t)=V(0) e−(σ+1+b)t.\dot V = -(\sigma + 1 + b)\,V, \qquad\text{so}\qquad V(t) = V(0)\,e^{-(\sigma + 1 + b)t}.

    Every phase volume shrinks to zero exponentially, at a rate independent of position.

  3. A trapping region. Put W(x,y,z)=rx2+σy2+σ(z−2r)2W(x, y, z) = r x^2 + \sigma y^2 + \sigma (z - 2r)^2, whose level sets are ellipsoids centred at (0,0,2r)(0, 0, 2r). There is a ν∗>0\nu^* > 0 such that W˙<0\dot W < 0 on every level set W=νW = \nu with ν≥ν∗\nu \ge \nu^*. Consequently every solution enters the solid ellipsoid W≤ν∗W \le \nu^* in finite time and stays there.

  4. Equilibria. The origin is an equilibrium for all parameter values. For r>1r > 1 there are two more,

    C±=(±b(r−1), ±b(r−1), r−1),C^{\pm} = \bigl(\pm\sqrt{b(r-1)},\ \pm\sqrt{b(r-1)},\ r - 1\bigr),

    which are exchanged by the symmetry SS and which coalesce with the origin in a pitchfork bifurcation as r↓1r \downarrow 1.

  5. The origin. Its eigenvalues are −b-b and

    λ±=12[−(σ+1)±(σ+1)2−4σ(1−r)].\lambda_{\pm} = \tfrac12\Bigl[-(\sigma + 1) \pm \sqrt{(\sigma+1)^2 - 4\sigma(1 - r)}\Bigr].

    For 0≤r<10 \le r < 1 both λ±\lambda_{\pm} are negative, so the origin is a sink; for r>1r > 1 one is positive, so the origin is a saddle with a two-dimensional stable surface and a one-dimensional unstable curve.

  6. Global stability for r<1r < 1. If r<1r < 1, every solution tends to the origin. In particular there are no closed orbits and no chaos below r=1r = 1.

  7. The convective equilibria. Assume σ>b+1\sigma > b + 1. The eigenvalues at C±C^{\pm} are the roots of

    λ3+(1+b+σ)λ2+b(σ+r)λ+2bσ(r−1)=0,\lambda^3 + (1 + b + \sigma)\lambda^2 + b(\sigma + r)\lambda + 2b\sigma(r - 1) = 0,

    and C±C^{\pm} are sinks for

    1<r<rH=σ σ+b+3σ−b−1.1 < r < r_H = \sigma\,\frac{\sigma + b + 3}{\sigma - b - 1}.

    At r=rHr = r_H a Hopf bifurcation occurs. It is subcritical: the limit cycles involved are unstable and exist for r<rHr < r_H, so for rr slightly above rHr_H there is no attractor near C±C^{\pm}.

  8. What volume contraction excludes. The system has no quasiperiodic solutions, no repelling equilibria and no repelling closed orbits. Hence for r>rHr > r_H no equilibrium and no closed orbit can be an attractor near C±C^{\pm}, while by part 3 no trajectory can escape to infinity.

Idea of the proofOriginal

Parts 1, 2, 4 and 5 are direct computations. The two that carry the argument are the Liapunov function and the trapping ellipsoid, and both work the same way: choose a positive definite quadratic form, differentiate it along the flow, and watch the cubic terms cancel. They cancel because the only nonlinearities are −xz-xz in y˙\dot y and +xy+xy in z˙\dot z, and the single product xyzxyz they generate appears twice with opposite signs whenever yy and zz are weighted equally. What is left is a quadratic form, and the whole question becomes whether that form is definite — an exercise in completing the square. Part 7 then locates the stability boundary not by finding the roots of the cubic but by asking when a purely imaginary root is possible, which splits the cubic into two real equations for one unknown ω2\omega^2 and leaves one condition on rr.

ProofAdaptedAdapted from Hirsch, Smale & Devaney (2013), §14.2, pp. 308-311; Strogatz (1994), §9.2, pp. 312-316
  1. Symmetry. Substituting (−x,−y,z)(-x, -y, z) into the right-hand side gives (−σ(y−x),−(rx−y−xz),xy−bz)(-\sigma(y-x), -(rx - y - xz), xy - bz), which is (−x˙,−y˙,z˙)(-\dot x, -\dot y, \dot z); so the reflected curve satisfies the same system. On x=y=0x = y = 0 the first two equations give x˙=y˙=0\dot x = \dot y = 0, so the zz-axis is invariant, and there z˙=−bz\dot z = -bz has solution z(t)=z(0)e−bt→0z(t) = z(0)e^{-bt} \to 0.

  2. Volume contraction. Adding the three diagonal derivatives,

    ∇⋅L=∂∂xσ(y−x)+∂∂y(rx−y−xz)+∂∂z(xy−bz)=−σ−1−b.\nabla\cdot L = \frac{\partial}{\partial x}\sigma(y-x) + \frac{\partial}{\partial y}(rx - y - xz) + \frac{\partial}{\partial z}(xy - bz) = -\sigma - 1 - b .

    By Liouville's theorem, V˙=∫D(t)∇⋅L dV\dot V = \int_{D(t)} \nabla\cdot L\,dV, and since the integrand is the constant −(σ+1+b)-(\sigma+1+b) this is −(σ+1+b)V-(\sigma+1+b)V. Integrating the resulting linear equation gives the stated exponential. (Liouville's theorem is itself the divergence theorem applied to the volume swept out by the boundary: in time dtdt a patch dAdA of the boundary sweeps (L⋅n) dt dA(L\cdot n)\,dt\,dA, so V˙=∮L⋅n dA=∫∇⋅L dV\dot V = \oint L\cdot n\, dA = \int \nabla\cdot L\,dV; see the divergence theorem.)

  3. The trapping ellipsoid. Differentiate W=rx2+σy2+σ(z−2r)2W = rx^2 + \sigma y^2 + \sigma(z-2r)^2 along the flow:

    W˙=2rx σ(y−x)+2σy (rx−y−xz)+2σ(z−2r)(xy−bz).\dot W = 2rx\,\sigma(y - x) + 2\sigma y\,(rx - y - xz) + 2\sigma(z - 2r)(xy - bz).

    The xyxy terms contribute 2σrxy+2σrxy−4σrxy=02\sigma r xy + 2\sigma r xy - 4\sigma r xy = 0, and the cubic terms contribute −2σxyz+2σxyz=0-2\sigma xyz + 2\sigma xyz = 0. What remains is

    W˙=−2σ[rx2+y2+bz2−2rbz]=−2σ[rx2+y2+b(z−r)2−br2],\dot W = -2\sigma\bigl[rx^2 + y^2 + bz^2 - 2rbz\bigr] = -2\sigma\bigl[rx^2 + y^2 + b(z - r)^2 - br^2\bigr],

    by completing the square in zz. So W˙<0\dot W < 0 at every point outside the solid ellipsoid E={rx2+y2+b(z−r)2≤br2}E = \{rx^2 + y^2 + b(z-r)^2 \le br^2\}. The function WW is continuous and EE is compact, so WW attains a maximum on EE; let ν∗\nu^* exceed it. Then the level set W=νW = \nu with ν≥ν∗\nu \ge \nu^* lies entirely outside EE, so W˙<0\dot W < 0 there: no trajectory crosses it outwards, and the solid region W≤ν∗W \le \nu^* is positively invariant. Outside it, W˙\dot W is bounded above by a negative constant (again by compactness, applied to the region ν∗≤W≤ν0\nu^* \le W \le \nu_0 for any ν0\nu_0), so WW decreases to ν∗\nu^* in finite time.

  4. Equilibria. Setting x˙=0\dot x = 0 gives y=xy = x; then y˙=0\dot y = 0 gives x(r−1−z)=0x(r - 1 - z) = 0, and z˙=0\dot z = 0 gives x2=bzx^2 = bz. Either x=0x = 0, forcing z=0z = 0 and the origin; or z=r−1z = r - 1 and x2=b(r−1)x^2 = b(r-1), which has real solutions precisely for r>1r > 1 and gives C±C^{\pm}. The symmetry SS maps C+C^+ to C−C^-. As r↓1r \downarrow 1 both merge with the origin, and by part 5 the origin changes from sink to saddle there, which is a pitchfork bifurcation (see Bifurcations in one dimension for the name).

  5. The origin. The Jacobian of LL, whose eigenvalues decide stability by linearization, is

    DL(x,y,z)=(−σσ0r−z−1−xyx−b),DL(x,y,z) = \begin{pmatrix} -\sigma & \sigma & 0 \\ r - z & -1 & -x \\ y & x & -b \end{pmatrix},

    which at the origin is block diagonal: the zz row and column decouple, contributing the eigenvalue −b-b, and the upper block (−σσr−1)\bigl(\begin{smallmatrix} -\sigma & \sigma \\ r & -1\end{smallmatrix}\bigr) has trace −(σ+1)-(\sigma+1) and determinant σ(1−r)\sigma(1 - r), whence the stated λ±\lambda_{\pm}. For r<1r < 1 the determinant is positive and the trace negative, so both roots have negative real part; moreover the discriminant (σ+1)2−4σ(1−r)=(σ−1)2+4σr>0(\sigma+1)^2 - 4\sigma(1-r) = (\sigma-1)^2 + 4\sigma r > 0, so they are real and the origin is a stable node. For r>1r > 1 the determinant is negative, so the roots are real of opposite sign and the origin is a saddle; counting the decoupled −b-b, it has two stable directions and one unstable one.

  6. Global stability for r<1r < 1. Take the positive definite function

    Λ(x,y,z)=x2+σy2+σz2.\Lambda(x, y, z) = x^2 + \sigma y^2 + \sigma z^2 .

    Along a solution,

    Λ˙=2xσ(y−x)+2σy(rx−y−xz)+2σz(xy−bz)=−2σ[x2+y2−(1+r)xy]−2σbz2,\dot\Lambda = 2x\sigma(y-x) + 2\sigma y(rx - y - xz) + 2\sigma z(xy - bz) = -2\sigma\bigl[x^2 + y^2 - (1 + r)xy\bigr] - 2\sigma b z^2,

    the cubic terms cancelling as in part 3. Write Q(x,y)=x2−(1+r)xy+y2Q(x,y) = x^2 - (1+r)xy + y^2. Its discriminant as a quadratic form is (1+r)2−4(1+r)^2 - 4, which is negative exactly when 0<r<10 < r < 1; a binary quadratic form with positive leading coefficient and negative discriminant is positive definite, so Q(x,y)>0Q(x,y) > 0 for (x,y)≠(0,0)(x,y) \ne (0,0). Hence Λ˙<0\dot\Lambda < 0 except at the origin, where it vanishes: Λ\Lambda is a strict Liapunov function on all of R3\mathbb{R}^3, and by the Liapunov stability theorem the origin is asymptotically stable with basin all of R3\mathbb{R}^3. (Strogatz uses Λ/σ\Lambda/\sigma, which is the same function rescaled.)

  7. The convective equilibria. At C±C^{\pm} we have z=r−1z = r-1 and y=x=±b(r−1)=:ξy = x = \pm\sqrt{b(r-1)} =: \xi, so

    DL(C±)=(−σσ01−1−ξξξ−b).DL(C^{\pm}) = \begin{pmatrix} -\sigma & \sigma & 0 \\ 1 & -1 & -\xi \\ \xi & \xi & -b \end{pmatrix}.

    Expanding det⁡(λI−DL)\det(\lambda I - DL) and using ξ2=b(r−1)\xi^2 = b(r-1) gives the stated cubic, whose coefficients depend only on ξ2\xi^2 and so are the same at C+C^+ and C−C^-.

    At r=1r = 1 the cubic is λ3+(1+b+σ)λ2+b(σ+1)λ=λ(λ+b)(λ+σ+1)\lambda^3 + (1+b+\sigma)\lambda^2 + b(\sigma+1)\lambda = \lambda(\lambda + b)(\lambda + \sigma + 1), with roots 00, −b-b, −σ−1-\sigma-1, which are distinct because σ>b+1\sigma > b+1 gives −σ−1<−b<0-\sigma - 1 < -b < 0. For rr slightly above 11 the roots move continuously; the constant term 2bσ(r−1)2b\sigma(r-1) is now positive and the polynomial is positive for every λ≥0\lambda \ge 0, so no root is real and non-negative, and all three roots are real and negative.

    A root can acquire a non-negative real part only by crossing the imaginary axis, and since no root is ever 00 for r>1r > 1, the crossing must be at λ=±iω\lambda = \pm i\omega with ω≠0\omega \ne 0. Substituting λ=iω\lambda = i\omega and separating real and imaginary parts:

    (real)−(1+b+σ)ω2+2bσ(r−1)=0,(imaginary)−ω3+b(σ+r)ω=0.\text{(real)}\quad -(1+b+\sigma)\omega^2 + 2b\sigma(r-1) = 0, \qquad \text{(imaginary)}\quad -\omega^3 + b(\sigma + r)\omega = 0 .

    The second gives ω2=b(σ+r)\omega^2 = b(\sigma + r); substituting into the first and cancelling bb,

    (σ+r)(1+b+σ)=2σ(r−1)  ⟹  r(σ−b−1)=σ(σ+b+3)  ⟹  r=rH.(\sigma + r)(1 + b + \sigma) = 2\sigma(r - 1) \;\Longrightarrow\; r(\sigma - b - 1) = \sigma(\sigma + b + 3) \;\Longrightarrow\; r = r_H .

    Since σ>b+1\sigma > b+1, this rHr_H is positive and finite, and it is the smallest r>1r > 1 at which a root reaches the imaginary axis; below it all roots keep negative real parts, so C±C^{\pm} are sinks for 1<r<rH1 < r < r_H.

    That the bifurcation at rHr_H is a genuine Hopf bifurcation is stated without proof by Hirsch, Smale and Devaney; that it is subcritical — so that the bifurcating cycles are unstable and lie on the side r<rHr < r_H — is a separate calculation that Strogatz also does not reproduce, attributing it to Marsden and McCracken (1976). We follow both and do not prove it here.

  8. Consequences of contraction. A quasiperiodic solution would lie on an invariant torus, and the volume enclosed by that torus would be constant in time, contradicting part 2. A repelling equilibrium can be enclosed in a small sphere of initial conditions, and a repelling closed orbit in a thin tube around it; in either case the enclosed volume grows, again contradicting part 2. □\square

Remark(Where the hypotheses are used, and what is still open)Original
  • Positivity of σ\sigma, bb, rr is used throughout; it is σ>0\sigma > 0 that makes Λ\Lambda in part 6 positive definite, and b>0b > 0 that makes the zz-axis contracting in part 1.
  • r<1r < 1, strictly, is the whole of part 6: at r=1r = 1 the form QQ becomes (x−y)2(x - y)^2, which is only positive semi-definite, and Λ˙\dot\Lambda vanishes on the whole line x=yx = y, z=0z = 0. The conclusion survives at r=1r = 1 by a further argument, but not by this one.
  • σ>b+1\sigma > b + 1 is used only in part 7, twice: to separate the three roots at r=1r = 1, and to make rHr_H positive. If σ≤b+1\sigma \le b+1 the formula for rHr_H is negative or undefined, and C±C^{\pm} do not lose stability this way. The standard parameters σ=10\sigma = 10, b=8/3b = 8/3 satisfy it with room to spare.
  • Volume contraction does not by itself produce chaos. It gives a limiting set of zero volume, which could perfectly well be a point or a curve; indeed for r<1r < 1 it is a point. Part 8 is what removes the simple alternatives, and only in combination with part 7.
  • Two definitions of "attractor". We have followed Strogatz, whose third condition is minimality. Hirsch, Smale and Devaney instead require Λ\Lambda to be compact and invariant, to satisfy ⋂t≥0φt(U)=Λ\bigcap_{t\ge0}\varphi_t(U) = \Lambda for some open UU with φt(U)⊆U\varphi_t(U) \subseteq U, and to be transitive: any two points of Λ\Lambda have neighbourhoods joined by a single solution curve. The two conditions have the same purpose — to stop a union of several attractors from counting as one — and both reject the same standard example, the interval [−1,1][-1,1] for x˙=x−x3\dot x = x - x^3, y˙=−y\dot y = -y. They are not equivalent in general, and we do not use either beyond that purpose.
  • What is not proved here or anywhere in our sources. Nothing above shows that the set seen in simulations at σ=10\sigma=10, b=8/3b=8/3, r=28r=28 is an attractor in either sense. Strogatz, writing in 1994, records that no one had proved it. Hirsch, Smale and Devaney analyse instead a geometric model built to imitate the flow, prove that the model has a chaotic attractor, and report that the model was proved to describe the equations themselves only in 1999.
Method(The elementary analysis of a dissipative three-dimensional system)AdaptedAdapted from Strogatz (1994), §9.2, pp. 311-317; Hirsch, Smale & Devaney (2013), §14.2, pp. 308-311

The sequence of steps above is not special to Lorenz's equations; it is the standard opening for any polynomial system in R3\mathbb{R}^3.

  1. Look for symmetries. A linear involution SS with DS F=F∘SDS\,F = F\circ S halves the work: equilibria and orbits come in pairs, and any bifurcation creating a pair of equilibria from one is a pitchfork rather than a saddle-node.
  2. Compute ∇⋅F\nabla\cdot F. If it is a negative constant −k-k, all volumes decay like e−kte^{-kt}, and you may immediately rule out quasiperiodicity and all repelling invariant sets.
  3. Find a trapping region. Try a positive definite quadratic WW centred where the flow seems to live, differentiate along the flow, and choose the weights so that the cubic terms cancel. Complete the square in the remaining quadratic; the region where W˙≥0\dot W \ge 0 should come out bounded, and any sufficiently large sublevel set of WW then traps the flow.
  4. Find the equilibria and linearise. Where the Jacobian is block triangular, read the eigenvalues off the blocks.
  5. Try the same quadratic as a Liapunov function near the parameter value where the first equilibrium loses stability; this often gives global, not merely local, stability on one side of the threshold.
  6. Locate the stability boundary of the remaining equilibria by substituting λ=iω\lambda = i\omega into the characteristic polynomial rather than solving it. Real and imaginary parts give two equations in ω2\omega^2 and the parameter; eliminating ω2\omega^2 gives the threshold.
  7. Count what is left. If no equilibrium and no closed orbit can attract, and nothing escapes to infinity, the long-time behaviour has to be something else.
Example(The standard parameters σ=10\sigma = 10, b=8/3b = 8/3)Original

Take Lorenz's values σ=10\sigma = 10, b=8/3b = 8/3. Then σ−b−1=19/3>0\sigma - b - 1 = 19/3 > 0, so the standing assumption holds, and

rH=σ σ+b+3σ−b−1=10⋅47/319/3=47019=24.7368421…r_H = \sigma\,\frac{\sigma + b + 3}{\sigma - b - 1} = 10\cdot\frac{47/3}{19/3} = \frac{470}{19} = 24.7368421\ldots

Volume. The contraction rate is σ+1+b=41/3=13.66‾\sigma + 1 + b = 41/3 = 13.6\overline{6}, so phase volumes shrink by the factor e−41/3=1.1605×10−6e^{-41/3} = 1.1605\times10^{-6} per unit of time; the half-life of a volume is 3ln⁡2/41=0.0507183\ln 2/41 = 0.050718 time units. A blob of initial conditions of diameter 11 has shrunk in volume by six orders of magnitude after one time unit, which is roughly one and a half circuits of the attractor.

At r=28r = 28, above rHr_H. The equilibria are the origin and

C±=(±(8/3)⋅27, ±72, 27)=(±62, ±62, 27),62=8.4852814.C^{\pm} = \bigl(\pm\sqrt{(8/3)\cdot 27},\ \pm\sqrt{72},\ 27\bigr) = (\pm 6\sqrt2,\ \pm 6\sqrt2,\ 27), \qquad 6\sqrt2 = 8.4852814 .

At the origin the eigenvalues are −b=−2.66‾-b = -2.6\overline{6} and

λ±=12[−11±121+40⋅27]=12[−11±1201]=11.8277235, −22.8277235,\lambda_{\pm} = \tfrac12\bigl[-11 \pm \sqrt{121 + 40\cdot 27}\bigr] = \tfrac12\bigl[-11 \pm \sqrt{1201}\bigr] = 11.8277235,\ -22.8277235 ,

a saddle with one unstable direction, as part 5 predicts for r>1r > 1.

At C±C^{\pm} the cubic of part 7 is

λ3+413λ2+3043λ+1440=0.\lambda^3 + \tfrac{41}{3}\lambda^2 + \tfrac{304}{3}\lambda + 1440 = 0 .

Its roots, computed numerically, are

λ1=−13.8545779,λ2,3=0.0939556±10.1945052 i.\lambda_1 = -13.8545779, \qquad \lambda_{2,3} = 0.0939556 \pm 10.1945052\,i .

The complex pair has positive real part, confirming that r=28r = 28 lies above rH=24.7368r_H = 24.7368. So each of C±C^{\pm} is a saddle-focus with a one-dimensional stable manifold and a two-dimensional unstable one, and a trajectory near it spirals outwards within that unstable surface, taking 2π/10.1945052=0.61632\pi/10.1945052 = 0.6163 time units per turn. (As a check on the cubic: the sum of its roots is −13.8545779+2(0.0939556)=−13.66‾=−(1+b+σ)-13.8545779 + 2(0.0939556) = -13.6\overline{6} = -(1 + b + \sigma), and the product is −1440=−2bσ(r−1)-1440 = -2b\sigma(r-1).)

Putting the parts together. At these parameters: no trajectory escapes, by part 3; the origin is a saddle and C±C^{\pm} are saddle-foci, so no equilibrium attracts; there is no attracting closed orbit near C±C^{\pm}, because the Hopf bifurcation at rHr_H is subcritical; there are no quasiperiodic motions and no repellers, by part 8; and every volume shrinks to zero. The only possibility left is that almost every trajectory approaches a set of zero volume on which the motion is aperiodic — the strange attractor, whose sensitive dependence is quantified in Lyapunov exponents and sensitive dependence and whose fractional dimension is the subject of Fractals and dimension.

ApplicationAdaptedAdapted from Strogatz (1994), §9.1, pp. 302-311, §9.5, pp. 330-335, and §9.6, pp. 335-340

Convection and the waterwheel. The system's first use is as a caricature of Rayleigh-Benard convection: r<1r < 1 is pure conduction with the fluid at rest, 1<r<rH1 < r < r_H is steady convection in rolls of one handedness or the other (the two being exchanged by the symmetry SS, which is why the bifurcation at r=1r=1 is a pitchfork), and r>rHr > r_H is the irregular regime. Every statement above has a mechanical counterpart in the Malkus-Howard waterwheel, where xx is the angular velocity: at low inflow the wheel sits still, at moderate inflow it settles into steady rotation one way or the other, and above threshold it turns a few times, stalls, and reverses, erratically and forever. The same equations arise for a laser (the Maxwell-Bloch equations transform into them) and in models of geomagnetic dynamos, which is one reason the irregular reversals are suggestive.

Why the parameter rr repays study. Holding σ=10\sigma = 10, b=8/3b = 8/3 and varying rr shows that the chaotic regime is neither the only nor the final behaviour. Below rHr_H but above r≈24.06r \approx 24.06 a strange attractor coexists with the two stable equilibria, so the outcome depends on the initial condition and the system shows hysteresis as rr is swept. Below that, down to a homoclinic bifurcation near r=13.926r = 13.926, there is transient chaos: trajectories rattle around irregularly for a long and unpredictable time before settling on C+C^+ or C−C^-. This is worth separating from chaos proper, because it shows that a system with only simple attractors can still be effectively unpredictable — the reason a thrown die is a fair randomiser although it has six stable resting positions. For large rr the dynamics simplify again, to a globally attracting limit cycle for rr above a few hundred, corresponding to a waterwheel that rocks regularly back and forth.

Chaos as a carrier. A striking engineering use turns the sensitivity into an advantage. Cuomo and Oppenheim built two identical Lorenz circuits in the rescaled variables u=x/10u = x/10, v=y/10v = y/10, w=z/20w = z/20, for which the equations read u˙=σ(v−u)\dot u = \sigma(v-u), v˙=ru−v−20uw\dot v = ru - v - 20uw, w˙=5uv−bw\dot w = 5uv - bw. The transmitter runs freely; the receiver runs the same equations except that the transmitted scalar u(t)u(t) is substituted for its own first coordinate wherever that coordinate multiplies something in the last two equations. The error ee between the two states then obeys

e˙1=σ(e2−e1),e˙2=−e2−20 u(t) e3,e˙3=5 u(t) e2−b e3,\dot e_1 = \sigma(e_2 - e_1), \qquad \dot e_2 = -e_2 - 20\,u(t)\,e_3, \qquad \dot e_3 = 5\,u(t)\,e_2 - b\,e_3,

a linear system with a chaotic time-dependent coefficient. Take E(e)=12(σ−1e12+e22+4e32)E(e) = \tfrac12\bigl(\sigma^{-1}e_1^2 + e_2^2 + 4e_3^2\bigr). The two terms carrying u(t)u(t) are −20ue2e3-20u e_2e_3 and +20ue2e3+20u e_2 e_3, which cancel, leaving

E˙=−(e12−e1e2)−e22−4be32=−(e1−12e2)2−34e22−4be32<0\dot E = -\bigl(e_1^2 - e_1e_2\bigr) - e_2^2 - 4b e_3^2 = -\Bigl(e_1 - \tfrac12 e_2\Bigr)^2 - \tfrac34 e_2^2 - 4b e_3^2 < 0

away from e=0e = 0. So EE is a strict Liapunov function and the receiver locks onto the transmitter from any initial state, reconstructing all three coordinates from one. A message buried under a much louder chaotic signal can then be recovered by subtraction. The cancellation of the terms in uu, which is the same small algebraic accident as in parts 3 and 6 above, is what makes this work.

Definition

Lyapunov exponents and sensitive dependence

Adapted

Defines the exponential rates at which an infinitesimal ball of initial conditions is stretched and squeezed along a trajectory, for both flows and maps, proves that the exponents sum to the time-averaged divergence and that a bounded non-equilibrium trajectory of a flow always carries a zero exponent, and turns the largest exponent into the predictability horizon t≈λ−1ln⁡(a/∥δ0∥)t \approx \lambda^{-1}\ln(a/\|\delta_0\|) — checked against a direct simulation of the Lorenz system.

Prerequisites: The Lorenz equations, One-dimensional maps, Linearization and the Hartman-Grobman theorem, Singular value decomposition, Dependence on initial data and Gronwall's inequality

Definition(Separation, Lyapunov exponents, sensitive dependence)AdaptedAdapted from Strogatz (1994), §9.3, pp. 321-322, 324-325, and §10.5, pp. 366-367; Hirsch, Smale & Devaney (2013), §15.4, p. 340

For a flow. Let X˙=F(X)\dot X = F(X) with F∈C1F \in C^1 on Rn\mathbb{R}^n, let X(t)X(t) be a solution, and let δ(t)\delta(t) be the separation of an infinitesimally close solution. Solutions depend differentiably on their initial data (continuous dependence), and to first order δ\delta obeys the variational equation

δ˙=DF(X(t)) δ,\dot\delta = DF\bigl(X(t)\bigr)\,\delta ,

whose fundamental matrix Φ(t)\Phi(t) (the solution with Φ(0)=I\Phi(0) = I) carries an initial separation δ0\delta_0 to Φ(t)δ0\Phi(t)\delta_0. The image of the unit sphere under Φ(t)\Phi(t) is an ellipsoid; by the singular value decomposition its principal semi-axes are the singular values s1(t)≥s2(t)≥⋯≥sn(t)>0s_1(t) \ge s_2(t) \ge \dots \ge s_n(t) > 0 of Φ(t)\Phi(t). The Lyapunov exponents of the trajectory are

λk=lim⁡t→∞1tln⁡sk(t),k=1,…,n,\lambda_k = \lim_{t\to\infty} \frac1t \ln s_k(t), \qquad k = 1, \dots, n,

whenever the limits exist. They are listed in decreasing order, and λ1\lambda_1 is the largest Lyapunov exponent, usually written simply λ\lambda. Since ∥Φ(t)δ0∥≤s1(t)∥δ0∥\|\Phi(t)\delta_0\| \le s_1(t)\|\delta_0\| for every δ0\delta_0, with equality for the best-aligned one, λ1\lambda_1 is the fastest exponential rate at which any separation can grow; it is also the rate at which a separation chosen without regard to the geometry is observed to grow, and one writes ∥δ(t)∥∼∥δ0∥eλ1t\|\delta(t)\| \sim \|\delta_0\|e^{\lambda_1 t}.

For a map. For xn+1=f(xn)x_{n+1} = f(x_n) with f∈C1f \in C^1 on an interval, (fn)′(x0)=∏i<nf′(xi)(f^n)'(x_0) = \prod_{i<n} f'(x_i) by the chain rule (see One-dimensional maps), so there is a single exponent

λ(x0)=lim⁡n→∞1nln⁡∣(fn)′(x0)∣=lim⁡n→∞1n∑i=0n−1ln⁡∣f′(xi)∣,\lambda(x_0) = \lim_{n\to\infty} \frac1n \ln\bigl|(f^n)'(x_0)\bigr| = \lim_{n\to\infty}\frac1n\sum_{i=0}^{n-1}\ln\bigl|f'(x_i)\bigr| ,

when the limit exists.

Sensitive dependence and chaos. A system shows sensitive dependence on initial conditions in the metric sense used here if λ1>0\lambda_1 > 0: nearby trajectories separate exponentially fast on average. Following Strogatz, chaos is aperiodic long-term behaviour in a deterministic system that shows sensitive dependence, where "aperiodic" means that trajectories which approach no fixed point, periodic orbit or quasiperiodic orbit occur for a non-negligible set of initial conditions, and "deterministic" means that the irregularity comes from the nonlinearity and not from noise in the equations. A strange attractor is an attractor on which the motion is chaotic in this sense.

Definition(What the exponents must satisfy)Original

Let F∈C1F \in C^1 and let X(t)X(t) be a solution of X˙=F(X)\dot X = F(X) for which all nn limits above exist.

  1. The exponents sum to the averaged divergence.

    ∑k=1nλk=lim⁡t→∞1t∫0t∇⋅F(X(s)) ds,\sum_{k=1}^n \lambda_k = \lim_{t\to\infty}\frac1t\int_0^t \nabla\cdot F\bigl(X(s)\bigr)\,ds ,

    whenever the right-hand limit exists. In particular, if ∇⋅F\nabla\cdot F is the constant −k-k, as for the Lorenz equations, then ∑kλk=−k\sum_k \lambda_k = -k exactly.

  2. The flow direction is neutral. If the forward orbit {X(t):t≥0}\{X(t) : t \ge 0\} is bounded and inf⁡t≥0∣F(X(t))∣>0\inf_{t\ge0}|F(X(t))| > 0, then the direction along the flow neither grows nor decays exponentially:

    lim⁡t→∞1tln⁡∣Φ(t)F(X(0))∣=0.\lim_{t\to\infty}\frac1t\ln\bigl|\Phi(t)F(X(0))\bigr| = 0 .

    In particular λn≤0≤λ1\lambda_n \le 0 \le \lambda_1.

  3. A stable cycle of a map has a negative exponent. If x0x_0 lies on a pp-cycle of a map ff with multiplier μ\mu, then λ(x0)=p−1ln⁡∣μ∣\lambda(x_0) = p^{-1}\ln|\mu|. So λ<0\lambda < 0 for a stable cycle, λ>0\lambda > 0 for an unstable one, and λ=−∞\lambda = -\infty for a superstable one.

  4. Predictability horizon. Suppose the largest exponent is λ>0\lambda > 0 and the initial state is known only to within ∥δ0∥\|\delta_0\|. If predictions are useful while the error stays below a tolerance aa, they cease to be useful after a time of order

    thorizon≈1λ ln⁡a∥δ0∥.t_{\text{horizon}} \approx \frac1\lambda\,\ln\frac{a}{\|\delta_0\|} .

    The dependence on ∥δ0∥\|\delta_0\| is logarithmic: reducing the initial uncertainty by a factor 10610^6 buys only 6ln⁡10/λ≈13.8/λ6\ln 10/\lambda \approx 13.8/\lambda extra time.

Idea of the proofOriginal

All four parts come from one observation: ln⁡\ln turns the multiplicative growth of lengths, areas and volumes into something additive, which can then be averaged. The product of all the semi-axes is ∣det⁡Φ∣|\det\Phi|, and Liouville's formula says that det⁡Φ\det\Phi grows at the instantaneous rate tr⁡DF=∇⋅F\operatorname{tr}DF = \nabla\cdot F; taking logarithms and dividing by tt gives part 1. Part 2 holds because the velocity vector itself solves the variational equation, so the flow direction neither grows nor decays beyond bounded factors. Part 3 is the chain-rule product again: along a cycle the same pp factors repeat forever, so the average of the logarithms is the logarithm of the multiplier divided by pp. Part 4 is just solving ∥δ0∥eλt=a\|\delta_0\|e^{\lambda t} = a.

ProofOriginal
  1. Sum of the exponents. The determinant of Φ\Phi obeys Liouville's formula: differentiating det⁡Φ\det\Phi and using Φ˙=DF(X(t))Φ\dot\Phi = DF(X(t))\Phi gives

    ddtdet⁡Φ(t)=tr⁡[DF(X(t))] det⁡Φ(t)=∇⋅F(X(t)) det⁡Φ(t),\frac{d}{dt}\det\Phi(t) = \operatorname{tr}\bigl[DF(X(t))\bigr]\,\det\Phi(t) = \nabla\cdot F\bigl(X(t)\bigr)\,\det\Phi(t),

    so, since det⁡Φ(0)=1\det\Phi(0) = 1,

    det⁡Φ(t)=exp⁡∫0t∇⋅F(X(s)) ds.\det\Phi(t) = \exp\int_0^t \nabla\cdot F\bigl(X(s)\bigr)\,ds .

    On the other hand ∣det⁡Φ(t)∣=∏k=1nsk(t)|\det\Phi(t)| = \prod_{k=1}^n s_k(t), because the singular values are the semi-axes of the image of the unit ball and the determinant is the volume ratio. Taking logarithms,

    ∑k=1nln⁡sk(t)=∫0t∇⋅F(X(s)) ds.\sum_{k=1}^n \ln s_k(t) = \int_0^t \nabla\cdot F\bigl(X(s)\bigr)\,ds .

    Divide by tt and let t→∞t \to \infty. The left side tends to ∑kλk\sum_k \lambda_k by hypothesis, so the right side converges too and the two limits agree. If ∇⋅F≡−k\nabla\cdot F \equiv -k the integral is −kt-kt and the average is −k-k for every tt.

  2. The zero exponent. Differentiating X˙=F(X)\dot X = F(X) with respect to tt gives ddtF(X(t))=DF(X(t)) F(X(t))\frac{d}{dt}F(X(t)) = DF(X(t))\,F(X(t)), so v(t)=F(X(t))v(t) = F(X(t)) solves the variational equation; hence v(t)=Φ(t)v(0)v(t) = \Phi(t)v(0). By hypothesis there are constants 0<m≤M<∞0 < m \le M < \infty with m≤∣v(t)∣≤Mm \le |v(t)| \le M for all t≥0t \ge 0: the lower bound is the hypothesis inf⁡∣F(X(t))∣>0\inf|F(X(t))| > 0, and the upper bound holds because FF is continuous and the orbit is bounded, so it lies in a compact set on which ∣F∣|F| is bounded. Therefore

    ln⁡m−ln⁡∣v(0)∣t  ≤  1tln⁡∣Φ(t)v(0)∣∣v(0)∣  ≤  ln⁡M−ln⁡∣v(0)∣t,\frac{\ln m - \ln|v(0)|}{t} \;\le\; \frac1t\ln\frac{|\Phi(t)v(0)|}{|v(0)|} \;\le\; \frac{\ln M - \ln|v(0)|}{t} ,

    and both bounds tend to 00. So the growth rate of the particular direction v(0)v(0) is 00. Since sn(t)∣v(0)∣≤∣Φ(t)v(0)∣≤s1(t)∣v(0)∣s_n(t)|v(0)| \le |\Phi(t)v(0)| \le s_1(t)|v(0)| for every tt, taking logarithms, dividing by tt and letting t→∞t \to \infty gives λn≤0≤λ1\lambda_n \le 0 \le \lambda_1.

  3. Cycles of a map. Let x0,…,xp−1x_0, \dots, x_{p-1} be the cycle. The sequence ln⁡∣f′(xi)∣\ln|f'(x_i)| is periodic with period pp, so for n=mpn = mp,

    1n∑i=0n−1ln⁡∣f′(xi)∣=mmp∑i=0p−1ln⁡∣f′(xi)∣=1pln⁡∣∏i=0p−1f′(xi)∣=1pln⁡∣μ∣,\frac1n\sum_{i=0}^{n-1}\ln|f'(x_i)| = \frac{m}{mp}\sum_{i=0}^{p-1}\ln|f'(x_i)| = \frac1p\ln\Bigl|\prod_{i=0}^{p-1}f'(x_i)\Bigr| = \frac1p\ln|\mu| ,

    using the chain-rule product formula for the multiplier μ\mu. For general nn the partial sum differs from this by at most pp bounded terms, which vanish after division by nn. Stability means ∣μ∣<1|\mu| < 1, hence ln⁡∣μ∣<0\ln|\mu| < 0; instability means ∣μ∣>1|\mu| > 1, hence ln⁡∣μ∣>0\ln|\mu| > 0; superstability means μ=0\mu = 0, and then some factor f′(xi)f'(x_i) is zero, so every partial sum past that index is −∞-\infty.

  4. Horizon. With ∥δ(t)∥≈∥δ0∥eλt\|\delta(t)\| \approx \|\delta_0\|e^{\lambda t}, the error first reaches aa when λt=ln⁡(a/∥δ0∥)\lambda t = \ln(a/\|\delta_0\|). Replacing ∥δ0∥\|\delta_0\| by ∥δ0∥/106\|\delta_0\|/10^6 increases the right-hand side by ln⁡106=6ln⁡10=13.8155\ln 10^6 = 6\ln 10 = 13.8155, hence tt by 13.8155/λ13.8155/\lambda. □\square

Remark(Where the hypotheses are used, and what the definition does not say)Original
  • Existence of the limits is assumed throughout and is not automatic. It is a theorem of ergodic theory that the limits exist for almost every initial condition with respect to an invariant measure, but nothing in our sources proves it, and we do not use it. In part 1 the hypothesis is used twice: the left-hand limit must exist for the identity to say anything, and it then forces the right-hand one.
  • Boundedness and inf⁡∣F∣>0\inf|F| > 0 in part 2. Both are needed. The first fails for x˙=x\dot x = x, whose single exponent is +1+1 and which has no neutral direction; the second fails at an equilibrium, where the orbit is a point and the exponents are the real parts of the eigenvalues, none of which need vanish.
  • From a neutral direction to a zero exponent. Part 2 says the flow direction grows at rate 00; it does not by itself say that 00 appears in the list λ1,…,λn\lambda_1, \dots, \lambda_n. That step needs the theorem of ergodic theory, mentioned above and not assumed here, which says that the growth rate of almost every direction is one of the λk\lambda_k and that the directions with each rate form a subspace. Granting it, the flow direction contributes a zero exponent. We therefore use part 2 as a numerical check — a computed spectrum for a flow on a bounded aperiodic orbit that does not contain a zero is wrong — rather than as a statement about the spectrum.
  • A positive exponent is not by itself chaos. The system x˙=x\dot x = x has λ=1>0\lambda = 1 > 0 but its trajectories run off to infinity and never return, so its long-term behaviour is not aperiodic in the required sense. The definition of chaos needs the aperiodicity clause as well, and that clause is what confines the motion to an attractor.
  • Two kinds of sensitive dependence. The definition above is metric: it asserts an exponential rate. Hirsch, Smale and Devaney instead call a map on an interval sensitive if there is one constant β\beta such that every point has points arbitrarily nearby whose orbits eventually get β\beta apart; no rate is mentioned, and their definition of a chaotic map adds density of periodic points and transitivity rather than a positive exponent. They note explicitly that definitions of chaos differ on this point. The two notions agree on the standard examples but are not the same condition, and we use the metric one because it is the one that produces a number.
  • The exponent is an average, so local behaviour deviates. The graph of ln⁡∥δ(t)∥\ln\|\delta(t)\| against tt is not a straight line; it wobbles because the stretching varies over the attractor, and it flattens once ∥δ∥\|\delta\| reaches the diameter of the attractor, beyond which the linearised description is void. The horizon formula is therefore an order-of-magnitude statement and is only meaningful for aa well below that diameter.
  • λ\lambda depends on the trajectory, so a numerical value must be averaged over a long orbit or over many starting points. For a map, Strogatz records that one and the same value comes out of every seed whose orbit is captured by a given attractor.
Method(Computing the exponents)AdaptedAdapted from Strogatz (1994), §10.5, Example 10.5.3, p. 368

For a one-dimensional map. Fix the parameter. Iterate from an arbitrary seed for a few hundred steps to shed the transient. Then iterate NN further times, accumulating ∑ln⁡∣f′(xi)∣\sum \ln|f'(x_i)| as you go — only the current xx need be stored — and divide by NN. Repeat for the next parameter value. Plotting the result against the parameter gives a curve that is negative below the onset of chaos, touches zero at each period-doubling, and is positive in the chaotic range except for downward spikes at the periodic windows.

For a flow, all nn exponents. Integrate the state XX and an n×nn\times n matrix QQ together, QQ obeying Q˙=DF(X)Q\dot Q = DF(X)Q and starting at Q=IQ = I. Every τ\tau units of time, factor Q=Q~RQ = \tilde Q R by the Gram-Schmidt (QR) process with the signs fixed so that RR has positive diagonal; add ln⁡Rkk\ln R_{kk} to a running total SkS_k; replace QQ by Q~\tilde Q and continue. After total time TT, the estimate is λk≈Sk/T\lambda_k \approx S_k/T. The periodic re-orthonormalisation is what stops every column from collapsing onto the fastest-growing direction and overflowing, and the diagonal of RR records exactly the growth of the kk-dimensional volume spanned by the first kk columns relative to the (k−1)(k-1)-dimensional one.

Two checks to run every time. The sum of the computed exponents must equal the time-averaged divergence (part 1); and for a flow on a bounded aperiodic orbit, one exponent must come out at zero, since the flow direction is neutral (part 2). If either fails, τ\tau is too long, the integrator tolerance too loose, or the transient too short.

Example(Three systems, computed)Original

The tent map. For f(x)=rmin⁡(x, 1−x)f(x) = r\min(x,\,1-x) — that is, f(x)=rxf(x) = rx on [0,12][0,\tfrac12] and f(x)=r(1−x)f(x) = r(1-x) on [12,1][\tfrac12, 1], with 0<r≤20 < r \le 2 — we have ∣f′∣=r|f'| = r at every point where the derivative exists. So every term of the sum is ln⁡r\ln r and λ=ln⁡r\lambda = \ln r for every seed whose orbit avoids the kink, with no computation at all. The map is chaotic for r>1r > 1 and not for r<1r < 1, and the threshold λ=0\lambda = 0 sits exactly at r=1r = 1.

The logistic map, where the answer is known in closed form. At r=3.2r = 3.2 the attractor is the 22-cycle computed in One-dimensional maps, with multiplier μ=4+2r−r2=0.16\mu = 4 + 2r - r^2 = 0.16. By part 3,

λ=12ln⁡0.16=−0.9162907319.\lambda = \tfrac12\ln 0.16 = -0.9162907319 .

Running the method above from the seed x0=0.1x_0 = 0.1 with N=2×105N = 2\times10^5 iterations after a transient of 10310^3 returns −0.9162907319-0.9162907319, agreeing to all ten figures shown (the two values differ by 3×10−123\times10^{-12}), and the seed x0=0.37x_0 = 0.37 returns the same. This is the easy case: once the orbit is on the cycle the average is exact.

The logistic map in the chaotic range. At r=3.9r = 3.9 there is no closed form. Averaging ln⁡∣3.9−7.8xn∣\ln|3.9 - 7.8x_n| over 2×1062\times10^6 iterations, for 4040 random seeds after a transient of 20002000, gives

λ=0.4960±0.0003,\lambda = 0.4960 \pm 0.0003 ,

the quoted uncertainty being the spread over seeds (the extreme values were 0.495340.49534 and 0.496490.49649). The exponent is positive, so the aperiodic orbits seen at this parameter really do separate exponentially. (At r=4r = 4 the same average returns 0.6931470.693147, which is ln⁡2\ln 2 to six figures; the reason is that 4x(1−x)4x(1-x) is semi-conjugate to the tent map with r=2r = 2 through h(x)=12(1−cos⁡2πx)h(x) = \tfrac12(1 - \cos 2\pi x), and the tent map has λ=ln⁡2\lambda = \ln 2. Direct iteration exactly at r=4r = 4 is numerically delicate, because rounding can drop an orbit onto a spurious cycle; one of four seeds we tried did so and returned a visibly wrong 1.1081.108.)

The Lorenz attractor. Take σ=10\sigma = 10, b=8/3b = 8/3, r=28r = 28. Integrating the state together with a 3×33\times3 matrix by fourth-order Runge-Kutta with step 0.0050.005, discarding 100100 time units of transient, re-orthonormalising every τ=0.5\tau = 0.5 and averaging over T=4000T = 4000 time units gives

λ1=0.9067,λ2=−0.00034,λ3=−14.5730.\lambda_1 = 0.9067, \qquad \lambda_2 = -0.00034, \qquad \lambda_3 = -14.5730 .

Both checks pass. The middle exponent is zero to within 3×10−43\times10^{-4}, the neutral direction of part 2. And the sum is −13.666660-13.666660, against the exact value −(σ+1+b)=−41/3=−13.666667-(\sigma + 1 + b) = -41/3 = -13.666667 from part 1, an agreement to six decimal places. The drift of λ1\lambda_1 over the second half of the run was about ±0.002\pm 0.002, so the honest statement is λ1=0.906±0.002\lambda_1 = 0.906 \pm 0.002; Strogatz quotes 0.90.9.

The horizon, measured. With λ1=0.906\lambda_1 = 0.906, part 4 predicts that an initial uncertainty of 10−610^{-6} grows to 11 — about one fiftieth of the diameter of the attractor, which our simulation measured as roughly 5858 — after

thorizon≈ln⁡1060.906=13.81550.906=15.25 time units.t_{\text{horizon}} \approx \frac{\ln 10^{6}}{0.906} = \frac{13.8155}{0.906} = 15.25 \text{ time units} .

To test this we took 200200 points spaced along one long trajectory on the attractor, displaced each by 10−610^{-6} in a random direction, integrated both copies, and recorded when their separation first reached 11. The mean was

t=14.24±0.14,t = 14.24 \pm 0.14 ,

within about 7%7\% of the prediction. The formula is an estimate, not an identity: the spread of individual times was large, because the stretching rate varies around the attractor, and 15.2515.25 is what one gets by pretending it does not.

ApplicationOriginal

The exponent converts a qualitative worry into a budget. In numerical weather prediction the largest exponent of the atmosphere corresponds to an error-doubling time of a day or two, so the horizon formula says that a hundredfold improvement in the initial analysis — an enormous investment in observations — buys roughly ln⁡100≈4.6\ln 100 \approx 4.6 doubling times, about a week. This is the quantitative content of Lorenz's original remark about weather, and it is why operational forecasting moved from single runs to ensembles: once the horizon is reached the useful output is a distribution, not a trajectory.

The same arithmetic governs long integrations in celestial mechanics and molecular dynamics. Positive exponents in the solar system (with Lyapunov times of a few million years for the inner planets) mean that individual orbits computed over longer spans are not predictions of where a planet will be, although statistical properties of the ensemble remain meaningful; in molecular dynamics the exponents are so large that no trajectory is reproducible beyond picoseconds, which is why only time averages are reported.

In the laboratory the exponent is used as a diagnostic. Estimating λ1\lambda_1 from a measured time series distinguishes deterministic chaos from noise, since a noisy periodic signal has λ1≤0\lambda_1 \le 0 while a chaotic one does not, and the spectrum of exponents bounds how many degrees of freedom are active: the number of non-negative exponents is a lower bound on the dimension of the attractor, which in turn constrains how low-dimensional a model is allowed to be. The fractional dimension that goes with this picture is the subject of Fractals and dimension.

Method

One-dimensional maps

Adapted

Gives the working apparatus for a discrete-time system xn+1=f(xn)x_{n+1} = f(x_n) on an interval — orbits, fixed points, pp-cycles, the multiplier and its chain-rule product formula, and the cobweb construction — proves the sink/source criterion from the mean value theorem, and applies the recipe to the logistic map, where the fixed point loses stability at r=3r = 3 and a 22-cycle with multiplier 4+2r−r24 + 2r - r^2 takes over.

Prerequisites: Flows on the line, Bifurcations in one dimension, Limits of sequences and completeness

Definition(Maps, orbits, cycles and the multiplier)AdaptedAdapted from Hirsch, Smale & Devaney (2013), §15.1, pp. 329-331, 333; Strogatz (1994), §10.1, pp. 349-350, 367

Let I⊆RI \subseteq \mathbb{R} be an interval and let f:I→If : I \to I be continuously differentiable. The map is the rule

xn+1=f(xn),n=0,1,2,…,x_{n+1} = f(x_n), \qquad n = 0, 1, 2, \dots,

which replaces the continuous time of a differential equation by integer time. Much of the vocabulary carries over from flows on the line, but the behaviour does not: a map on an interval can oscillate and can be chaotic, which a one-dimensional flow cannot. Because ff sends II into itself, the recursion never leaves II; this invariance is part of the data, not an afterthought.

  • Write fnf^n for the nn-fold composite f∘⋯∘ff \circ \dots \circ f (never for a power). The orbit of a starting value x0∈Ix_0 \in I, also called its seed, is the sequence x0,f(x0),f2(x0),…x_0, f(x_0), f^2(x_0), \dots.
  • x∗x^* is a fixed point if f(x∗)=x∗f(x^*) = x^*; its orbit is the constant sequence.
  • x0x_0 is periodic of period pp (p∈Np \in \mathbb{N}) if fp(x0)=x0f^p(x_0) = x_0. The least such pp is the minimal period, and the set {x0,f(x0),…,fp−1(x0)}\{x_0, f(x_0), \dots, f^{p-1}(x_0)\} of a point of minimal period pp is a pp-cycle. A fixed point is a 11-cycle.
  • The multiplier of a pp-cycle through x0x_0 is λ=(fp)′(x0)\lambda = (f^p)'(x_0). For a fixed point this is λ=f′(x∗)\lambda = f'(x^*).
  • A fixed point x∗x^* is attracting (a sink) if it has a neighbourhood UU such that every orbit started in UU stays in UU and converges to x∗x^*; it is repelling (a source) if, for some such UU, every orbit started in UU other than x∗x^* itself eventually leaves UU; and neutral if it is neither. A pp-cycle is called a sink, a source or neutral according to which of these its points are as fixed points of fpf^p, a classification that makes sense because, as the next statement shows, all pp points have the same multiplier.
  • A cycle with λ=0\lambda = 0 is called superstable.

The cobweb of a seed x0x_0 is the following drawing in the (x,y)(x, y) plane. Draw y=f(x)y = f(x) and the diagonal y=xy = x. From the point (x0,x0)(x_0, x_0) move vertically to (x0,x1)(x_0, x_1) on the graph, then horizontally to (x1,x1)(x_1, x_1) on the diagonal; repeat. The abscissae of the points reached on the diagonal are exactly x0,x1,x2,…x_0, x_1, x_2, \dots, so the staircase or spiral traced out is a picture of the orbit.

Method(Stability of a cycle from its multiplier)AdaptedAdapted from Hirsch, Smale & Devaney (2013), §15.1, Proposition, p. 332; Strogatz (1994), §10.1, p. 350; Strogatz (1994), §10.5, Example 10.5.1, p. 367

Let f∈C1(I)f \in C^1(I) and let x0,x1=f(x0),…,xp−1x_0, x_1 = f(x_0), \dots, x_{p-1} be a pp-cycle of ff in the interior of II. Then:

  1. (Chain-rule product.) The multiplier is the product of the derivatives of ff around the cycle,

    λ=(fp)′(x0)=∏k=0p−1f′(xk),\lambda = (f^p)'(x_0) = \prod_{k=0}^{p-1} f'(x_k),

    and this value is unchanged if x0x_0 is replaced by any other point xjx_j of the cycle. So "the multiplier of the cycle" is well defined.

  2. (Sink.) If ∣λ∣<1|\lambda| < 1, the cycle is attracting. More precisely, for every KK with ∣λ∣<K<1|\lambda| < K < 1 there is a δ>0\delta > 0 such that ∣x−x0∣≤δ|x - x_0| \le \delta implies ∣fnp(x)−x0∣≤Kn∣x−x0∣|f^{np}(x) - x_0| \le K^n |x - x_0| for all n≥0n \ge 0.

  3. (Source.) If ∣λ∣>1|\lambda| > 1, the cycle is repelling.

  4. (No conclusion at ∣λ∣=1|\lambda| = 1.) If ∣λ∣=1|\lambda| = 1, the cycle may be attracting, repelling, or neither, and the derivative alone does not decide which.

If λ>0\lambda > 0 a nearby orbit approaches or leaves the fixed point from one side; if λ<0\lambda < 0 it alternates from side to side, which is what makes a cobweb spiral rather than climb.

Idea of the proofOriginal

A pp-cycle of ff is a fixed point of fpf^p, so the whole question reduces to fixed points, and for a fixed point the mean value theorem does everything: if ∣f′∣≤K<1|f'| \le K < 1 on a small interval around x∗x^*, then ff moves every point of that interval at least a factor KK closer to x∗x^*, so the interval is mapped into itself and the distance to x∗x^* falls geometrically. The product formula is the chain rule applied to a composite whose intermediate points are the points of the cycle; it is independent of the starting point because a cyclic shift does not change a product.

ProofAdaptedAdapted from Hirsch, Smale & Devaney (2013), §15.1, proof of the Proposition, pp. 332-333
  1. The product formula. Differentiating fp=f∘fp−1f^p = f \circ f^{p-1} repeatedly by the chain rule and evaluating at x0x_0 gives

    (fp)′(x0)=f′(fp−1(x0)) f′(fp−2(x0))⋯f′(x0)=∏k=0p−1f′(xk),(f^p)'(x_0) = f'\bigl(f^{p-1}(x_0)\bigr)\,f'\bigl(f^{p-2}(x_0)\bigr)\cdots f'(x_0) = \prod_{k=0}^{p-1} f'(x_k),

    because fk(x0)=xkf^k(x_0) = x_k. Starting the cycle at xjx_j instead permutes the factors cyclically, and a product of real numbers does not notice the order, so the value is the same.

  2. ∣λ∣<1|\lambda| < 1 gives a sink. Put g=fpg = f^p, so g(x0)=x0g(x_0) = x_0 and g′(x0)=λg'(x_0) = \lambda. Fix KK with ∣λ∣<K<1|\lambda| < K < 1. Since gg is C1C^1 (a composite of C1C^1 maps) its derivative is continuous, so there is a δ>0\delta > 0 with J=[x0−δ,x0+δ]⊂IJ = [x_0 - \delta, x_0 + \delta] \subset I and ∣g′∣≤K|g'| \le K on JJ.

    Let x∈Jx \in J. By the mean value theorem applied to gg on the interval between xx and x0x_0 there is a point cc strictly between them with

    g(x)−x0=g(x)−g(x0)=g′(c) (x−x0),g(x) - x_0 = g(x) - g(x_0) = g'(c)\,(x - x_0),

    and c∈Jc \in J, so ∣g(x)−x0∣≤K∣x−x0∣≤Kδ<δ|g(x) - x_0| \le K|x - x_0| \le K\delta < \delta. Hence g(J)⊆Jg(J) \subseteq J and the estimate may be applied again. Induction gives ∣gn(x)−x0∣≤Kn∣x−x0∣|g^n(x) - x_0| \le K^n|x - x_0|, and Kn→0K^n \to 0 because 0<K<10 < K < 1. So gn(x)→x0g^n(x) \to x_0, which says that the subsequence x,fp(x),f2p(x),…x, f^p(x), f^{2p}(x), \dots converges to x0x_0.

    The intermediate iterates are handled by continuity: fnp+j(x)=fj(gn(x))→fj(x0)=xjf^{np+j}(x) = f^j(g^n(x)) \to f^j(x_0) = x_j for each fixed j∈{0,…,p−1}j \in \{0, \dots, p-1\}, since fjf^j is continuous. So the whole orbit of xx converges to the cycle.

  3. ∣λ∣>1|\lambda| > 1 gives a source. Now choose KK with 1<K<∣λ∣1 < K < |\lambda| and, by continuity of g′g' again, a δ>0\delta > 0 with ∣g′∣≥K|g'| \ge K on J=[x0−δ,x0+δ]J = [x_0 - \delta, x_0 + \delta]. The same mean value theorem step, with the inequality reversed, gives ∣g(x)−x0∣≥K∣x−x0∣|g(x) - x_0| \ge K|x - x_0| for x∈Jx \in J. As long as the iterates stay in JJ we get ∣gn(x)−x0∣≥Kn∣x−x0∣|g^n(x) - x_0| \ge K^n|x - x_0|, and the right-hand side exceeds δ\delta once Kn>δ/∣x−x0∣K^n > \delta/|x - x_0|, which happens for some finite nn because K>1K > 1 and x≠x0x \ne x_0. So every orbit except the cycle leaves JJ.

  4. ∣λ∣=1|\lambda| = 1 decides nothing. It is enough to exhibit three maps with a fixed point at 00 of multiplier 11 and three different behaviours; this is the list in Hirsch, Smale and Devaney.

    • f(x)=x−x3f(x) = x - x^3. For 0<x<10 < x < 1 we have 0<f(x)<x0 < f(x) < x, so the orbit decreases and is bounded below by 00; its limit LL satisfies L=L−L3L = L - L^3, hence L=0L = 0. By oddness the same holds for −1<x<0-1 < x < 0. So 00 is a sink.
    • f(x)=x+x3f(x) = x + x^3. For x>0x > 0 the orbit increases, and it cannot converge to a finite limit LL, since L=L+L3L = L + L^3 forces L=0L = 0, which is below the starting point. So orbits leave every neighbourhood: 00 is a source.
    • f(x)=x+x2f(x) = x + x^2. For x>0x > 0 the orbit increases and, by the same argument, escapes; for −1<x<0-1 < x < 0 we have x<f(x)<0x < f(x) < 0, so the orbit increases towards a limit L≤0L \le 0 with L=L+L2L = L + L^2, hence L=0L = 0. The fixed point attracts from the left and repels from the right, so it is neither a sink nor a source. □\square
Remark(Where the hypotheses are used)Original
  • Continuous differentiability is used only through the continuity of g′=(fp)′g' = (f^p)', which is what lets a bound on ∣g′∣|g'| at the single point x0x_0 be spread over a whole interval JJ. For a merely differentiable ff the argument has to be replaced by a direct estimate from the definition of the derivative; the conclusions still hold, but the proof above does not apply verbatim.
  • The cycle lies in the interior of II so that a two-sided interval JJ around x0x_0 is available. At an endpoint of II one gets only the one-sided statement.
  • Strict inequality ∣λ∣≠1|\lambda| \ne 1 is what part 4 shows cannot be dropped: all three maps there have f′(0)=1f'(0) = 1, and all three behave differently. The reason is that at ∣λ∣=1|\lambda| = 1 the linear part neither contracts nor expands, so the sign and size of the first non-vanishing nonlinear term decide the outcome. This is exactly why bifurcations of maps occur at λ=+1\lambda = +1 and λ=−1\lambda = -1 and nowhere else.
  • ff maps II into II. Without this the iteration can simply leave the region where ff is defined, and "the orbit" stops existing. For the logistic map this is why rr is restricted to 0≤r≤40 \le r \le 4 below.
Method(Analysing a one-dimensional map)AdaptedAdapted from Strogatz (1994), §10.1, pp. 349-352, and §10.3, pp. 357-361; Hirsch, Smale & Devaney (2013), §15.1, pp. 331-333

Given xn+1=f(xn)x_{n+1} = f(x_n) with a parameter:

  1. Fix an invariant interval. Find an interval II with f(I)⊆If(I) \subseteq I, and restrict the parameter so that this holds. Everything below is relative to II.
  2. Fixed points. Solve f(x)=xf(x) = x. Graphically these are the crossings of y=f(x)y = f(x) with the diagonal.
  3. Classify them. Compute λ=f′(x∗)\lambda = f'(x^*) and apply the statement above: sink for ∣λ∣<1|\lambda| < 1, source for ∣λ∣>1|\lambda| > 1, superstable for λ=0\lambda = 0, and inconclusive for ∣λ∣=1|\lambda| = 1, where you must look at the nonlinear terms or draw a cobweb.
  4. Draw a cobweb for one or two seeds. It shows at a glance what the linearisation cannot: which fixed point an orbit is captured by, whether the approach is monotone (λ>0\lambda > 0) or alternating (λ<0\lambda < 0), and whether orbits escape.
  5. Cycles of period pp. Solve fp(x)=xf^p(x) = x. Every fixed point of ff solves this too, so divide those roots out first; the remaining roots come in groups of pp, one group per pp-cycle.
  6. Classify the cycle by λ=∏kf′(xk)\lambda = \prod_{k} f'(x_k), using the product formula rather than differentiating fpf^p directly.
  7. Track the bifurcations. Move the parameter and watch λ\lambda at each cycle. A cycle can change stability only as λ\lambda passes through +1+1 or −1-1. Passage through +1+1 is where cycles are created or destroyed in pairs or exchanged (saddle-node, transcritical, pitchfork, as for flows on the line); passage through −1-1 is a flip bifurcation, at which the cycle keeps existing but its period doubles.
Example(Fixed points and the 22-cycle of the logistic map)AdaptedAdapted from Strogatz (1994), §10.2, pp. 353-355; Strogatz (1994), §10.3, Examples 10.3.1-10.3.3, pp. 357-361

Take the logistic map

fr(x)=r x (1−x),f_r(x) = r\,x\,(1 - x),

the standard test case for everything above, and run the recipe on it with the parameter kept general.

Step 1: an invariant interval. The graph is a downward parabola vanishing at x=0x = 0 and x=1x = 1, with apex at x=12x = \tfrac12 of height r/4r/4. Hence fr([0,1])=[0,r/4]f_r([0,1]) = [0, r/4], which is contained in [0,1][0,1] precisely when 0≤r≤40 \le r \le 4. Take I=[0,1]I = [0,1] and rr in that range.

Step 2: fixed points. rx(1−x)=xrx(1-x) = x holds at x=0x = 0 and at x∗=1−1/rx^* = 1 - 1/r; the second belongs to II only once r≥1r \ge 1.

Step 3: their multipliers. Since fr′(x)=r(1−2x)f_r'(x) = r(1 - 2x),

fr′(0)=r,fr′(x∗)=r(1−2+2r)=2−r.f_r'(0) = r, \qquad f_r'(x^*) = r\Bigl(1 - 2 + \tfrac2r\Bigr) = 2 - r .

So the origin is a sink for r<1r < 1 and a source for r>1r > 1, while x∗x^* is a sink exactly when ∣2−r∣<1|2 - r| < 1, that is on 1<r<31 < r < 3. The two fixed points swap stability where they collide at r=1r = 1 (a transcritical bifurcation), and at r=3r = 3 the multiplier of x∗x^* arrives at −1-1, which by step 7 is a flip.

Step 5: the 22-cycle, without solving a quartic. The equation fr2(x)=xf_r^2(x) = x is a quartic whose roots include the two fixed points, and one route is to divide those out. It is quicker to work from the defining relations. Let p≠qp \ne q be the two points of a 22-cycle, so q=fr(p)q = f_r(p) and p=fr(q)p = f_r(q). Subtracting the relations,

p−q=fr(q)−fr(p)=r(q−p)−r(q2−p2)=r(q−p)[1−(p+q)],p - q = f_r(q) - f_r(p) = r(q - p) - r(q^2 - p^2) = r(q-p)\bigl[1 - (p+q)\bigr],

and dividing by q−p≠0q - p \ne 0 leaves −1=r[1−(p+q)]-1 = r[1 - (p+q)], so the sum is pinned down:

s:=p+q=r+1r.s := p + q = \frac{r+1}{r} .

Adding the relations instead, and using p2+q2=s2−2pqp^2 + q^2 = s^2 - 2pq,

s=rs−r(s2−2pq),so2r pq=s (1−r+rs)=2s,s = r s - r\bigl(s^2 - 2pq\bigr), \qquad\text{so}\qquad 2r\,pq = s\,(1 - r + rs) = 2s ,

because rs=r+1rs = r+1 makes the bracket equal to 22. Hence pq=s/r=(r+1)/r2pq = s/r = (r+1)/r^2. Knowing the sum and the product, pp and qq are the roots of t2−st+pq=0t^2 - st + pq = 0, that is of

r2t2−r(r+1) t+(r+1)=0,p,q=r+1±(r−3)(r+1)2r,r^2 t^2 - r(r+1)\,t + (r+1) = 0, \qquad p, q = \frac{r + 1 \pm \sqrt{(r-3)(r+1)}}{2r} ,

whose discriminant is s2−4pq=(r+1)(r−3)/r2s^2 - 4pq = (r+1)(r-3)/r^2. For r>0r > 0 this is positive exactly when r>3r > 3: the 22-cycle exists only beyond r=3r = 3, born at the flip bifurcation, at the very parameter where the fixed point lost its stability.

Step 6: the multiplier of the cycle. The product formula needs only the two symmetric functions, so pp and qq never have to be evaluated:

λ=fr′(p) fr′(q)=r2(1−2p)(1−2q)=r2[1−2s+4pq]=r2−2r(r+1)+4(r+1)=4+2r−r2.\lambda = f_r'(p)\,f_r'(q) = r^2 (1 - 2p)(1 - 2q) = r^2\bigl[1 - 2s + 4pq\bigr] = r^2 - 2r(r+1) + 4(r+1) = 4 + 2r - r^2 .

At r=3r = 3 this gives λ=1\lambda = 1, as it must, since the cycle is just emerging from the fixed point there; λ\lambda then decreases, and reaches −1-1 when r2−2r−5=0r^2 - 2r - 5 = 0, that is at

r=1+6=3.449489…r = 1 + \sqrt6 = 3.449489\ldots

So the 22-cycle is a sink exactly for 3<r<1+63 < r < 1 + \sqrt6, and at the right-hand end it flips in turn and a 44-cycle appears. That is the first step of the cascade treated in Period doubling and universality.

Example(The logistic map at r=3.2r = 3.2, in numbers)Original

Fix r=3.2r = 3.2 in the family above and put every step to the test.

Both fixed points repel. x∗=1−1/3.2=0.6875x^* = 1 - 1/3.2 = 0.6875 with multiplier λ=2−3.2=−1.2\lambda = 2 - 3.2 = -1.2, and the origin has multiplier 3.23.2; both exceed 11 in absolute value, so no orbit other than the two constant ones can settle at a fixed point.

The 22-cycle. The discriminant is (r−3)(r+1)=(0.2)(4.2)=0.84(r-3)(r+1) = (0.2)(4.2) = 0.84, so

p=4.2+0.846.4=0.799455490…,q=4.2−0.846.4=0.513044510…,p = \frac{4.2 + \sqrt{0.84}}{6.4} = 0.799455490\ldots, \qquad q = \frac{4.2 - \sqrt{0.84}}{6.4} = 0.513044510\ldots,

and its multiplier is λ=4+6.4−10.24=0.16\lambda = 4 + 6.4 - 10.24 = 0.16, comfortably inside (−1,1)(-1,1). The cycle is therefore a sink, and because λ>0\lambda > 0 the iterates of f2f^2 approach each cycle point from one side rather than alternating about it.

Check by iterating. Take the seed x0=0.2x_0 = 0.2 and iterate xn+1=3.2 xn(1−xn)x_{n+1} = 3.2\,x_n(1 - x_n):

x1=0.512000000,x2=0.799539200,x3=0.512884057,x4=0.799468803,x6=0.799457619,x8=0.799455831,x12=0.799455499,x16=0.799455491,x20=0.799455490.\begin{aligned} x_1 &= 0.512000000, & x_2 &= 0.799539200, & x_3 &= 0.512884057,\\ x_4 &= 0.799468803, & x_6 &= 0.799457619, & x_8 &= 0.799455831,\\ x_{12} &= 0.799455499, & x_{16} &= 0.799455491, & x_{20} &= 0.799455490 . \end{aligned}

The even iterates run to p=0.799455490467p = 0.799455490467 and the odd ones to q=0.513044509533q = 0.513044509533, and the error should shrink by the factor λ=0.16\lambda = 0.16 every two steps. It does: x4−p=1.3313×10−5x_4 - p = 1.3313 \times 10^{-5} and x6−p=2.1280×10−6x_6 - p = 2.1280 \times 10^{-6}, a ratio of 0.159850.15985 against the predicted 0.160.16. (All the numbers in this block were computed at 3030-digit precision and then rounded.)

A superstable cycle nearby. The 22-cycle is superstable where its multiplier vanishes, 4+2r−r2=04 + 2r - r^2 = 0, that is at

r=1+5=3.236067977…r = 1 + \sqrt5 = 3.236067977\ldots

By the product formula λ=r2(1−2p)(1−2q)\lambda = r^2(1-2p)(1-2q) can vanish only if one factor does, so one point of the cycle must be x=12x = \tfrac12, the apex of the parabola. And indeed at this rr,

f(12)=r4=1+54=0.809016994…,f2(12)=r⋅r4⋅(1−r4)=r2(4−r)16=12,f\bigl(\tfrac12\bigr) = \frac{r}{4} = \frac{1 + \sqrt5}{4} = 0.809016994\ldots, \qquad f^2\bigl(\tfrac12\bigr) = r \cdot \frac r4 \cdot \Bigl(1 - \frac r4\Bigr) = \frac{r^2(4-r)}{16} = \frac12 ,

exactly, because r2=2r+4r^2 = 2r + 4 turns r2(4−r)r^2(4-r) into (2r+4)(4−r)=16+4r−2r2=16+4r−2(2r+4)=8(2r+4)(4-r) = 16 + 4r - 2r^2 = 16 + 4r - 2(2r+4) = 8. This is what makes superstable parameters easy to locate numerically: a superstable cycle of a map with a single critical point always contains that critical point, so one solves frp(c)=cf_r^p(c) = c for rr with cc the critical point, instead of hunting for the cycle first.

ApplicationOriginal

Maps of an interval reach physics from two directions.

As reductions of flows. A continuous-time system is turned into a map by recording a trajectory only at selected moments: the crossings of a surface in phase space (Poincare maps), or the successive maxima of one coordinate, as Lorenz did for his equations. A periodic orbit of the flow becomes a fixed point or a cycle of the map, and its multiplier is exactly what decides the orbit's stability, so the apparatus above is the standard tool for the stability of periodic solutions. Because the map inherits the dimension of the surface minus nothing, the reduction is only one-dimensional when the attractor of the flow is nearly two-dimensional, as it is for strongly dissipative systems.

As models in their own right. Discrete time is the natural setting wherever the state is updated once per cycle rather than continuously: non-overlapping generations in population biology, where fr(x)=rx(1−x)f_r(x) = rx(1-x) was popularised as the simplest model with a carrying capacity; sampled-data and switching circuits; impact and kick maps in mechanics, where a particle is struck once per revolution; and the period-to-period return of a driven oscillator. The same map also appears in numerical analysis: Newton's iteration for g(x)=0g(x) = 0 is the map f(x)=x−g(x)/g′(x)f(x) = x - g(x)/g'(x), and a simple root is a superstable fixed point of it, f′(x)=g(x)g′′(x)/g′(x)2f'(x) = g(x)g''(x)/g'(x)^2 vanishing where gg does, which is the reason for the method's rapid convergence.

Theorem

Period doubling and universality

Adapted

States Feigenbaum's universality — that every smooth one-parameter family of unimodal maps with a quadratic maximum reaches chaos through an infinite cascade of period doublings whose parameter spacings shrink by the same factor δ=4.6692\delta = 4.6692 and whose cycles shrink by the same factor α=−2.5029\alpha = -2.5029 — explains it by renormalisation, carries out an approximate renormalisation in closed form to get δ≈1+17\delta \approx 1 + \sqrt{17}, and treats intermittency, the other way a periodic window ends.

Prerequisites: One-dimensional maps, Bifurcations in one dimension

Definition(Cascades, the Feigenbaum constants, intermittency)AdaptedAdapted from Strogatz (1994), §10.2, pp. 353-355, §10.4, pp. 363-364, §10.6, pp. 370, 373, and §10.7, p. 380; Hirsch, Smale & Devaney (2013), §15.2, pp. 336-337

Let f(x,r)f(x, r) be a smooth one-parameter family of maps of an interval into itself.

  • A map is unimodal on [0,1][0,1] if it is smooth, vanishes at both endpoints, and has a single interior maximum. The maximum is quadratic if f′′f'' is non-zero there; write xmx_m for its location. The logistic map rx(1−x)rx(1-x) and the sine map rsin⁡πxr\sin\pi x are the standard examples.

  • A cycle undergoes a flip (or period-doubling) bifurcation at r=r0r = r_0 if its multiplier passes through −1-1 there. By the multiplier criterion, this and passage through +1+1 are the only ways a cycle can change stability, so these are the only parameter values at which a bifurcation of cycles can occur.

  • A period-doubling cascade is an infinite sequence of flip bifurcations in which a 2n2^{n}-cycle loses stability and a 2n+12^{n+1}-cycle takes over. Write rnr_n for the parameter at which the 2n2^n-cycle is born, and r∞=lim⁡nrnr_\infty = \lim_n r_n for the accumulation point of the cascade.

  • A cycle is superstable if its multiplier is 00. Because a superstable cycle of a unimodal map must contain the critical point xmx_m, the superstable parameter values are easy to find numerically; write RnR_n for the value at which the 2n2^n-cycle is superstable. Then rn<Rn<rn+1r_n < R_n < r_{n+1}, so the RnR_n and the rnr_n accumulate at the same point.

  • The Feigenbaum constants are

    δ=lim⁡n→∞rn−rn−1rn+1−rn,α=lim⁡n→∞dndn+1,\delta = \lim_{n\to\infty}\frac{r_n - r_{n-1}}{r_{n+1} - r_n}, \qquad \alpha = \lim_{n\to\infty}\frac{d_n}{d_{n+1}},

    where dnd_n is the signed distance from xmx_m to the nearest other point of the 2n2^n-cycle, measured at r=Rnr = R_n. The same limits are obtained with RnR_n in place of rnr_n in the first.

  • Intermittency is long stretches of nearly periodic motion interrupted at unpredictable times by short chaotic bursts. The kind considered here, type I, occurs just outside a periodic window, where a stable and an unstable cycle have just annihilated in a tangent (saddle-node) bifurcation.

Theorem(Feigenbaum universality)AdaptedAdapted from Strogatz (1994), §10.6, pp. 370, 373-374, and §10.7, pp. 383-384

Consider families of unimodal maps undergoing a period-doubling route to chaos.

  1. Qualitative universality (the U-sequence). Metropolis, Stein and Stein proved that for all families xn+1=rf(xn)x_{n+1} = r f(x_n) with ff unimodal and f(0)=f(1)=0f(0) = f(1) = 0 — the precise conditions are in their paper — the order in which stable cycles appear as rr increases does not depend on ff. Up to period 66 that order is

    1, 2, 22, 6, 5, 3, 2⋅3, 5, 6, 4, 6, 5, 6.1,\ 2,\ 2^2,\ 6,\ 5,\ 3,\ 2\cdot3,\ 5,\ 6,\ 4,\ 6,\ 5,\ 6 .

    Only the shape of ff matters, not its algebraic form; the parameter values at which the cycles appear are not universal.

  2. Quantitative universality. For every such family whose maximum is quadratic, the limits δ\delta and α\alpha exist and take the same values,

    δ=4.669…,α=−2.5029…,\delta = 4.669\ldots, \qquad \alpha = -2.5029\ldots,

    independent of the family. The negative sign of α\alpha records that the nearest cycle point lies alternately above and below xmx_m. A maximum of a different order — quartic, say — gives a different pair of constants.

  3. The functional equation. The mechanism is renormalisation. With the origin of xx moved to xmx_m, the rescaled iterates converge,

    gi(x)=lim⁡n→∞αnf(2n) ⁣(xαn, Rn+i),g_i(x) = \lim_{n\to\infty}\alpha^n f^{(2^n)}\!\Bigl(\frac{x}{\alpha^n},\ R_{n+i}\Bigr),

    to universal functions gig_i independent of ff. At the accumulation point of the cascade no shift of parameter is needed, and the limit g=g∞g = g_\infty satisfies

    g(x)=α g(g(x/α)),g′(0)=0,g(0)=1,g(x) = \alpha\, g\bigl(g(x/\alpha)\bigr), \qquad g'(0) = 0, \quad g(0) = 1 ,

    from which α=1/g(1)\alpha = 1/g(1). No closed form for gg is known; a power series g(x)=1+c1x2+c2x4+⋯g(x) = 1 + c_1x^2 + c_2x^4 + \cdots substituted into the functional equation and truncated at seven terms gave Feigenbaum c1=−1.5276c_1 = -1.5276, c2=0.1048c_2 = 0.1048 and α=−2.5029\alpha = -2.5029. The corresponding account of δ\delta requires the spectrum of the linearisation of the renormalisation operator on a space of functions, which is beyond what we develop here; neither Strogatz nor Hirsch, Smale and Devaney proves it, and neither do we.

Lemma(An approximate renormalisation that can be done in closed form)AdaptedAdapted from Strogatz (1994), §10.7, pp. 384-387

Near a flip bifurcation every smooth family looks, after translating xx and μ\mu and rescaling xx, like

fμ(x)=−(1+μ)x+x2,f_\mu(x) = -(1+\mu)x + x^2 ,

whose fixed point at x=0x = 0 has multiplier −(1+μ)-(1+\mu) and so flips at μ=0\mu = 0. For this family:

  1. For μ>0\mu > 0 there is a 22-cycle {p,q}\{p, q\} with p+q=μp + q = \mu and pq=−μpq = -\mu, namely p,q=12(μ±μ2+4μ)p, q = \tfrac12\bigl(\mu \pm \sqrt{\mu^2+4\mu}\bigr).

  2. Writing x=p+ηx = p + \eta and discarding terms of order η3\eta^3, the second iterate obeys

    ηn+1=(1−4μ−μ2)ηn+C(μ) ηn2,C(μ)=μ2+4μ−3μ2+4μ.\eta_{n+1} = \bigl(1 - 4\mu - \mu^2\bigr)\eta_n + C(\mu)\,\eta_n^2, \qquad C(\mu) = \mu^2 + 4\mu - 3\sqrt{\mu^2+4\mu} .
  3. Rescaling by x~=C(μ)η\tilde x = C(\mu)\eta puts this back into the original form with the renormalised parameter

    μˉ=T(μ)=μ2+4μ−2.\bar\mu = T(\mu) = \mu^2 + 4\mu - 2 .
  4. Consequently the parameter μk\mu_k at which a 2k2^k-cycle is born satisfies T(μk+1)=μkT(\mu_{k+1}) = \mu_k with μ1=0\mu_1 = 0; the sequence increases to the fixed point

    μ∗=12(−3+17)=0.5615528,\mu^* = \tfrac12\bigl(-3 + \sqrt{17}\bigr) = 0.5615528 ,

    which is the accumulation point of the cascade in this approximation, and the convergence is geometric with ratio

    T′(μ∗)=2μ∗+4=1+17=5.1231,T'(\mu^*) = 2\mu^* + 4 = 1 + \sqrt{17} = 5.1231 ,

    the approximation's value of δ\delta. The rescaling factor at the accumulation point,

    C(μ∗)=1+172−31+172=−2.2399,C(\mu^*) = \frac{1+\sqrt{17}}{2} - 3\sqrt{\frac{1+\sqrt{17}}{2}} = -2.2399 ,

    is the approximation's value of α\alpha. Both are within about 10%10\% of the true constants.

Idea of the proofOriginal

The orbit diagram of a unimodal map repeats itself: each branch of the figtree, magnified in the xx direction and stretched in the rr direction, looks like the whole tree. The reason is that the second iterate of the map, restricted to a small interval around the critical point and with the parameter shifted to the next superstable value, is again a unimodal map with a quadratic maximum — an inverted and shrunken copy of the original. So one step of the cascade for ff is one step of the cascade for f2f^2, which is the same problem over again. The whole of the cascade therefore comes from iterating a single operation on maps: take the second iterate, rescale xx by a factor α\alpha, and shift the parameter. The constants are the properties of that operation at its fixed point — α\alpha is the rescaling the fixed point demands, and δ\delta is the rate at which the parameter shift converges, so they cannot depend on the family one started with. The Lemma carries out exactly this programme with the smallest possible model of a map, a quadratic kept only to second order, where every step can be done by hand.

ProofAdaptedAdapted from Strogatz (1994), §10.7, pp. 384-387

We prove the Lemma. Throughout, S=μ2+4μS = \sqrt{\mu^2 + 4\mu} and a=−(1+μ)a = -(1+\mu), so that fμ(x)=ax+x2f_\mu(x) = ax + x^2. Assume μ>0\mu > 0, so SS is real and positive.

  1. The 22-cycle. A 22-cycle {p,q}\{p,q\} satisfies f(p)=qf(p) = q and f(q)=pf(q) = p. Subtracting the two equations,

    p−q=a(q−p)+q2−p2=(q−p)[a+(p+q)],p - q = a(q - p) + q^2 - p^2 = (q-p)\bigl[a + (p+q)\bigr],

    and since p≠qp \ne q we may divide by p−qp - q to get −1=a+(p+q)-1 = a + (p+q), that is p+q=−1−a=μp + q = -1 - a = \mu. Adding the two equations instead,

    p+q=a(p+q)+p2+q2=aμ+μ2−2pq,p + q = a(p+q) + p^2 + q^2 = a\mu + \mu^2 - 2pq ,

    so μ=−(1+μ)μ+μ2−2pq=−μ−2pq\mu = -(1+\mu)\mu + \mu^2 - 2pq = -\mu - 2pq, giving pq=−μpq = -\mu. Hence pp and qq are the roots of t2−μt−μ=0t^2 - \mu t - \mu = 0, which are real and distinct for μ>0\mu > 0. Take pp to be the root with the ++ sign.

  2. The second iterate near pp. Put x=p+ηx = p + \eta. Then

    f(p+η)=a(p+η)+(p+η)2=ap+p2⏟= q+(a+2p)η+η2,f(p + \eta) = a(p+\eta) + (p+\eta)^2 = \underbrace{ap + p^2}_{=\,q} + (a + 2p)\eta + \eta^2 ,

    so f(p+η)=q+uf(p+\eta) = q + u with u=(a+2p)η+η2u = (a+2p)\eta + \eta^2, and applying ff again,

    f2(p+η)=aq+q2+(a+2q)u+u2=p+(a+2q)(a+2p) η+[(a+2q)+(a+2p)2]η2+O(η3),f^2(p+\eta) = aq + q^2 + (a+2q)u + u^2 = p + (a+2q)(a+2p)\,\eta + \bigl[(a+2q) + (a+2p)^2\bigr]\eta^2 + O(\eta^3),

    where the η2\eta^2 terms come from (a+2q)η2(a+2q)\eta^2 and from the leading part of u2u^2. Now 2p=μ+S2p = \mu + S and 2q=μ−S2q = \mu - S, and a=−1−μa = -1-\mu, so

    a+2p=−1+S,a+2q=−1−S.a + 2p = -1 + S, \qquad a + 2q = -1 - S .

    Hence the coefficient of η\eta is (−1−S)(−1+S)=1−S2=1−4μ−μ2(-1-S)(-1+S) = 1 - S^2 = 1 - 4\mu - \mu^2, and the coefficient of η2\eta^2 is

    C=(−1−S)+(−1+S)2=−1−S+1−2S+S2=S2−3S=μ2+4μ−3μ2+4μ,C = (-1 - S) + (-1 + S)^2 = -1 - S + 1 - 2S + S^2 = S^2 - 3S = \mu^2 + 4\mu - 3\sqrt{\mu^2+4\mu},

    which is part 2. (That the linear coefficient is the multiplier of the 22-cycle is the chain-rule product formula of One-dimensional maps; here it has been obtained directly.)

  3. Rescaling. Multiply the recursion of part 2 by CC and set η~=Cη\tilde\eta = C\eta:

    η~n+1=(1−4μ−μ2)η~n+η~n2.\tilde\eta_{n+1} = \bigl(1 - 4\mu - \mu^2\bigr)\tilde\eta_n + \tilde\eta_n^2 .

    This has exactly the algebraic form −(1+μˉ)η~+η~2-(1+\bar\mu)\tilde\eta + \tilde\eta^2 of the original map, provided we define μˉ\bar\mu by −(1+μˉ)=1−4μ−μ2-(1+\bar\mu) = 1 - 4\mu - \mu^2, that is μˉ=μ2+4μ−2=T(μ)\bar\mu = \mu^2 + 4\mu - 2 = T(\mu).

  4. Iterating the renormalisation. The renormalised map describes the dynamics of f2f^2 near pp, so the renormalised family flips — at μˉ=0\bar\mu = 0 — precisely when the 22-cycle of the original family doubles into a 44-cycle. More generally, the renormalised family gives birth to a 2k2^k-cycle exactly when the original gives birth to a 2k+12^{k+1}-cycle. Therefore

    T(μk+1)=μk,μ1=0.T(\mu_{k+1}) = \mu_k , \qquad \mu_1 = 0 .

    Solving for the forward iteration, T(μ)=μkT(\mu) = \mu_{k} means (μ+2)2=6+μk(\mu+2)^2 = 6 + \mu_k, and the relevant root is

    μk+1=−2+6+μk.\mu_{k+1} = -2 + \sqrt{6 + \mu_k} .

    The map μ↦−2+6+μ\mu \mapsto -2 + \sqrt{6+\mu} is increasing, is a contraction on [0,1][0, 1] (its derivative there is 12(6+μ)−1/2≤12⋅6−1/2<1\tfrac12(6+\mu)^{-1/2} \le \tfrac12\cdot6^{-1/2} < 1), and maps [0,1][0,1] into itself since it sends 00 to 0.44950.4495 and 11 to 0.64580.6458. So the sequence converges monotonically to the unique fixed point in [0,1][0,1], which satisfies μ=μ2+4μ−2\mu = \mu^2 + 4\mu - 2, that is μ2+3μ−2=0\mu^2 + 3\mu - 2 = 0, with positive root μ∗=12(−3+17)=0.5615528\mu^* = \tfrac12(-3 + \sqrt{17}) = 0.5615528.

    For the rate: μk−μ∗=T(μk+1)−T(μ∗)\mu_k - \mu^* = T(\mu_{k+1}) - T(\mu^*), so by the mean value theorem μk−μ∗=T′(ck)(μk+1−μ∗)\mu_k - \mu^* = T'(c_k)(\mu_{k+1} - \mu^*) with ckc_k between μk+1\mu_{k+1} and μ∗\mu^*, hence ck→μ∗c_k \to \mu^* and

    μk−μ∗μk+1−μ∗=T′(ck)⟶T′(μ∗)=2μ∗+4=1+17=5.1231.\frac{\mu_k - \mu^*}{\mu_{k+1} - \mu^*} = T'(c_k) \longrightarrow T'(\mu^*) = 2\mu^* + 4 = 1 + \sqrt{17} = 5.1231 .

    The constant δ\delta was defined by the spacings rather than by the distances to μ∗\mu^*, but the two give the same number. Write ek=μk−μ∗e_k = \mu_k - \mu^* and ρk=ek−1/ek\rho_k = e_{k-1}/e_k, so ρk→T′(μ∗)\rho_k \to T'(\mu^*) by the display above. Then

    μk−μk−1μk+1−μk=ek−ek−1ek+1−ek=ρk+1−ρkρk+11−ρk+1⟶T′(μ∗)−T′(μ∗)21−T′(μ∗)=T′(μ∗),\frac{\mu_k - \mu_{k-1}}{\mu_{k+1} - \mu_k} = \frac{e_k - e_{k-1}}{e_{k+1} - e_k} = \frac{\rho_{k+1} - \rho_k\rho_{k+1}}{1 - \rho_{k+1}} \longrightarrow \frac{T'(\mu^*) - T'(\mu^*)^2}{1 - T'(\mu^*)} = T'(\mu^*),

    on dividing numerator and denominator by ek+1e_{k+1}. So the spacings shrink by the same factor 1+171+\sqrt{17}, which is the approximation's δ\delta. Finally, CC was the factor by which η\eta had to be rescaled at each renormalisation, which is the role played by α\alpha; evaluating at the fixed point, with μ∗2+4μ∗=μ∗+2=12(1+17)\mu^{*2} + 4\mu^* = \mu^* + 2 = \tfrac12(1+\sqrt{17}),

    C(μ∗)=1+172−31+172=2.5615528−4.8014557=−2.2399027.□C(\mu^*) = \frac{1+\sqrt{17}}{2} - 3\sqrt{\frac{1+\sqrt{17}}{2}} = 2.5615528 - 4.8014557 = -2.2399027 . \qquad\square
Remark(Where the hypotheses are used)Original
  • A quadratic maximum is what fixes the values of the constants. In the Lemma this enters at the very first line: the model map was truncated after x2x^2, and it is the x2x^2 term that supplied CC and hence α\alpha. A map whose maximum is quartic renormalises to a different fixed function and has its own pair of constants. This is also the sense in which gg is universal: the argument x/αnx/\alpha^n shrinks to zero, so only the behaviour of ff in a vanishing neighbourhood of the maximum survives, and all that survives of that is the order of the maximum.
  • Unimodality is what makes the renormalised map a map of the same kind, with one critical point in the interval being magnified. A map with two humps can renormalise to something else, and the U-sequence does not apply to it.
  • Where the Lemma is only an approximation. Two things were discarded: the O(η3)O(\eta^3) terms at each renormalisation, and the dependence of the family on μ\mu beyond linear order. Both are genuinely present, and the price is the 10%10\% error in δ\delta and α\alpha. What survives exactly is the structure: that there is a renormalisation operation at all, that it has a fixed point, and that the constants are a derivative and a scale factor at that fixed point. The exact theory replaces the one-parameter map TT by an operator on a space of functions; its fixed point is gg, and δ\delta is the one eigenvalue of modulus greater than 11 of its linearisation.
  • What the cascade does not require. Nothing above needs the map to be the logistic map, or even to have a formula. It needs a family of maps of an interval with one quadratic maximum. That is why the same constants appear in flows: if a flow is dissipative enough that its return map is nearly one-dimensional and unimodal — as it is for the Rossler system, and apparently for convection in mercury — the theory applies to the flow.
  • The constants are limits. The ratios approach δ\delta and α\alpha only in the limit, and the early ratios are noticeably off, as the computation below shows. An experiment that resolves four doublings is measuring something still several percent from δ\delta, which is one reason measured values cluster near 4.44.4 rather than 4.6694.669.
Remark(Intermittency: the other way a window ends)AdaptedAdapted from Strogatz (1994), §10.4, pp. 361-365

A periodic window in the orbit diagram begins with a tangent bifurcation and ends with a cascade. For the logistic map's period-33 window, which begins at r=1+8=3.8284271…r = 1 + \sqrt8 = 3.8284271\ldots — a value due to Myrberg and, as Strogatz notes, surprisingly hard to derive — the graph of f3f^3 becomes tangent to the diagonal at three points simultaneously, creating a stable and an unstable 33-cycle there. Raising rr further, the stable 33-cycle period-doubles through its own cascade, with the same δ\delta, and a miniature copy of the whole orbit diagram appears inside the window.

Lowering rr below 1+81+\sqrt8 instead produces intermittency. The three tangency points become three narrow channels between the graph of f3f^3 and the diagonal. An orbit that enters a channel takes many iterations to squeeze through it, and while it does, f3(xn)≈xnf^3(x_n) \approx x_n, so the motion looks like the 33-cycle that no longer exists. On leaving the channel the orbit wanders chaotically until it falls into a channel again, at an unpredictable time.

How long the laminar phase lasts. Near the tangency the third iterate is, to leading order, f3(x)≈x+a(x−xc)2+c ϵf^3(x) \approx x + a(x - x_c)^2 + c\,\epsilon with a,c>0a, c > 0 and ϵ=rc−r\epsilon = r_c - r. Treating nn as continuous, dx/dn≈a(x−xc)2+cϵdx/dn \approx a(x-x_c)^2 + c\epsilon, so the number of iterations to cross the channel is

n≈∫−∞∞dsas2+cϵ=πac ϵ∝ϵ−1/2.n \approx \int_{-\infty}^{\infty}\frac{ds}{as^2 + c\epsilon} = \frac{\pi}{\sqrt{ac\,\epsilon}} \propto \epsilon^{-1/2} .

So the laminar stretches lengthen without bound as the window is approached, and the bursts become rarer; moving away from the window they become more frequent until the motion is fully chaotic. This progression is the intermittency route to chaos, and it has been observed in lasers, in fluids and in chemical reactions. The ϵ−1/2\epsilon^{-1/2} law is checked numerically below.

Method(Measuring δ\delta)AdaptedAdapted from Strogatz (1994), §10.7, pp. 380-381, and §10.6, pp. 374-376

In a simulation, do not chase the bifurcation values rnr_n: they are the parameters at which a multiplier passes through −1-1, which is hard to localise because nothing visible happens at the cycle itself. Use the superstable values RnR_n instead, and exploit the fact that a superstable cycle contains the critical point xmx_m.

  1. Locate xmx_m, the critical point of the family.
  2. For each nn, solve f(2n)(xm,r)=xmf^{(2^n)}(x_m, r) = x_m for rr. This is one scalar equation in one unknown and is solved by bisection or by a secant method.
  3. Bracket the root: the next RnR_n lies close to Rn−1+(Rn−1−Rn−2)/δR_{n-1} + (R_{n-1} - R_{n-2})/\delta, so use that as the prediction and search a small interval around it, taking the root nearest the prediction — the equation has many other roots, belonging to cycles of other periods.
  4. Work in extended precision. Each level needs about log⁡10δ≈0.67\log_{10}\delta \approx 0.67 more decimal digits in rr than the last, and 2n2^n iterations of the map amplify rounding error, so double precision runs out near n=9n = 9 or 1010.
  5. Form the ratios (Rn−Rn−1)/(Rn+1−Rn)(R_n - R_{n-1})/(R_{n+1} - R_n) and extrapolate; the accumulation point follows from R∞≈Rn+(Rn−Rn−1)/(δ−1)R_\infty \approx R_n + (R_n - R_{n-1})/(\delta - 1).

In an experiment, step 1 is unavailable, so one measures the rnr_n directly from time series and accepts a few percent of error. Strogatz tabulates the results: 4.3±0.84.3 \pm 0.8 from convection in water (Giglio and others, 1981), 4.4±0.14.4 \pm 0.1 from convection in mercury (Libchaber and others, 1982, over four doublings), 4.5±0.64.5 \pm 0.6 and 4.3±0.14.3 \pm 0.1 from diode circuits, 4.7±0.34.7 \pm 0.3 from a transistor circuit, and 4.5±0.34.5 \pm 0.3 from a simulated Josephson junction. Since each further doubling needs about a fivefold improvement in the resolution of the control parameter, and noise blurs high-period orbits, about five doublings is the practical limit.

Example(The logistic cascade, computed)Original

We carried out the method above for f(x,r)=rx(1−x)f(x,r) = rx(1-x), with xm=12x_m = \tfrac12, in 6060-digit arithmetic. Solving f(2n)(12,r)=12f^{(2^n)}(\tfrac12, r) = \tfrac12 gives the superstable parameters

R0=2R1=3.236067977499790R2=3.498561699327702R3=3.554640862768825R4=3.566667379856269R5=3.569243531637110R6=3.569795293749945R7=3.569913465422349R8=3.569938774233305R9=3.569944194608065\begin{array}{llll} R_0 = 2 & R_1 = 3.236067977499790 & R_2 = 3.498561699327702 & R_3 = 3.554640862768825 \\ R_4 = 3.566667379856269 & R_5 = 3.569243531637110 & R_6 = 3.569795293749945 & R_7 = 3.569913465422349 \\ R_8 = 3.569938774233305 & R_9 = 3.569944194608065 & & \end{array}

The first two are exact: R0=2R_0 = 2 because f(12)=r/4=12f(\tfrac12) = r/4 = \tfrac12, and R1=1+5=3.2360679774997897R_1 = 1 + \sqrt5 = 3.2360679774997897, as computed in One-dimensional maps.

The constant δ\delta. The successive ratios (Rn−Rn−1)/(Rn+1−Rn)(R_n - R_{n-1})/(R_{n+1} - R_n) are

4.70894,4.68077,4.66296,4.66840,4.66895,4.66916,4.66919,4.669199,4.70894,\quad 4.68077,\quad 4.66296,\quad 4.66840,\quad 4.66895,\quad 4.66916,\quad 4.66919,\quad 4.669199 ,

for n=1,…,8n = 1, \dots, 8. They settle on 4.669204.66920, against the accepted δ=4.6692016\delta = 4.6692016. Note that the first ratio is off by nearly 1%1\% and the third actually overshoots: the convergence is not monotone, which is worth knowing before reading much into an experiment that resolves four doublings.

The accumulation point. Extrapolating, R∞≈R9+(R9−R8)/(δ−1)=3.5699456719R_\infty \approx R_9 + (R_9 - R_8)/(\delta - 1) = 3.5699456719, in agreement with the value 3.5699463.569946 that Strogatz obtains from the rnr_n.

The constant α\alpha. At each RnR_n we took dnd_n to be the displacement from xm=12x_m = \tfrac12 to the point of the 2n2^n-cycle half a period away, having checked for every n≤8n \le 8 that this is indeed the nearest cycle point to xmx_m. The values alternate in sign:

d1=0.3090170,d2=−0.1164018,d3=0.0459752,d4=−0.0183262,d5=0.0073184,d_1 = 0.3090170,\quad d_2 = -0.1164018,\quad d_3 = 0.0459752,\quad d_4 = -0.0183262,\quad d_5 = 0.0073184,

and so on down to d8=−4.666897×10−4d_8 = -4.666897\times10^{-4}. The ratios dn/dn+1d_n/d_{n+1} are

−2.65474,−2.53184,−2.50872,−2.50411,−2.50316,−2.50296,−2.50292,-2.65474,\quad -2.53184,\quad -2.50872,\quad -2.50411,\quad -2.50316,\quad -2.50296,\quad -2.50292 ,

converging to −2.50292-2.50292 against the accepted α=−2.5029079\alpha = -2.5029079. The sign alternation predicted in the statement is visible in the dnd_n themselves.

Comparison with the Lemma. The approximate renormalisation gave δ≈1+17=5.1231\delta \approx 1 + \sqrt{17} = 5.1231 (high by 9.7%9.7\%), α≈−2.2399\alpha \approx -2.2399 (low in magnitude by 10.5%10.5\%), and an accumulation point at μ∗=0.5616\mu^* = 0.5616, which corresponds to r=3+μ∗=3.5616r = 3 + \mu^* = 3.5616 for the logistic map since μ=0\mu = 0 was placed at the first flip, r=3r = 3. The true value is 3.56993.5699: an error of 0.2%0.2\%, far better than the error in δ\delta, which is what one expects from a calculation that approximates the renormalisation map TT well near its fixed point but its derivative there less well.

Example(Intermittency near the period-3 window, measured)Original

Set r=rc−ϵr = r_c - \epsilon with rc=1+8=3.8284271r_c = 1 + \sqrt8 = 3.8284271, iterate f3f^3 for 4×1064\times10^6 steps after discarding a transient of 10410^4, and call a step laminar when ∣f3(x)−x∣<10−2|f^3(x) - x| < 10^{-2}. The mean length LL of a run of consecutive laminar steps, in iterations of f3f^3, came out as

ϵ=10−3:L=4.70Lϵ=0.1486ϵ=3×10−4:L=8.87Lϵ=0.1537ϵ=10−4:L=15.43Lϵ=0.1543ϵ=3×10−5:L=28.25Lϵ=0.1547ϵ=10−5:L=48.57Lϵ=0.1536\begin{array}{lllll} \epsilon = 10^{-3}: & L = 4.70 & \quad & L\sqrt\epsilon = 0.1486 \\ \epsilon = 3\times10^{-4}: & L = 8.87 & & L\sqrt\epsilon = 0.1537 \\ \epsilon = 10^{-4}: & L = 15.43 & & L\sqrt\epsilon = 0.1543 \\ \epsilon = 3\times10^{-5}: & L = 28.25 & & L\sqrt\epsilon = 0.1547 \\ \epsilon = 10^{-5}: & L = 48.57 & & L\sqrt\epsilon = 0.1536 \end{array}

Across the whole table a hundredfold decrease in ϵ\epsilon multiplies LL by 48.57/4.70=10.3348.57/4.70 = 10.33, against the predicted 1010; over the last four rows, where ϵ\epsilon falls by a factor 3030, it multiplies LL by 48.57/8.87=5.47648.57/8.87 = 5.476, against the predicted 30=5.477\sqrt{30} = 5.477. The product LϵL\sqrt\epsilon is constant to within 1%1\% over the last four rows, which is the ϵ−1/2\epsilon^{-1/2} law. (The value of the constant 0.1540.154 is not universal: it depends on the threshold 10−210^{-2} chosen to call a step laminar, and on aa and cc, which are properties of this particular map at this particular tangency. The exponent is what the argument predicts.)

ApplicationOriginal

Feigenbaum's constants are the reason a one-dimensional toy map is taken seriously as a model of a laboratory system. A convecting layer of mercury has an enormous number of degrees of freedom and nothing in its equations resembles rx(1−x)rx(1-x); yet if the dissipation is strong enough that the attractor is barely more than two-dimensional, the return map of the flow is nearly one-dimensional and unimodal, and the ratio of successive bifurcation intervals must then be 4.6694.669. That is a parameter-free prediction about a real fluid, and it is why Libchaber's group went to the trouble of stabilising the roll structure with a magnetic field: increasing the damping is exactly what pushes a system into the regime where the theory applies.

The practical uses follow from that. Observing a few period doublings with roughly the right ratio in a measured signal — from a laser, a chemical reactor, a cardiac preparation, a nonlinear circuit — is evidence that the irregularity to come is low-dimensional chaos rather than noise or high-dimensional turbulence, and therefore that a model with two or three active variables may be worth building. Conversely, when the ratios come out wrong, the one-dimensional picture is the wrong picture. Where the behaviour is unwanted, the cascade also says where to intervene: since the route is a sequence of flips, keeping a multiplier away from −1-1 — by adding damping, or by small feedback corrections applied once per cycle — suppresses the whole cascade at its first step.

Intermittency plays the same diagnostic role for the other common route. Nearly periodic behaviour interrupted by irregular bursts, with the burst rate growing as a control parameter is moved, points to a saddle-node bifurcation of cycles rather than to a cascade; and the ϵ−1/2\epsilon^{-1/2} law for the laminar lengths gives a quantitative test and, if it holds, a way of locating the critical parameter from data taken away from it.

Method

Poincare maps

Adapted

Replaces a closed orbit of a flow by a fixed point of the first-return map on a transverse surface, shows that this map is well defined and continuously differentiable near the orbit, identifies the eigenvalues of its linearisation with the nontrivial Floquet multipliers of the orbit — so that they decide its stability and their product is exp⁡∫0T∇⋅f\exp\int_0^T \nabla\cdot f — and works the machinery through two systems whose return maps can be written down.

Prerequisites: Limit cycles and the Poincare-Bendixson theorem, One-dimensional maps, Floquet theory, Dependence on initial data and Gronwall's inequality, Implicit and inverse function theorems, Jordan normal form

Definition(Surface of section, return map, multipliers)AdaptedAdapted from Strogatz (1994), §8.7, pp. 278-281; Hirsch, Smale & Devaney (2013), §10.2, p. 217, and §10.3, p. 219

Let ff be continuously differentiable on an open set U⊆RnU \subseteq \mathbb{R}^n and let ϕt\phi_t be the flow of x˙=f(x)\dot x = f(x) (Existence and uniqueness of solutions).

A surface of section is a set S⊆US \subseteq U of dimension n−1n-1 that the flow crosses cleanly. Concretely we take

S  =  { x∈W:g(x)=0 },W⊆U open,S \;=\; \{\, x \in W : g(x) = 0 \,\}, \qquad W \subseteq U \text{ open},

where g:W→Rg : W \to \mathbb{R} is continuously differentiable and

∇g(x)⋅f(x)  ≠  0for every x∈S.\nabla g(x) \cdot f(x) \;\neq\; 0 \qquad\text{for every } x \in S .

This last condition is transversality: the velocity never lies in the tangent plane ker⁡∇g(x)\ker \nabla g(x) of SS, so no trajectory grazes SS or runs along it, and all trajectories pierce SS in the same direction, the one in which gg increases. For n=2n = 2 this is the local section already used in the Poincare-Bendixson theorem, where g(x)=(x−x0)⋅f(x0)g(x) = (x - x_0)\cdot f(x_0) and SS is a short straight segment.

Fix x∈Sx \in S. If there is a smallest t>0t > 0 with ϕt(x)∈S\phi_t(x) \in S, write τ(x)\tau(x) for it — the return time — and set

P(x)  =  ϕτ(x)(x).P(x) \;=\; \phi_{\tau(x)}(x) .

The map PP, defined on the set of points of SS that do return, is the Poincare map, or first-return map, of SS. It turns the continuous time of the flow into the integer time of a map of the (n−1)(n-1)-dimensional set SS into itself, so the whole apparatus of one-dimensional maps and its higher-dimensional analogue applies to it.

The point of the construction is the dictionary it sets up. A closed orbit γ\gamma of least period TT that meets SS at x∗x^* and nowhere else in one circuit gives P(x∗)=x∗P(x^*) = x^* with τ(x∗)=T\tau(x^*) = T; conversely a fixed point of PP is a point whose trajectory returns to itself, hence a closed orbit. A pp-cycle of PP is a closed orbit that threads SS pp times before closing up.

Let γ\gamma be such a closed orbit and x∗x^* its intersection with SS. The derivative DP(x∗)DP(x^*), restricted to the tangent plane Tx∗S=ker⁡∇g(x∗)T_{x^*}S = \ker\nabla g(x^*), is the linearised Poincare map: an (n−1)×(n−1)(n-1)\times(n-1) matrix once a basis of that plane is fixed. Its eigenvalues λ1,…,λn−1\lambda_1, \dots, \lambda_{n-1} are the characteristic multipliers, or Floquet multipliers, of γ\gamma. The name is the one used for the eigenvalues of the monodromy matrix of the TT-periodic variational equation v˙=Df(γ(t))v\dot v = Df(\gamma(t))v (Floquet theory); the statement below shows that the two lists agree once the monodromy matrix's unavoidable eigenvalue 11 — the trivial multiplier, belonging to displacements along the orbit, which are time shifts and not real perturbations — is deleted. Strogatz records the same convention.

A time-periodic system x˙=F(x,t)\dot x = F(x,t) with F(x,t+T)=F(x,t)F(x, t+T) = F(x,t) is covered by this: adjoin θ˙=1\dot\theta = 1 on Rn×R/TZ\mathbb{R}^n \times \mathbb{R}/T\mathbb{Z} and take S={θ=0}S = \{\theta = 0\}, which is transverse because ∇θ⋅(F,1)=1\nabla\theta \cdot (F,1) = 1. Every point returns, with τ≡T\tau \equiv T, and PP is the stroboscopic map: photograph the state once per drive period.

Method(The return map exists, is smooth, and decides stability)AdaptedAdapted from Hirsch, Smale & Devaney (2013), §10.2, Proposition, p. 217, and §10.3, p. 219; Strogatz (1994), §8.7, pp. 281-282

Let f∈C1(U)f \in C^1(U), let γ\gamma be a closed orbit of least period T>0T > 0, let x∗∈γx^* \in \gamma, and let SS be a surface of section containing x∗x^*, as above.

  1. (Well defined and C1C^1.) There is a relatively open neighbourhood VV of x∗x^* in SS and a continuously differentiable τ:V→R\tau : V \to \mathbb{R} with τ(x∗)=T\tau(x^*) = T such that ϕτ(x)(x)∈S\phi_{\tau(x)}(x) \in S for every x∈Vx \in V, and τ(x)\tau(x) is the first positive return time for xx close enough to x∗x^*. Hence P(x)=ϕτ(x)(x)P(x) = \phi_{\tau(x)}(x) is continuously differentiable on a neighbourhood of x∗x^* in SS, with P(x∗)=x∗P(x^*) = x^*.
  2. (Attracting case.) If every eigenvalue of DP(x∗)DP(x^*) satisfies ∣λj∣<1|\lambda_j| < 1, then γ\gamma is asymptotically orbitally stable: there is a neighbourhood NN of γ\gamma in UU such that every trajectory starting in NN stays in NN and its distance to γ\gamma tends to 00.
  3. (Repelling case in the plane.) For n=2n = 2, DP(x∗)DP(x^*) is the single number P′(x∗)P'(x^*), and the criterion is exactly the sink/source criterion for a fixed point of a map on an interval (One-dimensional maps): ∣P′(x∗)∣<1|P'(x^*)| < 1 gives an attracting closed orbit, ∣P′(x∗)∣>1|P'(x^*)| > 1 a repelling one, and ∣P′(x∗)∣=1|P'(x^*)| = 1 settles nothing.
  4. (Borderline.) If max⁡j∣λj∣=1\max_j|\lambda_j| = 1 the linearisation does not decide the stability of γ\gamma; this is where closed orbits bifurcate.
Theorem(The multipliers, and what their product must be)Original

In the setting above, let Φ(t)\Phi(t) be the matrix solution of the variational equation along γ\gamma,

Φ˙=Df(γ(t)) Φ,Φ(0)=I,\dot\Phi = Df\bigl(\gamma(t)\bigr)\,\Phi, \qquad \Phi(0) = I ,

with γ(0)=x∗\gamma(0) = x^*, so that M=Φ(T)M = \Phi(T) is the monodromy matrix of γ\gamma (Floquet theory). Then:

  1. (The two lists of multipliers agree.) The characteristic polynomial of MM factors as

    det⁡(μI−M)  =  (μ−1) det⁡(μI−DP(x∗)).\det(\mu I - M) \;=\; (\mu - 1)\,\det\bigl(\mu I - DP(x^*)\bigr) .

    So the eigenvalues of MM are 11 together with the eigenvalues λ1,…,λn−1\lambda_1, \dots, \lambda_{n-1} of the linearised Poincare map, counted with multiplicity.

  2. (No choice matters.) Consequently λ1,…,λn−1\lambda_1, \dots, \lambda_{n-1} depend only on the orbit γ\gamma: not on the surface of section, not on the point of γ\gamma at which it is placed, and not on the coordinates used on SS.

  3. (Their product is fixed by the divergence.)

    ∏j=1n−1λj  =  det⁡DP(x∗)  =  exp⁡∫0T∇⋅f(γ(t)) dt.\prod_{j=1}^{n-1}\lambda_j \;=\; \det DP(x^*) \;=\; \exp\int_0^T \nabla\cdot f\bigl(\gamma(t)\bigr)\,dt .

    In particular, in the plane there is only one multiplier and it is given by this formula, with no linearised map to compute; and in a system of constant divergence −k-k the product of the multipliers is e−kTe^{-kT}, so at least one multiplier has modulus below 11 whenever k>0k > 0.

Idea of the proofOriginal

Everything rests on one observation: hitting SS is a scalar equation, g(ϕt(x))=0g(\phi_t(x)) = 0, and transversality says that its tt-derivative does not vanish at the solution we already know. The implicit function theorem therefore solves it for tt as a smooth function of the starting point, and that function is the return time.

Once PP is differentiable, stability is the fixed-point question for a map, and a map whose derivative has spectral radius below 11 contracts in a suitably weighted norm — which is what the Jordan form provides.

For the multipliers, differentiate the definition P(x)=ϕτ(x)(x)P(x) = \phi_{\tau(x)}(x) by the product rule. The first term is Φ(T)\Phi(T) acting on the perturbation; the second is a multiple of the velocity f(x∗)f(x^*), because wobbling the return time only slides the point along its own trajectory. So in the splitting Rn=Rf(x∗)⊕Tx∗S\mathbb{R}^n = \mathbb{R}f(x^*)\oplus T_{x^*}S the monodromy matrix is block triangular with the blocks 11 and DP(x∗)DP(x^*), and both the factorisation of the characteristic polynomial and the determinant formula fall out, the latter combined with Liouville's formula for det⁡Φ\det\Phi.

Proof(Part 1: existence and smoothness of the return map)AdaptedAdapted from Hirsch, Smale & Devaney (2013), §10.2, proof of the Proposition, p. 218

Define G(x,t)=g(ϕt(x))G(x,t) = g(\phi_t(x)) on a neighbourhood of (x∗,T)(x^*, T) in U×RU\times\mathbb{R}. The flow is continuously differentiable in both arguments, by smooth dependence on initial data, and so is gg; hence GG is continuously differentiable.

  • The equation holds at the known point. G(x∗,T)=g(ϕT(x∗))=g(x∗)=0G(x^*,T) = g(\phi_T(x^*)) = g(x^*) = 0, because x∗x^* has period TT and lies on SS.

  • The tt-derivative is nonzero there. By the chain rule and ddtϕt(x)=f(ϕt(x))\frac{d}{dt}\phi_t(x) = f(\phi_t(x)),

    ∂G∂t(x∗,T)  =  ∇g(ϕT(x∗))⋅f(ϕT(x∗))  =  ∇g(x∗)⋅f(x∗)  ≠  0,\frac{\partial G}{\partial t}(x^*,T) \;=\; \nabla g\bigl(\phi_T(x^*)\bigr)\cdot f\bigl(\phi_T(x^*)\bigr) \;=\; \nabla g(x^*)\cdot f(x^*) \;\neq\; 0 ,

    which is exactly the transversality hypothesis at x∗x^*. This is the only place it is used, and without it the argument stops here.

By the implicit function theorem there are a neighbourhood V0V_0 of x∗x^* in UU and a continuously differentiable τ:V0→R\tau : V_0 \to \mathbb{R} with τ(x∗)=T\tau(x^*) = T and G(x,τ(x))≡0G(x,\tau(x)) \equiv 0, that is, ϕτ(x)(x)∈S\phi_{\tau(x)}(x) \in S. Put V=V0∩SV = V_0 \cap S.

It remains to check that τ(x)\tau(x) is the first return, not a later one. Two facts combine. First, trajectories leave SS immediately: since ddtg(ϕt(x))=∇g⋅f≠0\frac{d}{dt}g(\phi_t(x)) = \nabla g\cdot f \neq 0 on SS and this quantity is continuous, there is σ>0\sigma > 0 and a neighbourhood of x∗x^* on which t↦g(ϕt(x))t \mapsto g(\phi_t(x)) is strictly monotone for ∣t∣≤σ|t| \le \sigma; so no point near x∗x^* meets SS at a time in (0,σ](0,\sigma]. Second, on the compact time interval [σ,T−σ][\sigma, T-\sigma] the orbit of x∗x^* stays at a positive distance dd from SS, because it does not meet SS there and both sets are closed in the relevant compacta; by continuity of (x,t)↦ϕt(x)(x,t)\mapsto\phi_t(x) on the compact set {x∗}×[σ,T−σ]\{x^*\}\times[\sigma,T-\sigma], every xx close enough to x∗x^* keeps its orbit within d/2d/2 of that of x∗x^* on [σ,T−σ][\sigma,T-\sigma] and so also misses SS there. Shrinking VV to the intersection of these neighbourhoods, τ(x)\tau(x) is the first positive return time, and P=ϕτ(⋅)(⋅)P = \phi_{\tau(\cdot)}(\cdot) is continuously differentiable on VV as a composite of continuously differentiable maps. □\square

Proof(Parts 2-4: stability)AdaptedAdapted from Hirsch, Smale & Devaney (2013), §10.3, p. 219; Strogatz (1994), §8.7, pp. 281-282

An adapted norm. Write A=DP(x∗)A = DP(x^*), acting on the (n−1)(n-1)-dimensional space E=Tx∗SE = T_{x^*}S, and let ρ(A)=max⁡j∣λj∣\rho(A) = \max_j|\lambda_j| be its spectral radius. We use: for every ρ>ρ(A)\rho > \rho(A) there is a norm ∥⋅∥∗\|\cdot\|_* on EE with ∥Av∥∗≤ρ∥v∥∗\|Av\|_* \le \rho\|v\|_* for all vv. To see this, put AA in Jordan form, A=QJQ−1A = Q J Q^{-1}, and rescale the basis vectors of each Jordan block by successive powers of δ=ρ−ρ(A)>0\delta = \rho - \rho(A) > 0; in the rescaled basis the superdiagonal entries become δ\delta instead of 11, and the resulting matrix has every row sum of moduli at most ρ(A)+δ=ρ\rho(A)+\delta = \rho, so the induced maximum norm of AA is at most ρ\rho. (For complex eigenvalues work over C\mathbb{C} and take the real part of the resulting norm; the bound is unchanged.)

Part 2. Suppose ρ(A)<1\rho(A) < 1 and fix ρ\rho with ρ(A)<ρ<1\rho(A) < \rho < 1; take ∥⋅∥∗\|\cdot\|_* as above and set ρ′=(1+ρ)/2<1\rho' = (1+\rho)/2 < 1. Since PP is continuously differentiable at x∗x^*,

P(x)−x∗  =  A (x−x∗)+o(∥x−x∗∥∗),P(x) - x^* \;=\; A\,(x - x^*) + o\bigl(\|x - x^*\|_*\bigr) ,

so there is δ>0\delta > 0 such that ∥P(x)−x∗∥∗≤ρ′∥x−x∗∥∗\|P(x) - x^*\|_* \le \rho' \|x - x^*\|_* whenever ∥x−x∗∥∗≤δ\|x-x^*\|_* \le \delta and x∈Sx \in S. The ball B={x∈S:∥x−x∗∥∗≤δ}B = \{x \in S: \|x - x^*\|_* \le \delta\} is therefore mapped into itself, and by induction

∥Pk(x)−x∗∥∗  ≤  (ρ′)k ∥x−x∗∥∗⟶0.\|P^k(x) - x^*\|_* \;\le\; (\rho')^k\,\|x - x^*\|_* \longrightarrow 0 .

So x∗x^* attracts every point of BB under PP, geometrically.

This is a statement about the discrete times at which a trajectory crosses SS; the continuous-time statement follows from it. The return times τ\tau are continuous and τ(x∗)=T\tau(x^*) = T, so after shrinking δ\delta we may assume T/2≤τ≤2TT/2 \le \tau \le 2T on BB. Every trajectory starting at a point x∈Bx \in B therefore consists of the arcs {ϕt(Pk(x)):0≤t≤τ(Pk(x))}\{\phi_t(P^k(x)) : 0 \le t \le \tau(P^k(x))\}, k=0,1,2,…k = 0,1,2,\dots, laid end to end. Each arc starts within (ρ′)kδ(\rho')^k\delta of x∗x^* and lasts at most 2T2T; by continuous dependence on initial data over the bounded time interval [0,2T][0,2T], for every ε>0\varepsilon > 0 there is η>0\eta > 0 such that starting within η\eta of x∗x^* keeps the whole arc within ε\varepsilon of the corresponding arc of γ\gamma, hence within ε\varepsilon of γ\gamma. Since (ρ′)kδ→0(\rho')^k\delta \to 0, all but finitely many arcs are within ε\varepsilon of γ\gamma, and the finitely many early ones are within ε\varepsilon too once δ\delta is chosen below the η\eta belonging to ε\varepsilon. Thus the trajectory stays in the ε\varepsilon-neighbourhood NN of γ\gamma and its distance to γ\gamma tends to 00.

Finally, a point of NN not on SS flows to SS in time at most 2T2T provided NN is thin enough, by the flow-box argument of part 1 applied around each point of γ\gamma and compactness of γ\gamma; so the conclusion covers a full neighbourhood of γ\gamma and not merely of x∗x^*.

Part 3. For n=2n = 2 the section is a segment, EE is one-dimensional and AA is the number P′(x∗)P'(x^*). Part 2 gives the attracting case. For ∣P′(x∗)∣>1|P'(x^*)| > 1, the source half of the multiplier criterion of One-dimensional maps says that every orbit of PP other than x∗x^* itself leaves a fixed neighbourhood of x∗x^* in SS; since points of SS near x∗x^* are points near γ\gamma, γ\gamma is not stable.

Part 4. The logistic examples recorded in One-dimensional maps already show, for n=2n = 2, that a multiplier of modulus 11 is compatible with an attracting, a repelling and a one-sided closed orbit, so no criterion phrased in DP(x∗)DP(x^*) alone can decide. □\square

Proof(The multiplier theorem)Original

Write v=f(x∗)v = f(x^*), which is nonzero because γ\gamma is a nonconstant periodic orbit, and E=Tx∗S=ker⁡∇g(x∗)E = T_{x^*}S = \ker\nabla g(x^*). Transversality says ∇g(x∗)⋅v≠0\nabla g(x^*)\cdot v \neq 0, that is, v∉Ev \notin E; since dim⁡E=n−1\dim E = n-1, this gives the direct sum

Rn  =  Rv ⊕ E.\mathbb{R}^n \;=\; \mathbb{R}v \,\oplus\, E .

The monodromy matrix fixes the flow direction. Differentiating γ˙=f(γ)\dot\gamma = f(\gamma) in tt shows that t↦f(γ(t))t\mapsto f(\gamma(t)) solves the variational equation; it equals vv at t=0t=0, so Φ(t)v=f(γ(t))\Phi(t)v = f(\gamma(t)) and in particular

Mv  =  Φ(T)v  =  f(γ(T))  =  f(x∗)  =  v.Mv \;=\; \Phi(T)v \;=\; f(\gamma(T)) \;=\; f(x^*) \;=\; v .

The monodromy matrix on EE. Let w∈Ew \in E, and differentiate P(x)=ϕτ(x)(x)P(x) = \phi_{\tau(x)}(x) at x∗x^* in the direction ww by the chain rule, using τ(x∗)=T\tau(x^*) = T and ∂tϕt(x∗)∣t=T=f(x∗)=v\partial_t\phi_t(x^*)|_{t=T} = f(x^*) = v:

DP(x∗) w  =  DxϕT(x∗)⏟=  Φ(T)  =  M w  +  v (Dτ(x∗)w).DP(x^*)\,w \;=\; \underbrace{D_x\phi_T(x^*)}_{=\;\Phi(T)\;=\;M}\,w \;+\; v\,\bigl(D\tau(x^*)w\bigr) .

(The identity DxϕT(x∗)=Φ(T)D_x\phi_T(x^*) = \Phi(T) is the definition of the variational equation: the derivative of the flow with respect to its initial point solves it with the identity as initial value.) Writing c(w)=Dτ(x∗)wc(w) = D\tau(x^*)w, a linear functional on EE, this rearranges to

Mw  =  −c(w) v  +  DP(x∗) w,w∈E.M w \;=\; -c(w)\,v \;+\; DP(x^*)\,w , \qquad w \in E .

Reading off the matrix. In a basis consisting of vv followed by a basis of EE, the two displays say that MM has the block form

M  =  (1−c0DP(x∗)),M \;=\; \begin{pmatrix} 1 & -c \\ 0 & DP(x^*)\end{pmatrix} ,

upper block triangular, because Mv=vMv = v has no EE-component and MwMw has EE-component DP(x∗)wDP(x^*)w. The characteristic polynomial of a block triangular matrix is the product of those of its diagonal blocks, which is part 1; taking determinants gives det⁡M=det⁡DP(x∗)\det M = \det DP(x^*).

Part 2. By Floquet theory (Floquet theory) the eigenvalues of the monodromy matrix of a periodic linear system are unchanged if the fundamental matrix is normalised at a different time: replacing the base point γ(0)\gamma(0) by γ(s)\gamma(s) replaces MM by a matrix similar to it. The eigenvalues of MM are therefore an attribute of γ\gamma alone. Part 1 identifies the eigenvalues of DP(x∗)DP(x^*) as those of MM with one copy of 11 removed, and nothing in that list refers to SS or to the coordinates on it. Hence the λj\lambda_j are attributes of γ\gamma alone. (That one copy of 11 is removed and not more is the content of the factorisation: if 11 happens to be an eigenvalue of DP(x∗)DP(x^*) as well, then MM has 11 as an eigenvalue of algebraic multiplicity at least two, and the trivial multiplier is still a single factor μ−1\mu - 1.)

Part 3. Liouville's formula for the variational equation — derived in Lyapunov exponents — gives

det⁡Φ(t)  =  exp⁡∫0ttr⁡Df(γ(s)) ds  =  exp⁡∫0t∇⋅f(γ(s)) ds,\det\Phi(t) \;=\; \exp\int_0^t \operatorname{tr}Df\bigl(\gamma(s)\bigr)\,ds \;=\; \exp\int_0^t \nabla\cdot f\bigl(\gamma(s)\bigr)\,ds ,

since the trace of the Jacobian is the divergence. At t=Tt = T the left side is det⁡M=det⁡DP(x∗)=∏jλj\det M = \det DP(x^*) = \prod_j \lambda_j. For n=2n = 2 the product is a single multiplier. If ∇⋅f≡−k\nabla\cdot f \equiv -k then the product is e−kTe^{-kT}, which for k>0k>0 is less than 11 in modulus, so not all ∣λj∣|\lambda_j| can be ≥1\ge 1. □\square

Remark(Where the hypotheses are used)Original
  • Transversality is used exactly twice, and both uses are essential. It makes ∂tG≠0\partial_t G \neq 0, which is what the implicit function theorem needs to produce the return time; and it makes f(x∗)∉Tx∗Sf(x^*) \notin T_{x^*}S, which is what splits Rn\mathbb{R}^n into the flow direction and the section and so block-triangularises MM. A section tangent to the flow at some point gives no return map near that point: trajectories can touch it and turn back, so "the next crossing" is not even locally well defined.
  • f(x∗)≠0f(x^*) \neq 0, that is, the orbit is a genuine closed orbit and not an equilibrium. Without it v=0v = 0, the splitting collapses, and there is no trivial multiplier to remove.
  • Least period TT. If TT is taken as a multiple kT0kT_0 of the least period, the orbit crosses SS kk times in a circuit, x∗x^* is a kk-cycle of PP rather than a fixed point, and the multipliers come out as kk-th powers. The statements above are for a section crossed once per circuit.
  • C1C^1 and no more. Only continuous differentiability of ff and gg is used; PP is then C1C^1, which is all the stability argument needs. If ff is CrC^r so is PP, by the same implicit function theorem.
  • What part 2 does not say. It gives attraction when all ∣λj∣<1|\lambda_j| < 1. The converse at the nonlinear level — that some ∣λj∣>1|\lambda_j| > 1 forces instability — is true but needs an invariant-manifold argument that we do not give; what is immediate is the linear statement, that the recursion vk+1=DP(x∗)vkv_{k+1} = DP(x^*)v_k then has geometrically growing solutions. In the plane there is no gap, because part 3 reduces the question to a map of an interval, where both directions are proved.
  • Orbital, not pointwise. Even for a strongly attracting limit cycle, a nearby trajectory does not converge to γ(t)\gamma(t) for the same tt; it converges to the set γ\gamma, generally with a persistent phase lag. That is why the trivial multiplier is 11 and not something smaller: a phase shift is neither damped nor amplified.
Method(Using a section)AdaptedAdapted from Strogatz (1994), §8.7, pp. 278-283; Hirsch, Smale & Devaney (2013), §10.3, pp. 219-220

To study a suspected closed orbit of x˙=f(x)\dot x = f(x):

  1. Choose the section. Pick a hypersurface S={g=0}S = \{g = 0\} that the orbit must cross and check ∇g⋅f≠0\nabla g\cdot f \neq 0 on the part of SS you will use. Natural choices: a half-plane {θ=θ0}\{\theta = \theta_0\} for a system that circulates; the set where one coordinate is at a maximum, {z˙=0, z¨<0}\{\dot z = 0,\ \ddot z<0\}; and, for a TT-periodic forcing, the stroboscopic section {t≡0 mod T}\{t \equiv 0 \bmod T\}, which is transverse automatically.
  2. Integrate to the next crossing. From x∈Sx \in S, integrate x˙=f(x)\dot x = f(x) until gg changes sign, then locate the crossing time accurately by solving g(ϕt(x))=0g(\phi_t(x)) = 0 — for instance by Newton's method on tt, whose derivative ∇g⋅f\nabla g\cdot f is the transversality quantity and so is nonzero. This evaluates P(x)P(x).
  3. Find the fixed point. Solve P(x)=xP(x) = x on SS, numerically if need be; n−1n-1 equations in n−1n-1 unknowns. Each solution is a closed orbit.
  4. Get DPDP. Either integrate the variational equation Φ˙=Df(ϕt(x))Φ\dot\Phi = Df(\phi_t(x))\Phi alongside the trajectory and project, or difference PP: form [P(x∗+hei)−P(x∗−hei)]/2h[P(x^*+h e_i) - P(x^*-h e_i)]/2h for a basis eie_i of Tx∗ST_{x^*}S.
  5. Read off the stability from the eigenvalues of DP(x∗)DP(x^*): attracting if all lie strictly inside the unit circle, bifurcating when one reaches it. A multiplier leaving through +1+1 signals a saddle-node or pitchfork of cycles, through −1-1 a period doubling of the cycle, and a complex pair crossing together a torus (Neimark-Sacker) bifurcation.
  6. Check the determinant. Compare ∏jλj\prod_j\lambda_j with exp⁡∫0T∇⋅f dt\exp\int_0^T\nabla\cdot f\,dt computed along the orbit. For a system of constant divergence this is a one-line check that catches most integration errors; in the plane it replaces step 4 entirely.
Example(A return map in closed form, and its multiplier two ways)Original

On the punctured plane U=R2∖{0}U = \mathbb{R}^2\setminus\{0\}, in polar coordinates, take

r˙  =  − rln⁡r,θ˙  =  1.\dot r \;=\; -\,r\ln r, \qquad \dot\theta \;=\; 1 .

The field is continuously differentiable on UU (it is not defined at the origin, which is why the origin is excluded). Take SS to be the positive xx-axis, g(x,y)=yg(x,y) = y restricted to x>0x>0; then ∇g⋅f=y˙=r˙sin⁡θ+rθ˙cos⁡θ=r>0\nabla g\cdot f = \dot y = \dot r\sin\theta + r\dot\theta\cos\theta = r > 0 on SS, so SS is transverse and every trajectory returns to it after exactly τ≡2π\tau \equiv 2\pi, since θ˙=1\dot\theta = 1.

The return map. Substituting u=ln⁡ru = \ln r turns the radial equation into u˙=−u\dot u = -u, so u(t)=u0e−tu(t) = u_0e^{-t} and r(t)=r0 e−tr(t) = r_0^{\,e^{-t}}. Therefore, with κ=e−2π\kappa = e^{-2\pi},

P(r)  =  r κ,κ  =  e−2π  =  0.00186744273…P(r) \;=\; r^{\,\kappa}, \qquad \kappa \;=\; e^{-2\pi} \;=\; 0.00186744273\ldots

The closed orbit. P(r)=rP(r) = r forces rκ−1=1r^{\kappa-1} = 1, hence r=1r = 1: the unit circle is the only closed orbit, and it has period T=2πT = 2\pi.

The multiplier, from the map. P′(r)=κrκ−1P'(r) = \kappa r^{\kappa-1}, so

λ  =  P′(1)  =  κ  =  e−2π  =  0.00186744273.\lambda \;=\; P'(1) \;=\; \kappa \;=\; e^{-2\pi} \;=\; 0.00186744273 .

Since 0<λ<10 < \lambda < 1, the circle is an attracting limit cycle, approached monotonically from each side.

The multiplier, from the divergence. The divergence in polar coordinates is ∇⋅f=r−1∂r(rFr)+r−1∂θFθ\nabla\cdot f = r^{-1}\partial_r(rF_r) + r^{-1}\partial_\theta F_\theta with Fr=−rln⁡rF_r = -r\ln r and Fθ=rθ˙=rF_\theta = r\dot\theta = r, so

∇⋅f  =  1r ddr(−r2ln⁡r)  =  −2ln⁡r−1,\nabla\cdot f \;=\; \frac1r\,\frac{d}{dr}\bigl(-r^2\ln r\bigr) \;=\; -2\ln r - 1 ,

which equals −1-1 on the orbit r=1r=1. Part 3 of the multiplier theorem then predicts

λ  =  exp⁡∫02π(−1) dt  =  e−2π,\lambda \;=\; \exp\int_0^{2\pi}(-1)\,dt \;=\; e^{-2\pi} ,

the same number, obtained without knowing PP. This is the check of step 6, passed exactly.

Iterating the map. The cobweb recipe of One-dimensional maps applies to PP verbatim. Because ln⁡P(r)=κln⁡r\ln P(r) = \kappa\ln r, the logarithms of the successive crossings are exactly geometric, ln⁡rk=κkln⁡r0\ln r_k = \kappa^k\ln r_0. From r0=3r_0 = 3:

r1=1.0020537015,r2=1.0000038312,r3=1.0000000072,r4=1.0000000000134,r_1 = 1.0020537015,\quad r_2 = 1.0000038312,\quad r_3 = 1.0000000072,\quad r_4 = 1.0000000000134 ,

each excess over 11 being about κ=1.87×10−3\kappa = 1.87\times10^{-3} times the previous one, as the multiplier says. Integrating the Cartesian form of the system numerically from (3,0)(3,0) over [0,2π][0,2\pi] returns (1.00205370150,−7×10−13)(1.00205370150, -7\times10^{-13}), agreeing with r1r_1 to eleven digits and confirming the return time.

Example(A forced oscillator: the multiplier without the orbit)Original

Now a case where the closed orbit cannot be written down but the multiplier can. Consider the 2π2\pi-periodically forced equation

x˙  =  (1+cos⁡t) x  −  x3,x>0,\dot x \;=\; (1 + \cos t)\,x \;-\; x^3 , \qquad x > 0 ,

a logistic-type growth whose growth rate is modulated once per period. Use the stroboscopic section S={t≡0 mod 2π}S = \{t \equiv 0 \bmod 2\pi\}, on which the return time is τ≡T=2π\tau \equiv T = 2\pi.

Finding the fixed point. The equation is a Bernoulli equation: u=x−2u = x^{-2} obeys the linear equation

u˙  =  −2(1+cos⁡t) u+2,\dot u \;=\; -2(1+\cos t)\,u + 2 ,

whose integrating factor is eμ(t)e^{\mu(t)} with μ(t)=2t+2sin⁡t\mu(t) = 2t + 2\sin t. Since μ(2π)=4π\mu(2\pi) = 4\pi and μ(0)=0\mu(0)=0,

u(2π)  =  e−4πu(0)+K,K=e−4π ⁣ ⁣∫02π ⁣ ⁣2 e2s+2sin⁡s ds  =  0.52781657316.u(2\pi) \;=\; e^{-4\pi}u(0) + K, \qquad K = e^{-4\pi}\!\!\int_0^{2\pi}\!\! 2\,e^{2s+2\sin s}\,ds \;=\; 0.52781657316 .

So in the variable uu the stroboscopic map is the affine map u↦e−4πu+Ku \mapsto e^{-4\pi}u + K, with the unique fixed point

u∗  =  K1−e−4π  =  0.52781841384,x∗  =  (u∗)−1/2  =  1.37644141493.u^* \;=\; \frac{K}{1 - e^{-4\pi}} \;=\; 0.52781841384 , \qquad x^* \;=\; (u^*)^{-1/2} \;=\; 1.37644141493 .

There is therefore exactly one 2π2\pi-periodic solution with x>0x>0, and it passes through x=1.37644141493x = 1.37644141493 at t=0t = 0.

The multiplier. The map x↦u=x−2x\mapsto u = x^{-2} is a diffeomorphism of (0,∞)(0,\infty), so it conjugates the stroboscopic map in xx to the affine map in uu, and a multiplier is unchanged by a smooth change of variable. Hence

λ  =  e−4π  =  3.4873423562×10−6,\lambda \;=\; e^{-4\pi} \;=\; 3.4873423562\times10^{-6} ,

far inside the unit circle: the periodic solution is violently attracting, which is why a numerical integration from almost any positive initial value looks periodic after one cycle.

Three checks. (i) Integrating the original equation from x(0)=1.37644141493x(0) = 1.37644141493 over one period returns 1.37644141493021.3764414149302, reproducing the starting value to thirteen digits. (ii) Integrating the variational equation v˙=[(1+cos⁡t)−3x(t)2]v\dot v = \bigl[(1+\cos t) - 3x(t)^2\bigr]v along that solution with v(0)=1v(0)=1 gives v(2π)=3.48734235622×10−6v(2\pi) = 3.48734235622\times10^{-6}, matching e−4πe^{-4\pi} to eleven digits — this is the divergence formula of part 3, since for the one-dimensional nonautonomous equation the bracket is the divergence. (iii) The periodic solution oscillates between 0.519560.51956 and 1.397731.39773 over the cycle, so the forcing is far from a small perturbation, yet the multiplier is exactly e−4πe^{-4\pi}: the two e−2πe^{-2\pi}-sized factors come from the mean growth rate 11 and the mean of −3x2-3x^2 along the orbit, and the modulation cos⁡t\cos t averages away.

ApplicationOriginal

A surface of section is the standard way to see a flow of three or more dimensions, because it trades one dimension of picture for one of integer time.

In mechanics. For a Hamiltonian system of two degrees of freedom the energy surface is three-dimensional, and a section of it is a two-dimensional picture in which a periodic orbit is a point, a quasiperiodic orbit an invariant curve, and a chaotic orbit a scatter of dots. This is the construction behind every Poincare-section plot of the Henon-Heiles system or of the restricted three-body problem; the multipliers of a periodic orbit come in reciprocal pairs there, because a Hamiltonian flow has zero divergence and part 3 forces the product to be 11.

In forced oscillators and circuits. The stroboscopic map turns a driven system into a map, and the bifurcations of the driven response are bifurcations of its fixed points: a multiplier leaving through −1-1 is the period doubling that halves the observed frequency, and a cascade of these is the route to chaos described in Period doubling and universality. The same reduction applied to a strongly dissipative flow, where all but one multiplier are tiny, is what makes a one-dimensional map a faithful model of a three-dimensional flow — the justification for studying the logistic map at all, and the step Lorenz took when he plotted successive maxima of zz for his equations.

In experiment and in numerics. Shaft-angle triggers in rotating machinery, the once-per-orbit crossings recorded in accelerator physics, and the fixed-step sampling of an experimental time series are all Poincare sections taken by the apparatus rather than by the analyst; the measured return map is then fitted directly. On the numerical side, steps 2-5 of the method are exactly how a periodic-orbit solver works: Newton's method on P(x)−xP(x)-x, with the Jacobian supplied by the variational equation, converges quadratically to closed orbits that a plain time integration would take thousands of periods to reveal — or would never reveal at all, if the orbit is unstable.

Definition

Fractals and dimension

Adapted

Defines the similarity, box and correlation dimensions, proves that a set built by keeping mm of the rDr^D subcubes of a cube at every stage has box dimension ln⁡m/ln⁡r\ln m/\ln r — so the middle-thirds Cantor set, which is also shown to be compact, totally disconnected, uncountable and of measure zero, has dimension 0.63090.6309 — and tests the theorem against a box count of a planar dust of dimension ln⁡6/ln⁡4=1.2925\ln 6/\ln 4 = 1.2925.

Prerequisites: One-dimensional maps, Sets, functions and countability, Compactness, Lebesgue measure

Definition(Self-similarity, and three dimensions)AdaptedAdapted from Strogatz (1994), §11.3, pp. 406-408, and §11.4, pp. 409-410, and §11.5, pp. 411-412; Folland (1999), §11.3, pp. 355-356, 359

A similitude of ratio s∈(0,1)s \in (0,1) is a map S:RD→RDS : \mathbb{R}^D \to \mathbb{R}^D of the form S(x)=s Ox+cS(x) = s\,O x + c with OO orthogonal. A nonempty compact set FF is self-similar with mm pieces of ratio ss if there are similitudes S1,…,SmS_1,\dots,S_m of ratio ss with

F  =  S1(F)∪⋯∪Sm(F),F \;=\; S_1(F)\cup\dots\cup S_m(F) ,

the pieces overlapping only negligibly. Iterating, FF is a union of mkm^k copies of itself at ratio sks^k, so it has detail at every scale: magnifying a small piece reproduces the whole. Writing s=1/rs = 1/r, the similarity dimension of FF is the exponent dd for which mm copies at ratio 1/r1/r make up one copy at ratio 11, that is m=rdm = r^d:

dsim  =  ln⁡mln⁡r.d_{\text{sim}} \;=\; \frac{\ln m}{\ln r} .

For a segment (m=rm=r), a square (m=r2m=r^2) and a cube (m=r3m=r^3) this returns 11, 22 and 33, which is the reason for the definition; for the sets below it returns a number that is not an integer.

Self-similarity is special, so one wants a definition that applies to any bounded set. Let F⊆RDF \subseteq \mathbb{R}^D be bounded and nonempty and, for ε>0\varepsilon > 0, let

N(ε)  =  the least number of cubes of side ε whose union contains F.N(\varepsilon) \;=\; \text{the least number of cubes of side } \varepsilon \text{ whose union contains } F .

A smooth curve of length LL needs N≈L/εN \approx L/\varepsilon cubes and a smooth surface of area AA needs N≈A/ε2N \approx A/\varepsilon^2: the exponent in N(ε)∝ε−dN(\varepsilon) \propto \varepsilon^{-d} is the dimension. Taking that as the definition, the box dimension (also called the capacity) is

dbox  =  lim⁡ε→0+ln⁡N(ε)ln⁡(1/ε),d_{\text{box}} \;=\; \lim_{\varepsilon\to0^+} \frac{\ln N(\varepsilon)}{\ln(1/\varepsilon)} ,

when the limit exists. Counting instead the cubes of a fixed mesh of side ε\varepsilon that contain a point of FF changes N(ε)N(\varepsilon) by at most the factor 2D2^D — each mesh cube that meets FF is covered, and each covering cube meets at most 2D2^D mesh cubes — and a bounded factor does not survive division by ln⁡(1/ε)\ln(1/\varepsilon). So the mesh count, which is what a computer does, gives the same dimension.

Finally, a definition for a set that carries a dynamics. Let AA be an attractor and x0,x1,…,xn−1x_0, x_1, \dots, x_{n-1} a long trajectory on it. Fix a point xx of AA and let Nx(ε)N_x(\varepsilon) be the number of trajectory points within distance ε\varepsilon of xx; the pointwise dimension at xx is the exponent in Nx(ε)∝εdN_x(\varepsilon)\propto\varepsilon^{d}. Averaging over xx gives the correlation sum

C(ε)  =  #{(i,j):i≠j, ∣xi−xj∣<ε}n(n−1),C(\varepsilon) \;=\; \frac{\#\{(i,j) : i\neq j,\ |x_i - x_j| < \varepsilon\}}{n(n-1)} ,

and the correlation dimension dcorrd_{\text{corr}} is the exponent in C(ε)∝ε dcorrC(\varepsilon)\propto\varepsilon^{\,d_{\text{corr}}}, read off as the slope of ln⁡C\ln C against ln⁡ε\ln\varepsilon. Unlike the box dimension it weights a region by how often the trajectory visits it, so it describes the invariant measure on AA and not only the set; Strogatz records that in general dcorr≤dboxd_{\text{corr}} \le d_{\text{box}}, usually with little between them.

A closed set FF is a topological Cantor set if it is totally disconnected — its only connected subsets are single points, which for a subset of R\mathbb{R} means it contains no interval — and has no isolated point: every point of FF has other points of FF arbitrarily close. The two conditions pull in opposite directions, and that tension is what a Cantor set is. Neither mentions dimension or self-similarity, so the notion survives the continuous deformations under which those are destroyed.

Definition(Grid constructions)Original

All the explicit sets below are built the same way. Fix an integer r≥2r \ge 2, a dimension D≥1D \ge 1, and divide the unit cube Q0=[0,1]DQ_0 = [0,1]^D into rDr^D closed subcubes of side 1/r1/r in the obvious grid. Choose mm of them, say the cubes with lower corners c1/r,…,cm/rc_1/r, \dots, c_m/r where each ci∈{0,1,…,r−1}Dc_i \in \{0,1,\dots,r-1\}^D, and let

Si(x)  =  x+cir,i=1,…,m,S_i(x) \;=\; \frac{x + c_i}{r}, \qquad i = 1,\dots,m ,

so that Si(Q0)S_i(Q_0) is the ii-th chosen cube. Put F0=Q0F_0 = Q_0 and Fk+1=S1(Fk)∪⋯∪Sm(Fk)F_{k+1} = S_1(F_k)\cup\dots\cup S_m(F_k), and define the grid set

F  =  ⋂k≥0Fk.F \;=\; \bigcap_{k\ge0} F_k .

Thus FkF_k is a union of mkm^k closed cubes of side r−kr^{-k} — call them the stage-kk cubes — each stage-kk cube contains exactly mm stage-(k+1)(k+1) cubes, and distinct stage-kk cubes have disjoint interiors. The middle-thirds Cantor set CC is the case D=1D=1, r=3r=3, m=2m=2, c1=0c_1 = 0, c2=2c_2 = 2: remove the open middle third of [0,1][0,1], then of each remaining interval, and so on.

Definition(Grid sets and their dimension)Original

Let FF be a grid set as above, with 1≤m≤rD1 \le m \le r^D and the cic_i distinct.

  1. (FF is a self-similar compact set.) FF is nonempty and compact, F=S1(F)∪⋯∪Sm(F)F = S_1(F)\cup\dots\cup S_m(F), and the SiS_i are similitudes of ratio 1/r1/r whose images meet only in sets of Lebesgue measure zero. Every stage-kk cube contains at least one point of FF.

  2. (Box dimension.) The limit defining dboxd_{\text{box}} exists and

    dbox(F)  =  ln⁡mln⁡r  =  dsim(F).d_{\text{box}}(F) \;=\; \frac{\ln m}{\ln r} \;=\; d_{\text{sim}}(F) .
  3. (Measure.) The Lebesgue measure of FF is lim⁡kmkr−kD\lim_k m^k r^{-kD}, which is 00 if m<rDm < r^D and 11 if m=rDm = r^D (in which case F=Q0F = Q_0).

  4. (Cardinality and topology, for m≥2m \ge 2.) FF is uncountable. If moreover no two chosen cubes touch — as happens for the middle-thirds Cantor set, where the two chosen intervals [0,13][0,\frac13] and [23,1][\frac23,1] are disjoint — then FF is a topological Cantor set.

Specialising to D=1D=1, r=3r=3, m=2m=2: the Cantor set CC is a compact topological Cantor set of Lebesgue measure zero, is uncountable, and has

dbox(C)  =  ln⁡2ln⁡3  =  0.6309297536.d_{\text{box}}(C) \;=\; \frac{\ln 2}{\ln 3} \;=\; 0.6309297536 .
Idea of the proofOriginal

The covering number is handed to us at the special scales ε=r−k\varepsilon = r^{-k}: the mkm^k stage-kk cubes cover FF, so N(r−k)≤mkN(r^{-k}) \le m^k, and since each of them contains a point of FF and a cube of side r−kr^{-k} can straddle at most 2D2^D cells of the stage-kk grid, N(r−k)≥mk/2DN(r^{-k}) \ge m^k/2^D. Both bounds give ln⁡N/ln⁡(1/ε)=ln⁡m/ln⁡r\ln N/\ln(1/\varepsilon) = \ln m/\ln r up to a term of order 1/k1/k. Intermediate scales are squeezed between two consecutive special ones, and the squeeze costs only a factor mm and a shift of one in kk, neither of which survives the limit.

The measure and the cardinality need no more than the construction: the areas multiply by m/rDm/r^D at each stage, and the stage-kk cube containing a point of FF records a choice of one of mm branches, so FF is coded by infinite words in mm letters.

ProofOriginal

Part 1. Each FkF_k is a finite union of closed cubes, hence compact, and Fk+1⊆FkF_{k+1}\subseteq F_k: indeed F1⊆F0F_1 \subseteq F_0 because the chosen subcubes lie in Q0Q_0, and applying the (inclusion-preserving) operation E↦⋃iSi(E)E \mapsto \bigcup_i S_i(E) repeatedly keeps the inclusion. So FF is an intersection of a nested sequence of nonempty compact sets, hence compact and nonempty (Compactness). The same argument inside a fixed stage-kk cube QQ shows that Q∩F≠∅Q\cap F \neq \emptyset: the sets Q∩Fk+jQ \cap F_{k+j}, j≥0j \ge 0, are nonempty — each stage-(k+j)(k+j) cube inside QQ contains m≥1m\ge1 stage-(k+j+1)(k+j+1) cubes — compact and nested.

For self-similarity, Si(F)=Si(⋂kFk)=⋂kSi(Fk)S_i(F) = S_i\bigl(\bigcap_k F_k\bigr) = \bigcap_k S_i(F_k), because SiS_i is injective; hence

⋃i=1mSi(F)  =  ⋃i⋂kSi(Fk)  =  ⋂k⋃iSi(Fk)  =  ⋂kFk+1  =  F,\bigcup_{i=1}^m S_i(F) \;=\; \bigcup_i \bigcap_k S_i(F_k) \;=\; \bigcap_k \bigcup_i S_i(F_k) \;=\; \bigcap_k F_{k+1} \;=\; F ,

where the middle exchange of union and intersection is legitimate because the sequences Si(Fk)S_i(F_k) are nested in kk and the union is finite. Each SiS_i is a similitude of ratio 1/r1/r with O=IO = I. Two distinct images Si(F)S_i(F), Sj(F)S_j(F) lie in distinct stage-11 cubes, which meet at most in a common face, a set of Lebesgue measure zero.

Part 2. Fix kk and put ε=r−k\varepsilon = r^{-k}.

  • Upper bound. The mkm^k stage-kk cubes have side ε\varepsilon and cover FF, so N(ε)≤mkN(\varepsilon) \le m^k.
  • Lower bound. Let cubes B1,…,BNB_1,\dots,B_N of side ε\varepsilon cover FF. Consider the grid of all rkDr^{kD} cells of side ε\varepsilon in Q0Q_0. In each coordinate, an interval of length ε\varepsilon meets at most two of the grid intervals of length ε\varepsilon, so each BlB_l meets at most 2D2^D grid cells. The mkm^k stage-kk cubes are grid cells and each contains a point of FF by part 1, so each must be met by at least one BlB_l. Counting the pairs (stage-kk cube, covering cube that meets it) in two ways gives mk≤2DNm^k \le 2^D N, that is N(ε)≥2−DmkN(\varepsilon) \ge 2^{-D}m^k.

Therefore

kln⁡m−Dln⁡2kln⁡r  ≤  ln⁡N(r−k)ln⁡(rk)  ≤  kln⁡mkln⁡r,\frac{k\ln m - D\ln 2}{k\ln r} \;\le\; \frac{\ln N(r^{-k})}{\ln(r^{k})} \;\le\; \frac{k \ln m}{k\ln r} ,

and both ends tend to ln⁡m/ln⁡r\ln m/\ln r as k→∞k\to\infty.

Now let ε\varepsilon be arbitrary and let kk be the integer with r−(k+1)<ε≤r−kr^{-(k+1)} < \varepsilon \le r^{-k}. Covering numbers are non-increasing in the size of the covering cube, so N(r−k)≤N(ε)≤N(r−(k+1))N(r^{-k}) \le N(\varepsilon) \le N(r^{-(k+1)}), while kln⁡r≤ln⁡(1/ε)<(k+1)ln⁡rk\ln r \le \ln(1/\varepsilon) < (k+1)\ln r. Combining with the two displayed bounds,

kln⁡m−Dln⁡2(k+1)ln⁡r  ≤  ln⁡N(ε)ln⁡(1/ε)  ≤  (k+1)ln⁡mkln⁡r,\frac{k\ln m - D\ln 2}{(k+1)\ln r} \;\le\; \frac{\ln N(\varepsilon)}{\ln(1/\varepsilon)} \;\le\; \frac{(k+1)\ln m}{k\ln r} ,

and as ε→0+\varepsilon \to 0^+ we have k→∞k \to \infty and both bounds tend to ln⁡m/ln⁡r\ln m/\ln r. So the limit exists and has that value. It coincides with ln⁡m/ln⁡r=dsim\ln m/\ln r = d_{\text{sim}} by part 1.

Part 3. FkF_k is a union of mkm^k cubes of side r−kr^{-k} with disjoint interiors, so its Lebesgue measure is exactly mkr−kD=(m/rD)km^kr^{-kD} = (m/r^D)^k (Lebesgue measure). The FkF_k decrease to FF and have finite measure, so the measure of FF is lim⁡k(m/rD)k\lim_k (m/r^D)^k, which is 00 when m<rDm < r^D and 11 when m=rDm = r^D.

Part 4. Assume m≥2m \ge 2. Each point of FF lies in exactly one nested sequence of cubes — stage 11, stage 22, and so on — unless it lies on a shared face, in which case it lies in more than one; conversely every infinite word i1i2i3⋯i_1i_2i_3\cdots in the alphabet {1,…,m}\{1,\dots,m\} determines a nested sequence of stage-kk cubes whose intersection is a single point of FF (single, because the diameters D r−k\sqrt{D}\,r^{-k} tend to 00), and distinct words give distinct points whenever the corresponding cubes are eventually disjoint. To avoid the face-sharing nuisance, note simply that the map

word (i1,i2,… )  ⟼  the point ⋂kSi1⋯Sik(Q0)\text{word } (i_1,i_2,\dots) \;\longmapsto\; \text{the point } \bigcap_k S_{i_1}\cdots S_{i_k}(Q_0)

is onto FF and is at most 2D2^D-to-one (a point lies in at most 2D2^D cubes of a grid). The set of words is uncountable, being {1,…,m}N\{1,\dots,m\}^{\mathbb{N}} with m≥2m\ge2 (Sets, functions and countability); a set that is the image of an uncountable set under an at-most-2D2^D-to-one map is uncountable, since a countable image would force the domain to be a countable union of finite sets. Hence FF is uncountable.

Suppose now that no two chosen cubes touch, and let δ>0\delta>0 be the least distance between two of them. Then two distinct stage-kk cubes inside a common stage-(k−1)(k-1) cube are at distance at least δr−(k−1)>0\delta r^{-(k-1)} > 0.

  • No isolated points. Let x∈Fx\in F and η>0\eta>0. Choose kk with D r−k<η\sqrt D\,r^{-k} < \eta and let QQ be a stage-kk cube containing xx. Its m≥2m \ge 2 stage-(k+1)(k+1) children each contain a point of FF by part 1, and at least one of those children does not contain xx; the point of FF in it is distinct from xx and within diam⁡Q<η\operatorname{diam}Q < \eta. So xx is not isolated.
  • Totally disconnected. Let x≠yx \ne y both lie in FF and choose kk with D r−k<∣x−y∣\sqrt D\,r^{-k} < |x-y|, so xx and yy lie in different stage-kk cubes Qx≠QyQ_x \neq Q_y. Walk back to the first stage j≤kj \le k at which their cubes differ; those two stage-jj cubes sit inside one stage-(j−1)(j-1) cube and are therefore at distance at least δr−(j−1)>0\delta r^{-(j-1)} > 0. The open slab strictly between them (take any hyperplane separating the two cubes) misses Fj⊇FF_j \supseteq F entirely, so it disconnects FF into two relatively open pieces, one containing xx and the other yy. Hence no connected subset of FF contains two points. □\square
Remark(Where the hypotheses are used, and what the box dimension is not)Original
  • Separation of the chosen cubes is used only in part 4, for the topological conclusions. Part 2 needs nothing of the kind: the chosen cubes may be adjacent, in which case FF is connected and still has dimension ln⁡m/ln⁡r\ln m/\ln r. What saves the dimension computation is that distinct cubes of a grid have disjoint interiors, which is enough for the two-way count.
  • The grid form is used in both bounds of part 2: that the stage-kk cubes are cells of one mesh of side r−kr^{-k} is what makes "at most 2D2^D cells per covering cube" available. For general similitudes with a common ratio — rotations allowed, as in the von Koch curve — the same conclusion holds under a separation condition, but the counting needs the volume argument of Folland's Lemma 11.32 rather than a grid.
  • Equal ratios. Nothing above covers pieces of different ratios s1,…,sms_1,\dots,s_m. There the dimension is the root pp of ∑isi p=1\sum_i s_i^{\,p} = 1, which reduces to ln⁡m/ln⁡r\ln m/\ln r when all si=1/rs_i = 1/r; Folland states this and attributes it to Hutchinson, and we do not prove it.
  • The box dimension can be wrong. It is not countably additive and does not vanish on all countable sets: the rationals in [0,1][0,1] have box dimension 11, as Strogatz notes, because any ε\varepsilon-cover of a dense subset of [0,1][0,1] is an ε\varepsilon-cover of [0,1][0,1]. Hausdorff's definition repairs this by allowing covers with sets of different small sizes: Hp(A)=lim⁡δ→0inf⁡{∑j(diam⁡Bj)p:A⊆⋃Bj, diam⁡Bj<δ}H_p(A) = \lim_{\delta\to0}\inf\{\sum_j(\operatorname{diam}B_j)^p : A\subseteq\bigcup B_j,\ \operatorname{diam}B_j<\delta\}, and the Hausdorff dimension is the value of pp at which Hp(A)H_p(A) drops from ∞\infty to 00. For the sets here the two agree: Folland's Theorem 11.33 gives Hausdorff dimension log⁡1/sm\log_{1/s}m for the compact invariant set of mm similitudes of ratio ss admitting a separating set — an open bounded UU with ⋃iSi(U)⊆U\bigcup_iS_i(U)\subseteq U and the Si(U)S_i(U) disjoint — and for a grid set the open unit cube is such a UU whenever the chosen cubes are distinct. In general dHausdorff≤dboxd_{\text{Hausdorff}} \le d_{\text{box}} and the inequality can be strict, the rationals again being the example.
  • The limit may not exist for a general bounded set, in which case one keeps the upper and lower limits separately. Part 2 proves existence for grid sets.
  • dcorrd_{\text{corr}} is not a property of the set. It depends on the invariant measure, so two systems with the same attractor but different statistics can return different correlation dimensions. It is nevertheless the one that is measurable in practice, because the correlation sum needs only a list of points.
Method(Measuring a dimension)AdaptedAdapted from Strogatz (1994), §11.4, pp. 409-411, and §11.5, pp. 411-413

For a self-similar set given by a rule. Identify mm, the number of copies, and rr, the factor by which each is shrunk; then d=ln⁡m/ln⁡rd = \ln m/\ln r, with no computation. Check the rule really does reproduce the whole set, not merely a stage of the construction.

By box counting, for a set given as a list of points or by a construction.

  1. Choose a sequence of scales ε\varepsilon spaced evenly in ln⁡ε\ln\varepsilon, spanning the range between the resolution of your data and the diameter of the set. If the set is built on a grid of ratio rr, the scales r−kr^{-k} give the cleanest numbers, but any sequence converges to the same limit.
  2. At each ε\varepsilon, lay a mesh of side ε\varepsilon and count the occupied cells N(ε)N(\varepsilon) — in practice by binning the coordinates, dividing by ε\varepsilon, rounding down, and counting distinct index tuples.
  3. Plot ln⁡N\ln N against ln⁡(1/ε)\ln(1/\varepsilon) and fit a straight line over the scaling region: scales small enough that the mesh resolves the structure, but large enough that each occupied cell still holds many points. The slope is dboxd_{\text{box}}.
  4. Expect the local slope to oscillate rather than settle, if the set has a preferred ratio rr: the count is exactly on the line only at ε=r−k\varepsilon = r^{-k}, and in between it overshoots. Average over at least one full period in ln⁡ε\ln\varepsilon, or use only the scales r−kr^{-k}.

By the correlation sum, for a trajectory on an attractor. Discard the transient, store nn points, and compute C(ε)C(\varepsilon) as the fraction of pairs closer than ε\varepsilon for a range of ε\varepsilon; the slope of ln⁡C\ln C against ln⁡ε\ln\varepsilon over the scaling region is dcorrd_{\text{corr}}. Two cautions: exclude pairs whose indices differ by less than a few correlation times, or consecutive points on one trajectory will inflate CC at small ε\varepsilon and bias the slope upward; and expect saturation at ε\varepsilon near the diameter of the attractor, where C→1C \to 1, and noise at ε\varepsilon below the typical nearest-neighbour distance.

Example(A planar dust, by rule and by count)Original

Divide the unit square into a 4×44\times4 grid of 1616 squares of side 14\tfrac14, index them by (i,j)(i,j) with ii the column and jj the row, i,j∈{0,1,2,3}i,j\in\{0,1,2,3\}, and keep the six squares

(0,0),(0,3),(1,1),(2,2),(3,0),(3,3).(0,0),\quad (0,3),\quad (1,1),\quad (2,2),\quad (3,0),\quad (3,3) .

Repeat inside each kept square for ever. Call the limit set FF: a dust of points scattered along a bent diagonal with two outlying clumps at each end.

By the rule. This is a grid set with D=2D = 2, r=4r = 4, m=6m = 6, and the six chosen squares are distinct, so part 2 of the theorem gives

dbox(F)  =  ln⁡6ln⁡4  =  1.7917594691.386294361  =  1.2924812504.d_{\text{box}}(F) \;=\; \frac{\ln 6}{\ln 4} \;=\; \frac{1.791759469}{1.386294361} \;=\; 1.2924812504 .

The open unit square is a separating set for the six maps Si(x)=(x+ci)/4S_i(x) = (x+c_i)/4 — their images are disjoint open squares inside it — so by Folland's theorem the Hausdorff dimension is the same number. The area is (6/16)k=(3/8)k→0(6/16)^k = (3/8)^k \to 0, so FF is a planar set of zero area and dimension strictly between 11 and 22. Two of the chosen squares touch at a corner, (0,0)(0,0) and (1,1)(1,1) for instance, so part 4 does not apply and we do not claim that FF is totally disconnected.

By count. To test the theorem rather than trust it, we generated the 69=10 077 6966^9 = 10\,077\,696 stage-99 squares, of side 4−9=3.81×10−64^{-9} = 3.81\times10^{-6}, took their lower corners as a point set, and counted occupied cells of a mesh of side ε\varepsilon for ε=10−j/2\varepsilon = 10^{-j/2}:

ε=10−1.5:N=280ε=10−3:N=25 140ε=10−2:N=1 230ε=10−3.5:N=112 403ε=10−2.5:N=5 775ε=10−4:N=484 884\begin{array}{llll} \varepsilon = 10^{-1.5}: & N = 280 \qquad & \varepsilon = 10^{-3}: & N = 25\,140\\ \varepsilon = 10^{-2}: & N = 1\,230 & \varepsilon = 10^{-3.5}: & N = 112\,403\\ \varepsilon = 10^{-2.5}: & N = 5\,775 & \varepsilon = 10^{-4}: & N = 484\,884 \end{array}

A least-squares fit of ln⁡N\ln N against ln⁡(1/ε)\ln(1/\varepsilon) over these six scales gives a slope of

1.2979,1.2979 ,

and the chord from the first point to the last gives 1.29541.2954, both within 0.4%0.4\% of the exact 1.29248125041.2924812504. The residual wobble is the effect predicted in step 4 of the method: the local slope between consecutive scales ranges from 1.271.27 to 1.341.34 and returns to the exact value only at the scales 4−k4^{-k}, where the count is exactly 6k6^k — we checked that it is, for k=1,…,6k = 1,\dots,6: 6,36,216,1296,7776,466566, 36, 216, 1296, 7776, 46656. Below ε≈10−5\varepsilon \approx 10^{-5} the count saturates at 10 077 69610\,077\,696, because the mesh has become finer than the stage-99 approximation; this is the lower end of the scaling region, and including those scales drags the fitted slope down to 1.051.05, which is the single most common way of getting a dimension wrong.

The one-dimensional case for comparison. The same theorem with D=1D = 1, r=3r = 3, m=2m = 2 gives dbox(C)=ln⁡2/ln⁡3=0.6309297536d_{\text{box}}(C) = \ln2/\ln3 = 0.6309297536 for the middle-thirds Cantor set, and with D=1D=1, r=5r=5, m=3m=3 — keep the first, third and fifth fifths of every interval — gives ln⁡3/ln⁡5=0.6826061944\ln3/\ln5 = 0.6826061944. The von Koch curve, four copies of itself at ratio 13\tfrac13, has similarity dimension ln⁡4/ln⁡3=1.2618595071\ln4/\ln3 = 1.2618595071; it is not a grid set, since its copies are rotated, so our theorem does not cover it, and we quote it from Strogatz, with Folland's Corollary 11.34 giving the same value for its Hausdorff dimension.

ApplicationOriginal

Fractal dimension entered dynamics because the attractors of dissipative chaotic systems are not surfaces.

Counting the active degrees of freedom. A dissipative flow contracts phase-space volume, so its attractor has measure zero; but an attractor on which the motion is chaotic cannot be a point, a curve or a torus either. What is left is a set of non-integer dimension, and that number is the most compact summary of how complicated the long-term motion is. For an experimental time series, the correlation dimension computed from a reconstructed trajectory is the standard estimate: a low value, stable as the reconstruction dimension is increased, is evidence that a few variables suffice, while a value that keeps rising with the reconstruction dimension indicates noise and not low-dimensional chaos. Strogatz reports the value 2.05±0.012.05\pm0.01 obtained by Grassberger and Procaccia for the Lorenz attractor at σ=10\sigma=10, b=8/3b=8/3, r=28r=28, and 0.500±0.0050.500\pm0.005 for the attractor of the logistic map at the accumulation point of the period-doubling cascade, against a box dimension of about 0.5380.538 for that set — an attractor that is a Cantor-like set but, because the gaps in the orbit diagram scale differently in different places, is not strictly self-similar.

Why the cross section is a Cantor set. A strange attractor is made by stretching a sheet of phase space, folding it, and laying it back down. After kk rounds there are 2k2^k layers inside the original thickness, so a transverse cut through the attractor meets a set of points separated by gaps of every size — exactly the construction of this unit, run in the transverse direction. The attractor is then locally the product of a smooth sheet with a Cantor set, and its dimension exceeds the dimension of the sheet by the dimension of that set. This is the mechanism made explicit in The Henon map and strange attractors.

Outside dynamics. The same arithmetic is used for the measured roughness of surfaces, for the dimension of fracture and porous networks, and for percolation clusters, in each case to answer the question "how does the amount of the object within a box scale with the size of the box?" — the only question the box dimension answers, but one that controls transport, scattering and adsorption on such objects.

Example · advanced

The Henon map and strange attractors

Adapted

Shows how repeated stretching, folding and re-injection builds a strange attractor, writes Henon's map as the composition of a fold, a contraction and a flip, proves it is invertible with constant area ratio −b-b, locates its two saddles and an exact trapping quadrilateral at a=1.4a = 1.4, b=0.3b = 0.3, and measures the attractor there — Lyapunov exponents 0.41910.4191 and −1.6231-1.6231, correlation dimension 1.211.21, box dimension 1.251.25, and a transverse cut resolving into sheets in groups of one, two and three.

Prerequisites: Fractals and dimension, One-dimensional maps, Lyapunov exponents and sensitive dependence, Eigenvalues and eigenvectors, Compactness

Definition(Stretching, folding, re-injection, and Henon's map)AdaptedAdapted from Strogatz (1994), §12.0-12.1, pp. 423-425, and §12.2, pp. 429-430

A strange attractor — an attractor carrying chaotic motion, in the sense of Lyapunov exponents and sensitive dependence — has to do two incompatible-looking things at once. Nearby states must separate exponentially, yet the whole motion must stay inside a bounded set. The way out is stretching and folding. Take a small blob of initial conditions. Dissipation squeezes it flat in some directions while the instability draws it out in others; the stretching cannot continue indefinitely inside a bounded region, so the elongated blob is bent back over itself and laid down beside where it started. That last step is the re-injection. Rolling and folding dough is the standard picture: each pass doubles the number of layers and halves their thickness, so after many passes a cut across the slab meets a set of layers separated by gaps of every size, and a speck of colouring placed in the dough is drawn out and distributed through it. In the limit the layers accumulate on a set that is, transverse to the sheets, a Cantor set, and along the sheets a smooth curve or surface. That product structure — smooth one way, Cantor the other — is what "strange" means geometrically, and the exponential separation is the stretching seen in the tangent space.

Henon built the smallest concrete model of this mechanism. He wanted the stretch-and-fold action of the Lorenz system with the amount of dissipation under the author's control: Lorenz's flow squashes a phase volume by a factor of roughly 14,00014{,}000 in one circuit of the attractor, which packs the sheets far too tightly to be resolved numerically. A map, besides, iterates faster and more accurately than a differential equation is integrated. The Henon map is

T(x,y)  =  ( y+1−ax2, bx ),a>0,  0<∣b∣<1,T(x, y) \;=\; \bigl(\,y + 1 - a x^2,\ b x\,\bigr), \qquad a > 0,\ \ 0 < |b| < 1 ,

written as a difference scheme xn+1=yn+1−axn2x_{n+1} = y_n + 1 - a x_n^2, yn+1=bxny_{n+1} = b x_n. It is assembled from three elementary moves, each of which is one word of the mechanism above. Begin with a region elongated along the xx-axis.

  1. Fold. T′(x,y)=(x, 1+y−ax2)T'(x, y) = (x,\ 1 + y - a x^2) bends the region over a parabola; horizontal lines become downward parabolas, and aa sets how sharp the bend is.
  2. Contract. T′′(x,y)=(bx, y)T''(x, y) = (b x,\ y) squeezes it horizontally by the factor ∣b∣|b|. This is the dissipation, and because the region is now bent it also tightens the fold.
  3. Flip. T′′′(x,y)=(y, x)T'''(x, y) = (y,\ x) reflects in the diagonal, returning the long axis to the horizontal so that the next pass can repeat the first two moves.

Composing, T=T′′′∘T′′∘T′T = T''' \circ T'' \circ T', which is the formula above. The Henon attractor is the attractor obtained at the standard parameters a=1.4a = 1.4, b=0.3b = 0.3, which lie well inside the chaotic range: as aa is increased at fixed b=0.3b = 0.3 the map passes from a stable fixed point through a stable 22-cycle and the rest of a period-doubling cascade (Period doubling and universality) into chaos interleaved with periodic windows.

Example(Four properties the map was designed to have)AdaptedAdapted from Strogatz (1994), §12.2, pp. 430-432, Examples 12.2.1-12.2.2

Let a>0a > 0 and 0<∣b∣<10 < |b| < 1.

  1. TT is invertible, so every state has exactly one past as well as one future. This is the feature that distinguishes TT from the logistic map, which also stretches and folds but is two-to-one, and it is what makes TT an honest analogue of a flow.
  2. TT contracts areas, at the same rate at every point: the Jacobian determinant is the constant −b-b. This is the counterpart of the constant negative divergence of the Lorenz field.
  3. For suitable parameters there is a bounded trapping region QQ, a set with T(Q)⊆QT(Q) \subseteq Q; the attractor lies inside it.
  4. Unlike the Lorenz flow, whose orbits are all bounded, TT has orbits that run to infinity: far out, the term −ax2-a x^2 dominates and throws the orbit away.
Proposition(The two saddles, the escape radius and a trapping quadrilateral)Original

Let a>0a > 0 and 0<∣b∣<10 < |b| < 1, and write T(x,y)=(y+1−ax2, bx)T(x,y) = (y + 1 - ax^2,\ bx).

  1. Inverse. TT is a bijection of R2\mathbb{R}^2, with

    T−1(X,Y)  =  (Yb, X−1+ab2Y2).T^{-1}(X, Y) \;=\; \Bigl(\frac{Y}{b},\ X - 1 + \frac{a}{b^2}Y^2\Bigr) .
  2. Area. DT(x,y)=(−2ax1b0)DT(x,y) = \begin{pmatrix} -2ax & 1 \\ b & 0\end{pmatrix}, so det⁡DT≡−b\det DT \equiv -b and every measurable set EE satisfies area⁡(T(E))=∣b∣area⁡(E)\operatorname{area}(T(E)) = |b|\operatorname{area}(E). Consequently any compact set AA with T(A)=AT(A) = A has area zero.

  3. Fixed points. TT has a fixed point (x,bx)(x, bx) exactly when ax2+(1−b)x−1=0a x^2 + (1-b)x - 1 = 0. Since a>0a > 0 the discriminant (1−b)2+4a(1-b)^2 + 4a is positive, so there are always two of them,

    x±  =  −(1−b)±(1−b)2+4a2a,x_\pm \;=\; \frac{-(1-b) \pm \sqrt{(1-b)^2 + 4a}}{2a} ,

    with x−<0<x+x_- < 0 < x_+. The multipliers at (x,bx)(x, bx) are the roots of μ2+2ax μ−b=0\mu^2 + 2ax\,\mu - b = 0, namely

    μ±(x)  =  −ax±a2x2+b(b>0),\mu_{\pm}(x) \;=\; -ax \pm \sqrt{a^2x^2 + b} \qquad (b > 0),

    and they satisfy μ+μ−=−b\mu_+\mu_- = -b, so ∣μ+μ−∣<1|\mu_+\mu_-| < 1: a fixed point is never a repeller.

  4. Escape. Put

    R  =  (1+∣b∣)+(1+∣b∣)2+4a2a,R \;=\; \frac{(1 + |b|) + \sqrt{(1+|b|)^2 + 4a}}{2a} ,

    the positive root of aR2−(1+∣b∣)R−1=0a R^2 - (1+|b|)R - 1 = 0. If an orbit satisfies ∣xn∣>R|x_{n}| > R and ∣xn−1∣≤∣xn∣|x_{n-1}| \le |x_{n}| for some nn, then ∣xm∣|x_m| increases strictly for m≥nm \ge n and ∣xm∣→∞|x_m| \to \infty. Consequently every compact set AA with T(A)=AT(A) = A lies in the strip ∣x∣≤R|x| \le R.

  5. A trapping region at the standard parameters. Let a=1.4a = 1.4, b=0.3b = 0.3 and let QQ be the closed convex quadrilateral with vertices

    (−1.33, 0.41),(1.33, 0.15),(1.25, −0.13),(−1.09, −0.46)(-1.33,\ 0.41), \quad (1.33,\ 0.15), \quad (1.25,\ -0.13), \quad (-1.09,\ -0.46)

    taken in this (clockwise) order. Then T(Q)⊆QT(Q) \subseteq Q. Hence A=⋂n≥0Tn(Q)A = \bigcap_{n \ge 0} T^n(Q) is a nonempty compact set with T(A)=AT(A) = A, of area zero, and every orbit starting in QQ has dist⁡(Tn(x,y),A)→0\operatorname{dist}(T^n(x,y), A) \to 0.

Idea of the proofOriginal

Everything here is elementary once one notices that the yy-equation is trivial: yn+1=bxny_{n+1} = bx_n merely stores the previous xx. So the map is really the scalar second-order recurrence xn+1=1−axn2+bxn−1x_{n+1} = 1 - ax_n^2 + bx_{n-1}, and inverting it, finding its fixed points and bounding its orbits are all one-variable problems. Invertibility is reading that recurrence backwards; the fixed-point equation and the characteristic polynomial are quadratics; and escape follows because the quadratic term beats the linear ones once ∣x∣|x| passes the root RR. The area statement is the chain rule plus the change-of-variables formula, and it gives the attractor zero area at once, since an invariant set would have to keep an area that is multiplied by ∣b∣<1|b| < 1 at every step. Only part 5 needs more than algebra, and even there the work collapses: because QQ is convex and TT moves points along horizontal lines in the image (the image height bxbx depends only on xx), it is enough to check that the upper and lower boundary curves of QQ land in QQ, and each such check is one quadratic inequality on an interval.

ProofOriginal

1. Inverse. Given (X,Y)(X, Y), the equations X=y+1−ax2X = y + 1 - ax^2 and Y=bxY = bx determine (x,y)(x,y) uniquely: the second gives x=Y/bx = Y/b, which is legitimate because b≠0b \neq 0, and substituting into the first gives y=X−1+a(Y/b)2y = X - 1 + a(Y/b)^2. Both operations are defined for every (X,Y)(X,Y), so TT is a bijection with the stated inverse, and both TT and T−1T^{-1} are polynomial, hence smooth.

2. Area. Differentiating the two components of TT gives the matrix displayed, whose determinant is (−2ax)⋅0−1⋅b=−b(-2ax)\cdot 0 - 1\cdot b = -b for every (x,y)(x,y). The change-of-variables formula for the diffeomorphism TT therefore gives area⁡(T(E))=∫E∣det⁡DT∣=∣b∣area⁡(E)\operatorname{area}(T(E)) = \int_E |\det DT| = |b|\operatorname{area}(E). If now T(A)=AT(A) = A with AA compact, then area⁡(A)=∣b∣area⁡(A)\operatorname{area}(A) = |b|\operatorname{area}(A) with area⁡(A)<∞\operatorname{area}(A) < \infty by compactness, and since ∣b∣<1|b| < 1 this forces area⁡(A)=0\operatorname{area}(A) = 0.

3. Fixed points and multipliers. A fixed point must have y=bxy = bx, and then x=bx+1−ax2x = bx + 1 - ax^2, that is ax2+(1−b)x−1=0ax^2 + (1-b)x - 1 = 0. The discriminant is (1−b)2+4a>0(1-b)^2 + 4a > 0 because a>0a > 0, so there are two real roots; their product is −1/a<0-1/a < 0, so one is negative and one positive. The Jacobian at (x,bx)(x,bx) has trace −2ax-2ax and determinant −b-b, so its characteristic polynomial is μ2+2axμ−b\mu^2 + 2ax\mu - b; the quoted roots are the quadratic formula, real because a2x2+b>0a^2x^2 + b > 0 when b>0b > 0. Their product is the determinant −b-b, whose modulus is ∣b∣<1|b| < 1, so the two multipliers cannot both have modulus ≥1\ge 1.

4. Escape. Write tm=∣xm∣t_m = |x_m|. The recurrence xm+1=1−axm2+bxm−1x_{m+1} = 1 - ax_m^2 + bx_{m-1} gives the lower bound

tm+1  ≥  atm2−1−∣b∣ tm−1.t_{m+1} \;\ge\; a t_m^2 - 1 - |b|\,t_{m-1} .

Let p(t)=at2−(1+∣b∣)t−1p(t) = at^2 - (1+|b|)t - 1; this is the quadratic whose positive root is RR, and since a>0a > 0 it is strictly increasing on [R,∞)[R,\infty) with p(t)>0p(t) > 0 there. Suppose tm>Rt_m > R and tm−1≤tmt_{m-1} \le t_m. Substituting tm−1≤tmt_{m-1} \le t_m into the bound above,

tm+1  ≥  atm2−∣b∣tm−1,sotm+1−tm  ≥  atm2−(1+∣b∣)tm−1  =  p(tm)  >  0,t_{m+1} \;\ge\; a t_m^2 - |b| t_m - 1 , \qquad\text{so}\qquad t_{m+1} - t_m \;\ge\; a t_m^2 - (1+|b|) t_m - 1 \;=\; p(t_m) \;>\; 0 ,

the last inequality because tm>Rt_m > R. So tm+1>tm>Rt_{m+1} > t_m > R, and the pair (tm,tm+1)(t_m, t_{m+1}) again satisfies the hypothesis. By induction tmt_m is strictly increasing for m≥nm \ge n and stays above RR. It cannot converge to a finite limit LL: letting m→∞m \to \infty in tm+1−tm≥p(tm)t_{m+1} - t_m \ge p(t_m) would give 0≥p(L)>00 \ge p(L) > 0. An increasing sequence that does not converge tends to +∞+\infty. Now let AA be compact with T(A)=AT(A) = A, and let M=max⁡{∣x∣:(x,y)∈A}M = \max\{|x| : (x,y) \in A\}, which exists because AA is compact and the coordinate function is continuous. Choose (x∗,y∗)∈A(x^*, y^*) \in A attaining it. Because T(A)=AT(A) = A, every point of AA has a preimage in AA, so there is a bi-infinite orbit inside AA passing through (x∗,y∗)(x^*, y^*); along it tm≤Mt_m \le M for every mm, and tn=Mt_n = M at the index of (x∗,y∗)(x^*,y^*). In particular tn−1≤tnt_{n-1} \le t_n. If M>RM > R the previous paragraph would make tm→∞t_m \to \infty, contradicting tm≤Mt_m \le M. Hence M≤RM \le R.

5. The trapping quadrilateral. Write QQ as the intersection of four closed half-planes { ni⋅p≤ci }\{\,n_i \cdot p \le c_i\,\}, i=1,…,4i = 1, \dots, 4, one per edge, with the normals nin_i pointing out of QQ; this is possible because the vertices listed are in convex position and in clockwise order, as the four cross products of consecutive edge vectors, all negative, confirm.

Reduction to the boundary. Let xℓ=−1.33x_\ell = -1.33 and xr=1.33x_r = 1.33 be the smallest and largest abscissas of QQ. For x∈[xℓ,xr]x \in [x_\ell, x_r] the vertical slice Q∩({x}×R)Q \cap (\{x\}\times\mathbb{R}) is the segment {x}×[φ−(x),φ+(x)]\{x\}\times[\varphi_-(x), \varphi_+(x)], where φ−\varphi_- and φ+\varphi_+ are the piecewise-affine lower and upper boundary curves of QQ. The image of that slice is

T({x}×[φ−(x),φ+(x)])  =  [ 1−ax2+φ−(x), 1−ax2+φ+(x) ]×{bx},T\bigl(\{x\}\times[\varphi_-(x), \varphi_+(x)]\bigr) \;=\; \bigl[\,1 - ax^2 + \varphi_-(x),\ 1 - ax^2 + \varphi_+(x)\,\bigr] \times \{bx\} ,

a horizontal segment, because the second coordinate of TT does not involve yy and the first is affine in yy with slope 11. A convex set contains a segment as soon as it contains both endpoints. So T(Q)⊆QT(Q) \subseteq Q holds if and only if TT maps the graphs of φ−\varphi_- and φ+\varphi_+ into QQ.

The boundary check. Each of φ±\varphi_\pm is affine on each of the (four in total) edges of QQ: say y=αx+βy = \alpha x + \beta for xx in an interval [u,v][u, v]. Along such an edge,

T(x,αx+β)  =  ( 1+β+αx−ax2, bx ),T(x, \alpha x + \beta) \;=\; \bigl(\,1 + \beta + \alpha x - a x^2,\ b x\,\bigr) ,

so the requirement ni⋅T(x,αx+β)≤cin_i \cdot T(x, \alpha x + \beta) \le c_i reads g(x)≤0g(x) \le 0 with

g(x)  =  −a ni,1 x2  +  (α ni,1+b ni,2)x  +  ni,1(1+β)−ci,g(x) \;=\; -a\,n_{i,1}\,x^2 \;+\; \bigl(\alpha\,n_{i,1} + b\,n_{i,2}\bigr)x \;+\; n_{i,1}(1+\beta) - c_i ,

a quadratic in xx. Its maximum over [u,v][u,v] is attained at uu, at vv, or (only if the leading coefficient is negative) at the vertex − (αni,1+bni,2)/(−2ani,1)-\,(\alpha n_{i,1} + b n_{i,2})/(-2an_{i,1}), so each condition is decided by evaluating gg at no more than three points. With a=7/5a = 7/5, b=3/10b = 3/10 and the given vertices, all four edges and all four half-planes have rational data, and the 4×4=164 \times 4 = 16 inequalities were evaluated in exact rational arithmetic. All sixteen hold; the largest value of g/∥ni∥g/\|n_i\| over all of them is −4.873×10−4-4.873 \times 10^{-4}, so T(Q)T(Q) lies inside QQ with a clearance of about 4.9×10−44.9 \times 10^{-4} at the tightest point, on the image of the top edge against the left edge.

The attractor. QQ is compact and TT continuous, so each Tn(Q)T^n(Q) is compact, and T(Q)⊆QT(Q) \subseteq Q gives Tn+1(Q)⊆Tn(Q)T^{n+1}(Q) \subseteq T^n(Q): the sets are nested. A nested sequence of nonempty compact sets has nonempty compact intersection AA (compactness), and T(A)=⋂n≥1Tn(Q)=AT(A) = \bigcap_{n\ge1}T^n(Q) = A because the sequence is nested and TT is a homeomorphism onto its image. By part 2, area⁡(A)=0\operatorname{area}(A) = 0. For attraction, note that Tn(Q)T^n(Q) has area ∣b∣narea⁡(Q)→0|b|^n\operatorname{area}(Q) \to 0; more directly, dist⁡(p,A)≤sup⁡{dist⁡(q,A):q∈Tn(Q)}=:dn\operatorname{dist}(p, A) \le \sup\{\operatorname{dist}(q, A) : q \in T^n(Q)\} =: d_n for p∈Tn(Q)p \in T^n(Q), and dn→0d_n \to 0 because the Tn(Q)T^n(Q) are nested compact sets with intersection AA: if dn≥εd_n \ge \varepsilon for all nn, pick qn∈Tn(Q)q_n \in T^n(Q) with dist⁡(qn,A)≥ε\operatorname{dist}(q_n, A) \ge \varepsilon; a subsequence converges to some q∈⋂nTn(Q)=Aq \in \bigcap_n T^n(Q) = A with dist⁡(q,A)≥ε\operatorname{dist}(q, A) \ge \varepsilon, a contradiction. □\square

Remark(Where the hypotheses are used)Original
  • b≠0b \neq 0 is what makes the map invertible. At b=0b = 0 the second coordinate collapses to 00 and TT degenerates to the one-dimensional quadratic map x↦1−ax2x \mapsto 1 - ax^2, which is two-to-one. Part 1 divides by bb at exactly the step where this would fail. So the Henon map is a genuinely two-dimensional object only for b≠0b \neq 0, and the quadratic family is its singular limit.
  • ∣b∣<1|b| < 1 is used only for dissipation. Parts 1, 3 and 4 hold for any b≠0b \neq 0. Part 2's conclusion that an invariant compact set has zero area needs ∣b∣<1|b| < 1; at ∣b∣=1|b| = 1 the map preserves area, there can be no attractor at all, and the phase portrait is of the conservative kind discussed in Conservative and reversible systems.
  • b>0b > 0 in the multiplier formula. For b<0b < 0 the discriminant a2x2+ba^2x^2 + b can be negative and the multipliers are then a complex-conjugate pair of modulus ∣b∣<1\sqrt{|b|} < 1, a stable spiral. The displayed real formula is stated for b>0b > 0 for that reason; the relation μ+μ−=−b\mu_+\mu_- = -b holds in all cases.
  • a>0a > 0 in part 3. It is what makes the discriminant (1−b)2+4a(1-b)^2 + 4a positive, so that the two fixed points exist for every a>0a > 0. For a<0a < 0 they can disappear: the fixed points are created in a saddle-node bifurcation at a=−(1−b)2/4a = -(1-b)^2/4.
  • The hypothesis ∣xn−1∣≤∣xn∣|x_{n-1}| \le |x_n| in part 4 cannot be dropped as stated. A single large ∣xn∣|x_n| does not by itself force escape, because the term bxn−1bx_{n-1} could in principle be large and negative and cancel the growth; the proof uses the inequality ∣b∣∣xn−1∣≤∣b∣∣xn∣|b||x_{n-1}| \le |b||x_n| at the first step. The last paragraph of the proof shows that the hypothesis costs nothing where it is needed: on a compact invariant set the orbit through a point of largest ∣x∣|x| supplies it automatically.
  • Part 5 is for the stated parameters only. Nothing in the construction of QQ survives a change of aa or bb; the clearance is only about 5×10−45\times10^{-4}, so even a=1.41a = 1.41 would need a different quadrilateral. This is not fussiness but a feature of the map: the exact check above already fails for QQ at a=1.41a = 1.41, and at b=0.3b = 0.3 there can be no trapping region at all once aa passes about 1.4271.427, where in twenty runs from random starting points near the origin eighteen escaped within 2×1042\times10^4 iterations while none escaped at a=1.426a = 1.426.
  • What the Proposition does not prove. It gives a compact invariant attracting set AA of zero area. It does not prove that AA is a strange attractor: that the motion on it is chaotic, that AA is not simply a stable cycle, or that AA has the fractal structure seen in the example below. Those are genuinely hard; the chaotic behaviour at a=1.4a = 1.4, b=0.3b = 0.3 is established here only numerically.
Remark(What the attractor looks like, and why)AdaptedAdapted from Strogatz (1994), §12.1, p. 425, and §12.2, pp. 433-434

Plotting ten thousand iterates from almost any starting point inside QQ draws a thin boomerang-shaped arc. Magnifying a small square of it does not smooth it out: the arc resolves into several nearly parallel curves, and magnifying one of those shows the same pattern again, at every scale that numerics can reach. Strogatz describes Henon's own sequence of magnifications as showing six curves in groups of one, two and three, with each curve of a group resolving into the same arrangement at the next level. This is the dough picture made visible: each application of TT folds the strip once more, so after nn steps a transverse cut meets a rapidly growing number of intervals — 2n2^n of them for the idealised dough — whose widths shrink geometrically, which is exactly the construction of a Cantor set. Locally the attractor is a smooth arc times a Cantor set, and its dimension is therefore between 11 and 22.

There is a reason the longitudinal direction is smooth. The saddle fixed point lies on the attractor, and its unstable manifold is a smooth curve that the dynamics stretches along the attractor and folds back; Strogatz reports the theorem of Benedicks and Carleson that the Henon attractor is the closure of one branch of that unstable manifold. So the "curves" seen under magnification are successive passes of a single immersed curve, and the Cantor structure is the pattern in which those passes accumulate.

Method(Measuring a two-dimensional attractor)Original

Given a planar map TT depending on parameters, this is the sequence of computations that turns a picture into numbers. Each step has a check attached; skipping the checks is how wrong dimensions get published.

  1. Fix the invariant structure first. Solve T(p)=pT(p) = p and diagonalise DT(p)DT(p) at each fixed point. Classify: the saddles are the organising centres, and their unstable manifolds will trace the attractor.
  2. Find a trapping region. Guess a convex polygon enclosing the plotted orbit, then verify T(Q)⊆QT(Q) \subseteq Q by the boundary reduction used above — for a polynomial map the verification is a finite set of polynomial inequalities and can be done exactly. If no polygon works, enlarge the parameter search: orbits may be escaping.
  3. Discard the transient. Iterate a few thousand steps before recording anything, and confirm the recorded orbit stays in QQ.
  4. Lyapunov exponents. Carry a tangent vector un+1=DT(pn)unu_{n+1} = DT(p_n)u_n alongside the orbit, renormalising uu to unit length each step and accumulating the logarithms of the norms; the average is λ1\lambda_1. Check: when det⁡DT\det DT is a constant cc, the exponents must satisfy λ1+λ2=ln⁡∣c∣\lambda_1 + \lambda_2 = \ln|c| exactly, so λ2\lambda_2 comes free and any discrepancy is an error. Repeat from several seeds; the spread is the honest error bar.
  5. Correlation dimension. Collect NN points, keeping only every kkth iterate so that successive stored points are dynamically decorrelated, and compute the correlation sum C(ε)C(\varepsilon) of Fractals and dimension with a kk-d tree. Plot ln⁡C\ln C against ln⁡ε\ln\varepsilon and fit the slope over the middle of the range — above the scale at which only a handful of pairs are counted, below the diameter of the attractor. Check: the local slope should oscillate about a constant rather than drift; a steady drift means the scaling range has not been reached.
  6. Box dimension. Bin a long orbit into a grid of side ε\varepsilon, count occupied cells, and halve ε\varepsilon repeatedly. Check: stop refining when the number of orbit points per occupied cell falls below about a hundred, or the count saturates at the sample size and the slope bends down. The two dimensions should satisfy dcorr≤dboxd_{\text{corr}} \le d_{\text{box}}.
  7. Look at a cut. Collect the points of a long orbit lying in a narrow vertical strip and sort their other coordinate. Sorting the gaps exposes the transverse Cantor structure directly, and lowering the gap threshold shows the next level of the hierarchy.
Example(The Henon attractor at a=1.4a = 1.4, b=0.3b = 0.3, in numbers)Original

All the numbers below were computed for this unit; the orbits start at the origin unless stated otherwise.

Fixed points. The fixed-point equation is 1.4x2+0.7x−1=01.4x^2 + 0.7x - 1 = 0, with discriminant 0.49+5.6=6.090.49 + 5.6 = 6.09 and 6.09=2.4677925359\sqrt{6.09} = 2.4677925359. Hence

p+=(0.6313544771, 0.1894063431),p−=(−1.1313544771, −0.3394063431).p_+ = (0.6313544771,\ 0.1894063431), \qquad p_- = (-1.1313544771,\ -0.3394063431).

At p+p_+ the Jacobian has trace −2ax+=−1.7677925359-2ax_+ = -1.7677925359 and determinant −0.3-0.3, so the multipliers are

μ+=0.1559463223,μ−=−1.9237388582,\mu_+ = 0.1559463223, \qquad \mu_- = -1.9237388582 ,

whose product is −0.3-0.3 to ten figures, as part 3 requires. This is a saddle, and it is the saddle on the attractor: the nearest of two million recorded attractor points lies 5.6×10−55.6\times10^{-5} from it. At p−p_- the multipliers are 3.25982209793.2598220979 and −0.0920295620-0.0920295620 (product again −0.3-0.3); this is also a saddle, but it sits 0.210.21 away from the attractor, outside it.

Escape radius and trapping region. Here (1+∣b∣)2+4a=1.69+5.6=7.29(1+|b|)^2 + 4a = 1.69 + 5.6 = 7.29, whose square root is exactly 2.72.7, so part 4 gives the clean value

R  =  1.3+2.72.8  =  107  =  1.428571…R \;=\; \frac{1.3 + 2.7}{2.8} \;=\; \frac{10}{7} \;=\; 1.428571\ldots

The recorded orbit obeys this comfortably: over twenty million iterates its extent was x∈[−1.28466, 1.27297]x \in [-1.28466,\ 1.27297] and y∈[−0.38540, 0.38189]y \in [-0.38540,\ 0.38189]. Every one of those twenty million points also lies inside the quadrilateral QQ of part 5.

Lyapunov exponents. Carrying a tangent vector for 2×1062\times10^6 iterations after a transient of 10310^3 gives λ1=0.41911\lambda_1 = 0.41911; six independent random seeds, each run for 5×1055\times10^5 iterations, gave values between 0.418550.41855 and 0.419940.41994. So

λ1=0.4191±0.0007,λ2=ln⁡0.3−λ1=−1.6231±0.0007,\lambda_1 = 0.4191 \pm 0.0007 , \qquad \lambda_2 = \ln 0.3 - \lambda_1 = -1.6231 \pm 0.0007 ,

where λ2\lambda_2 is obtained from the exact constraint λ1+λ2=ln⁡∣det⁡DT∣=ln⁡0.3=−1.2039728\lambda_1 + \lambda_2 = \ln|\det DT| = \ln 0.3 = -1.2039728. The first exponent is positive, so the motion on the attractor is chaotic. In one iteration a tangent vector along the attractor is stretched by eλ1=1.5206e^{\lambda_1} = 1.5206 and one across it is squeezed by eλ2=0.1973e^{\lambda_2} = 0.1973; the product is 0.30000.3000, which is the area ratio ∣b∣|b| — the stretching and the folding, in one line of arithmetic.

Correlation dimension. Taking 10510^5 points, keeping every fifth iterate, and counting pairs with a kk-d tree gives a correlation sum whose log-log slope over 10−4≤ε≤10−110^{-4} \le \varepsilon \le 10^{-1} is 1.20491.2049; three other starting points gave 1.20591.2059, 1.20621.2062 and 1.20671.2067. The local slope, measured over a sliding decade, oscillates between 1.181.18 and 1.251.25 rather than settling — the signature of a self-similar set, whose covering statistics repeat log-periodically. The honest report is therefore

dcorr=1.21±0.03,d_{\text{corr}} = 1.21 \pm 0.03 ,

the uncertainty being the oscillation, not the fitting error.

Box dimension. Binning 2×1072\times10^7 iterates into squares of side ε=2−k⋅4\varepsilon = 2^{-k}\cdot 4 gives occupied-cell counts 148148, 349349, 833833, 19311931, 45614561, 1061610616, 2579525795, 6327263272 and 151659151659 for ε\varepsilon from 1/161/16 down to 1/40961/4096. The least-squares slope of ln⁡N\ln N against ln⁡(1/ε)\ln(1/\varepsilon) over that range is 1.2481.248, and the two endpoints alone give 1.2501.250:

dbox≈1.25.d_{\text{box}} \approx 1.25 .

The refinement was stopped at ε=1/4096\varepsilon = 1/4096, where there are still about 130130 orbit points per occupied cell. As the general inequality requires, dcorr=1.21<1.25=dboxd_{\text{corr}} = 1.21 < 1.25 = d_{\text{box}}. (The two Lyapunov exponents furnish a third, independent estimate through the Kaplan-Yorke formula 1+λ1/∣λ2∣=1.25821 + \lambda_1/|\lambda_2| = 1.2582. That formula is a conjecture, proved in no source used here, and is quoted only as a cross-check; it agrees with the box count to within 1%1\%.)

A cut through the attractor. Of 4×1074\times10^7 iterates, 2948429484 fell in the strip 0.6245≤x≤0.62550.6245 \le x \le 0.6255. Sorting their yy-coordinates and looking in the window 0.17≤y≤0.200.17 \le y \le 0.20, the points occupy, when runs separated by gaps smaller than 10−310^{-3} are merged, exactly three bands:

[0.17501, 0.17528],[0.17997, 0.18095],[0.18793, 0.19047].[0.17501,\ 0.17528], \qquad [0.17997,\ 0.18095], \qquad [0.18793,\ 0.19047] .

Lowering the merging threshold to 5×10−45\times10^{-4} leaves the first band single, splits the second into two,

[0.17997, 0.18012]  and  [0.18079, 0.18095],[0.17997,\ 0.18012] \ \text{ and } \ [0.18079,\ 0.18095],

and splits the third into three,

[0.18793, 0.18810],[0.18871, 0.18899],[0.18994, 0.19047].[0.18793,\ 0.18810], \quad [0.18871,\ 0.18899], \quad [0.18994,\ 0.19047].

That is six sheets in groups of one, two and three — the pattern Henon reported, recovered here from a sorted list of numbers rather than from a picture. The gaps between the groups (4.7×10−34.7\times10^{-3} and 7.0×10−37.0\times10^{-3}) are an order of magnitude larger than the gaps inside them (6.8×10−46.8\times10^{-4} and 6.0×10−46.0\times10^{-4}, 9.5×10−49.5\times10^{-4}), which is the hierarchy of scales that makes the cross section a Cantor set and the dimension fractional.

ApplicationOriginal

The Henon map is the standard proving ground for anything that claims to measure chaos from data. Because it is two-dimensional, invertible, polynomial and cheap to iterate for 10910^9 steps, every algorithm for Lyapunov exponents, for correlation and box dimensions, for unstable periodic orbits and for noise reduction is calibrated against it first; a method that cannot return λ1=0.419\lambda_1 = 0.419 and d≈1.2d \approx 1.2 for a clean Henon orbit is not going to be trusted on a laser or a dripping tap. The transverse cut computed above is the one-dimensional version of what an experimenter does with a Poincare section of a measured flow.

More importantly, the map is the reason the words "stretching and folding" mean something quantitative. A dissipative flow in three dimensions, sampled on a surface of section, gives a planar map that contracts area; if the attractor is strange, that map must stretch in one direction and fold, because there is no other way to reconcile a positive exponent with a bounded invariant set. The Henon map is that mechanism stripped to a quadratic, and the numbers above — a stretch of 1.521.52, a squeeze of 0.200.20, a product of exactly 0.300.30 — show the whole budget. The same accounting is what makes mixing work in a stirred fluid, where repeated stretching and folding of material lines, not molecular diffusion, is what homogenises a dye at low diffusivity; the striation thickness falls like eλ2ne^{\lambda_2 n} while the interfacial length grows like eλ1ne^{\lambda_1 n}, and the fractal dimension of the striation pattern plays the role measured here.

In celestial mechanics the map has a direct ancestor. Henon introduced it as a surrogate for the Lorenz flow, but two-dimensional area-contracting and area-preserving maps had already entered astronomy as sections of galactic and restricted three-body orbits, where the question is whether a given orbit is confined to an invariant curve or wanders chaotically. The Henon map answers, in the simplest possible setting, what such a wandering set looks like: not a region, but a set of measure zero and dimension about 1.251.25 on which the motion never repeats.