Mathematical Methods Handbook

Diffusion

The heat equation and diffusion processes.

In this chapter 4

Tick a unit to add it to your PDF basket.

  1. The heat equation

The heat equation

4

Theorem

The heat kernel

Adapted

Convolving bounded continuous initial data with the Gaussian kernel (4 pi k t)^{-1/2} exp(-x^2/4kt) solves the heat equation on the line, reproduces the data as t tends to 0, makes the solution positive everywhere at once, and bounds its m-th derivative by t^{-m/2}.

Prerequisites: The convolution theorem, Gaussian integrals, Differentiation under the integral sign

Definition(The heat equation and its kernel)AdaptedAdapted from Strauss (2008), §2.4, Eq. (1) p. 46 and Eq. (7) p. 49; Evans (2010), §2.3.1, p. 44

Fix a constant k>0k > 0, the diffusivity. The heat equation (or diffusion equation) on the line is

ut=k uxx,x∈R, t>0.u_t = k\,u_{xx}, \qquad x \in \mathbb{R},\ t > 0 .

Its heat kernel is the function

S(x,t)=14πkt e−x2/4kt,x∈R, t>0,S(x,t) = \frac{1}{\sqrt{4\pi k t}}\, e^{-x^2/4kt}, \qquad x \in \mathbb{R},\ t > 0 ,

extended by S(x,t)=0S(x,t) = 0 for t<0t < 0. For each fixed t>0t > 0, S(⋅,t)S(\cdot,t) is the Gaussian probability density of mean 00 and variance 2kt2kt.

The same function is called the source function, the propagator, the diffusion kernel, the Gaussian kernel, and the fundamental solution of the heat equation; (Strauss (2008), p. 50) lists these names together. Evans (Evans (2010), p. 44) takes k=1k = 1 and works in Rn\mathbb{R}^n, where the kernel is (4πt)−n/2e−∣x∣2/4t(4\pi t)^{-n/2}e^{-|x|^2/4t}; the n=1n = 1 case of that formula is SS with k=1k = 1. The normalising constant is fixed by the requirement ∫RS(x,t) dx=1\int_{\mathbb{R}} S(x,t)\,dx = 1.

Theorem(Solution of the initial-value problem)AdaptedAdapted from Evans (2010), §2.3.1, Thm 1, p. 45 and pp. 46–47; Strauss (2008), §2.4, Eq. (8), p. 49

Let k>0k > 0 and let g:R→Rg : \mathbb{R} \to \mathbb{R} be continuous and bounded. Define

u(x,t)=∫−∞∞S(x−y,t) g(y) dy=14πkt∫−∞∞e−(x−y)2/4kt g(y) dy,x∈R, t>0.u(x,t) = \int_{-\infty}^{\infty} S(x - y, t)\, g(y)\,dy = \frac{1}{\sqrt{4\pi k t}} \int_{-\infty}^{\infty} e^{-(x-y)^2/4kt}\, g(y)\,dy , \qquad x \in \mathbb{R},\ t > 0 .

Then:

  1. Smoothness. u∈C∞(R×(0,∞))u \in C^{\infty}\bigl(\mathbb{R} \times (0,\infty)\bigr).
  2. Equation. ut(x,t)=k uxx(x,t)u_t(x,t) = k\,u_{xx}(x,t) for all x∈Rx \in \mathbb{R} and all t>0t > 0.
  3. Initial data. For every x0∈Rx_0 \in \mathbb{R}, lim⁡(x,t)→(x0,0)x∈R, t>0u(x,t)=g(x0).\lim_{\substack{(x,t) \to (x_0, 0)\\ x \in \mathbb{R},\ t > 0}} u(x,t) = g(x_0) . Hence setting u(x,0)=g(x)u(x,0) = g(x) makes uu continuous on R×[0,∞)\mathbb{R} \times [0,\infty).
  4. Averaging and infinite propagation speed. inf⁡Rg≤u(x,t)≤sup⁡Rg\inf_{\mathbb{R}} g \le u(x,t) \le \sup_{\mathbb{R}} g for all xx and all t>0t > 0. If moreover g≥0g \ge 0 and g≢0g \not\equiv 0, then u(x,t)>0u(x,t) > 0 for every x∈Rx \in \mathbb{R} and every t>0t > 0, however small.

Part 4 is the statement that the heat equation propagates disturbances at infinite speed: data supported in a small interval is felt everywhere immediately.

Idea of the proofOriginal

Everything comes from three properties of the Gaussian: it solves the equation, it has total integral 11, and for small tt almost all of that integral sits in a tiny interval around the origin. The first two make uu a weighted average of the initial values which satisfies the equation, once differentiation under the integral sign is justified; the third makes the weight concentrate at x0x_0, so the average tends to g(x0)g(x_0). The one quantitative step is to split the integral into the part where gg is within ε\varepsilon of g(x0)g(x_0) and the rest, and to show that the Gaussian gives the rest almost no weight.

ProofAdaptedAdapted from Evans (2010), Thm 1, pp. 45–46

Throughout, ∥g∥∞=sup⁡R∣g∣\|g\|_\infty = \sup_{\mathbb{R}}|g|, which is finite because gg is bounded.

Step 1: SS solves the equation for t>0t > 0. Differentiating the explicit formula,

St=(x24kt2−12t)S,Sx=−x2kt S,Sxx=(x24k2t2−12kt)S,S_t = \Bigl(\frac{x^2}{4kt^2} - \frac{1}{2t}\Bigr) S, \qquad S_x = -\frac{x}{2kt}\,S, \qquad S_{xx} = \Bigl(\frac{x^2}{4k^2t^2} - \frac{1}{2kt}\Bigr) S ,

so k Sxx=Stk\,S_{xx} = S_t. By translation invariance of the equation in xx, the function (x,t)↦S(x−y,t)(x,t) \mapsto S(x - y, t) also solves it for each fixed yy.

Step 2: unit mass. Substituting x=z4ktx = z\sqrt{4kt} for fixed t>0t > 0,

∫−∞∞S(x,t) dx=1π∫−∞∞e−z2 dz=1,\int_{-\infty}^{\infty} S(x,t)\,dx = \frac{1}{\sqrt{\pi}}\int_{-\infty}^{\infty} e^{-z^2}\,dz = 1 ,

by the Gaussian integral ∫e−z2dz=π\int e^{-z^2}dz = \sqrt{\pi}. In particular the integral defining uu converges absolutely, with ∣u∣≤∥g∥∞|u| \le \|g\|_\infty.

Step 3: smoothness and the equation (parts 1 and 2). Fix R>0R > 0 and 0<δ<T0 < \delta < T, and let Q=[−R,R]×[δ,T]Q = [-R, R] \times [\delta, T]. Each partial derivative ∂t j∂x mS(x,t)\partial_t^{\,j}\partial_x^{\,m} S(x,t) is Pj,m(x,1/t) S(x,t)P_{j,m}(x, 1/t)\,S(x,t) for a polynomial Pj,mP_{j,m}, as Step 1 illustrates; hence on QQ there is a constant CC with

∣∂t j∂x mS(x−y,t)∣≤C (1+∣x−y∣2j+m) e−(x−y)2/4kT,(x,t)∈Q, y∈R,\bigl|\partial_t^{\,j}\partial_x^{\,m} S(x - y, t)\bigr| \le C\,\bigl(1 + |x-y|^{2j+m}\bigr)\, e^{-(x-y)^2/4kT} , \qquad (x,t) \in Q,\ y \in \mathbb{R} ,

because t≥δt \ge \delta bounds the negative powers of tt and t≤Tt \le T bounds the Gaussian from above. For ∣y∣≥2R|y| \ge 2R we have ∣x−y∣≥∣y∣−R≥∣y∣/2|x - y| \ge |y| - R \ge |y|/2, so the right-hand side is at most C(1+∣y∣2j+m)e−y2/16kTC(1 + |y|^{2j+m})e^{-y^2/16kT}; for ∣y∣≤2R|y| \le 2R it is at most a constant. In both cases the bound is independent of (x,t)∈Q(x,t) \in Q and integrable in yy, and so is its product with the bounded function gg. By differentiation under the integral sign, uu has partial derivatives of every order on the interior of QQ, obtained by differentiating SS inside the integral. Since RR, δ\delta, TT were arbitrary, u∈C∞(R×(0,∞))u \in C^\infty(\mathbb{R}\times(0,\infty)), which is part 1, and

ut−k uxx=∫−∞∞(St−k Sxx)(x−y,t) g(y) dy=0u_t - k\,u_{xx} = \int_{-\infty}^{\infty} \bigl(S_t - k\,S_{xx}\bigr)(x-y,t)\,g(y)\,dy = 0

by Step 1, which is part 2.

Step 4: the initial data (part 3). Fix x0x_0 and ε>0\varepsilon > 0. Since gg is continuous at x0x_0, choose ρ>0\rho > 0 with

∣g(y)−g(x0)∣<εwhenever ∣y−x0∣<ρ.|g(y) - g(x_0)| < \varepsilon \qquad \text{whenever } |y - x_0| < \rho .

Let ∣x−x0∣≤ρ/2|x - x_0| \le \rho/2 and t>0t > 0. By Step 2 we may subtract the constant g(x0)g(x_0) inside the integral:

u(x,t)−g(x0)=∫−∞∞S(x−y,t) (g(y)−g(x0)) dy.u(x,t) - g(x_0) = \int_{-\infty}^{\infty} S(x-y,t)\,\bigl(g(y) - g(x_0)\bigr)\,dy .

Split the integral at ∣y−x0∣=ρ|y - x_0| = \rho and bound the two pieces separately.

  • Near piece. On ∣y−x0∣<ρ|y - x_0| < \rho the integrand is at most ε S(x−y,t)\varepsilon\,S(x-y,t) in absolute value, by the choice of ρ\rho, and S>0S > 0, so by Step 2 this piece is at most ε\varepsilon in absolute value.
  • Far piece. On ∣y−x0∣≥ρ|y - x_0| \ge \rho we use boundedness of gg: the integrand is at most 2∥g∥∞S(x−y,t)2\|g\|_\infty S(x-y,t). Moreover ∣y−x∣≥∣y−x0∣−ρ/2≥12∣y−x0∣|y - x| \ge |y - x_0| - \rho/2 \ge \tfrac12|y-x_0|, so S(x−y,t)≤(4πkt)−1/2e−(y−x0)2/16ktS(x-y,t) \le (4\pi kt)^{-1/2}e^{-(y-x_0)^2/16kt}. Substituting y−x0=z16kty - x_0 = z\sqrt{16kt}, ∫∣y−x0∣≥ρS(x−y,t) dy  ≤  2π∫∣z∣≥ρ/(4kt)e−z2 dz,\int_{|y-x_0|\ge\rho} S(x-y,t)\,dy \;\le\; \frac{2}{\sqrt{\pi}} \int_{|z| \ge \rho/(4\sqrt{kt})} e^{-z^2}\,dz , and the right-hand side tends to 00 as t→0+t \to 0^{+}, because the domain of integration shrinks to the empty set while the integrand is fixed and integrable. So there is τ>0\tau > 0, depending on ρ\rho and ε\varepsilon but not on xx, with far piece <ε< \varepsilon for 0<t<τ0 < t < \tau.

Hence ∣u(x,t)−g(x0)∣<2ε|u(x,t) - g(x_0)| < 2\varepsilon whenever ∣x−x0∣≤ρ/2|x - x_0| \le \rho/2 and 0<t<τ0 < t < \tau, which is part 3.

Step 5: averaging and positivity (part 4). Since S(⋅,t)>0S(\cdot,t) > 0 and integrates to 11, the number u(x,t)u(x,t) is a weighted average of the values of gg, so it lies between inf⁡g\inf g and sup⁡g\sup g. Suppose now g≥0g \ge 0 and g(y0)>0g(y_0) > 0 for some y0y_0. By continuity there are c>0c > 0 and an interval [a,b]∋y0[a,b] \ni y_0 of positive length with g≥cg \ge c on [a,b][a,b]. Then, for any xx and any t>0t > 0,

u(x,t) ≥ c∫abS(x−y,t) dy > 0,u(x,t) \ \ge\ c \int_a^b S(x - y, t)\,dy \ > \ 0 ,

because S(x−y,t)>0S(x-y,t) > 0 for every yy. □\square

Theorem(Smoothing)Original

Let gg be continuous and bounded and let uu be as above. For every integer m≥1m \ge 1 and every t>0t > 0,

sup⁡x∈R∣∂xmu(x,t)∣ ≤ γm ∥g∥∞ (2kt)−m/2,γm=∫−∞∞∣φ(m)(z)∣ dz,\sup_{x \in \mathbb{R}} \bigl|\partial_x^m u(x,t)\bigr| \ \le\ \gamma_m\, \|g\|_\infty\, (2kt)^{-m/2}, \qquad \gamma_m = \int_{-\infty}^{\infty} \bigl|\varphi^{(m)}(z)\bigr|\,dz ,

where φ(z)=(2π)−1/2e−z2/2\varphi(z) = (2\pi)^{-1/2}e^{-z^2/2} is the standard Gaussian density. The first two constants are

γ1=2π=0.797884…,γ2=4φ(1)=8πe=0.967882…,\gamma_1 = \sqrt{\tfrac{2}{\pi}} = 0.797884\ldots, \qquad \gamma_2 = 4\varphi(1) = \sqrt{\tfrac{8}{\pi e}} = 0.967882\ldots ,

so that ∣ux∣≤∥g∥∞/πkt|u_x| \le \|g\|_\infty/\sqrt{\pi k t}. No smoothness whatever is assumed of gg: the bound involves only its supremum. It degrades as t→0+t \to 0^+ and improves without limit as tt grows.

ProofOriginal

Write σ=2kt\sigma = \sqrt{2kt}, so that S(x,t)=σ−1φ(x/σ)S(x,t) = \sigma^{-1}\varphi(x/\sigma) by the definition of SS. Differentiating mm times in xx,

∂xmS(x,t)=σ−(m+1) φ(m)(x/σ),\partial_x^m S(x,t) = \sigma^{-(m+1)}\,\varphi^{(m)}(x/\sigma) ,

and substituting x=σzx = \sigma z gives ∫∣∂xmS(x,t)∣ dx=σ−mγm\int |\partial_x^m S(x,t)|\,dx = \sigma^{-m}\gamma_m, which is finite because φ(m)\varphi^{(m)} is a polynomial times φ\varphi. Step 3 of the previous proof allows the derivative to be taken inside the integral, so

∣∂xmu(x,t)∣=∣∫∂xmS(x−y,t) g(y) dy∣≤∥g∥∞∫∣∂xmS(x−y,t)∣ dy=γm ∥g∥∞ σ−m,\bigl|\partial_x^m u(x,t)\bigr| = \Bigl|\int \partial_x^m S(x-y,t)\,g(y)\,dy\Bigr| \le \|g\|_\infty \int \bigl|\partial_x^m S(x-y,t)\bigr|\,dy = \gamma_m\,\|g\|_\infty\,\sigma^{-m} ,

which is the claim. For the constants: φ′(z)=−zφ(z)\varphi'(z) = -z\varphi(z), so γ1=∫∣z∣φ(z) dz=2∫0∞zφ(z) dz=2φ(0)=2/π\gamma_1 = \int |z|\varphi(z)\,dz = 2\int_0^\infty z\varphi(z)\,dz = 2\varphi(0) = \sqrt{2/\pi}. Next φ′′(z)=(z2−1)φ(z)\varphi''(z) = (z^2-1)\varphi(z), so ∣z2−1∣φ|z^2-1|\varphi equals φ′′\varphi'' on ∣z∣>1|z| > 1 and −φ′′-\varphi'' on ∣z∣<1|z| < 1; integrating each of the three pieces with φ′′=(φ′)′\varphi'' = (\varphi')',

γ2=∫−∞∞∣z2−1∣φ(z) dz=[φ′]−∞−1−[φ′]−11+[φ′]1∞=4φ(1),\gamma_2 = \int_{-\infty}^{\infty}|z^2-1|\varphi(z)\,dz = \bigl[\varphi'\bigr]_{-\infty}^{-1} - \bigl[\varphi'\bigr]_{-1}^{1} + \bigl[\varphi'\bigr]_{1}^{\infty} = 4\varphi(1) ,

using φ′(±1)=∓φ(1)\varphi'(\pm1) = \mp\varphi(1) and φ′(±∞)=0\varphi'(\pm\infty) = 0. □\square

Remark(Three ways to find the kernel)AdaptedAdapted from Strauss (2008), §2.4, pp. 47–49; Evans (2010), §2.3.1, pp. 43–44; Stein & Shakarchi (2003), Ch. 5, §2.1, p. 146; Stakgold & Holst (2011), §2.5, Example 12, pp. 177–178

The theorem says the kernel works; it does not say how to find it. The books take three routes.

  • Dilation invariance. If uu solves ut=kuxxu_t = k u_{xx}, so does u(a x,at)u(\sqrt{a}\,x, at) for every a>0a > 0 (Strauss (2008), property (e), p. 47). Strauss therefore first solves the equation with the step initial datum Q(x,0)=1Q(x,0) = 1 for x>0x>0, 00 for x<0x<0, which is itself dilation invariant, so QQ can depend on xx and tt only through p=x/4ktp = x/\sqrt{4kt}; the equation becomes the ordinary differential equation g′′+2pg′=0g'' + 2pg' = 0, whose solution is an error function, and S=∂Q/∂xS = \partial Q/\partial x (Strauss (2008), Steps 1–4, pp. 47–49). Evans instead looks for a solution invariant under u(x,t)↦λαu(λβx,λt)u(x,t) \mapsto \lambda^{\alpha}u(\lambda^{\beta}x, \lambda t), finds β=1/2\beta = 1/2 and α=n/2\alpha = n/2 forced, and reduces to a radial ordinary differential equation (Evans (2010), pp. 43–44).
  • Fourier transform. With the convention f^(ξ)=∫f(x)e−2πixξ dx\hat f(\xi) = \int f(x)e^{-2\pi i x\xi}\,dx used by Stein and Shakarchi (Stein & Shakarchi (2003), p. 146), transforming the equation in xx turns it into ∂tu^=−4π2kξ2u^\partial_t \hat u = -4\pi^2 k\xi^2 \hat u for each fixed ξ\xi, so u^(ξ,t)=g^(ξ) e−4π2kξ2t\hat u(\xi,t) = \hat g(\xi)\,e^{-4\pi^2 k \xi^2 t}. The transform of a Gaussian is a Gaussian, so e−4π2kξ2te^{-4\pi^2 k\xi^2 t} is itself the transform of a Gaussian in xx; inverting it gives exactly S(⋅,t)S(\cdot,t), whence u=g∗Su = g * S by the convolution theorem. Stakgold and Holst (Stakgold & Holst (2011), Example 12, pp. 177–178) run the same computation with the convention f^(ω)=∫f(x)eiωxdx\hat f(\omega)=\int f(x)e^{i\omega x}dx and with a delta source in time, obtaining H(t)(4πt)−1/2e−x2/4tH(t)(4\pi t)^{-1/2}e^{-x^2/4t} for k=1k=1 as the causal fundamental solution, the one vanishing for t<0t<0; this is why SS is defined to be 00 for t<0t < 0.
  • As a limit of data. Equivalently, S(⋅,t)S(\cdot,t) is the solution whose initial datum is a unit point mass: S→δ0S \to \delta_0 as t→0+t \to 0^+. Both Evans and Stakgold–Holst state the problem in this form, the first by writing Φ=δ0\Phi = \delta_0 at t=0t=0 (Evans (2010), p. 46), the second by noting that EE solves the homogeneous equation with lim⁡t→0E(x,t)=δ(x)\lim_{t\to0}E(x,t) = \delta(x) (Stakgold & Holst (2011), p. 178).
Remark(Where the hypotheses are used)Original
  • Boundedness of gg is used twice in Step 4: to make the far piece small, and (through Step 2) to make the integral converge at all. It can be relaxed, but not freely: against the Gaussian weight e−(x−y)2/4kte^{-(x-y)^2/4kt}, the datum g(y)=ey2g(y) = e^{y^2} gives an integrand whose exponent has y2y^2-coefficient 1−1/(4kt)1 - 1/(4kt), so the integral converges for 0<t<1/4k0 < t < 1/4k and diverges for every t≥1/4kt \ge 1/4k. A formula that stops existing after a finite time is no solution, which is why boundedness (or at least sub-Gaussian growth) is assumed from the start.
  • Continuity of gg only at x0x_0 is what Step 4 actually uses; boundedness is needed globally. So part 3 holds at every point of continuity of a bounded, piecewise-continuous datum, as the second example below shows. Parts 1 and 2, and the averaging bound inf⁡g≤u≤sup⁡g\inf g \le u \le \sup g of part 4, need no continuity at all — only boundedness and measurability. The strict positivity in part 4 does use continuity, at one point where g>0g > 0: for the bounded g≥0g \ge 0 that is 11 at y=0y = 0 and 00 elsewhere, g≢0g \not\equiv 0 but u≡0u \equiv 0.
  • t>0t > 0 and k>0k > 0. SS is defined only for t>0t > 0: at t=0t = 0 the formula is meaningless, as (Strauss (2008), p. 50) points out, and the solution is recovered there only as a limit. The sign of kk matters: replacing tt by −t-t turns the Gaussian into e+x2/4kte^{+x^2/4kt}, which is not integrable, so the formula gives nothing backwards in time.
  • Positivity in part 4 cannot be upgraded to a bound on the speed of a signal. The value u(x,t)u(x,t) for ∣x∣|x| large is positive but exponentially small, of size e−x2/4kte^{-x^2/4kt}; see the numbers in the second example. The wave equation behaves differently and does have a finite propagation speed (d'Alembert's formula).
NoteAdaptedAdapted from Stein & Shakarchi (2003), Ch. 5, Thm 2.3, p. 148

The theorem produces a solution; it does not say that there is only one. Uniqueness needs a restriction on the growth of uu. Stein and Shakarchi prove that if uu is continuous on R×[0,∞)\mathbb{R}\times[0,\infty), solves the heat equation for t>0t>0, vanishes at t=0t=0, and u(⋅,t)u(\cdot,t) lies in the Schwartz class uniformly for 0<t<T0<t<T in the sense that sup⁡x, 0<t<T∣x∣j∣∂xℓu(x,t)∣<∞\sup_{x,\,0<t<T}|x|^{j}|\partial_x^{\ell}u(x,t)| < \infty for all j,ℓ≥0j,\ell \ge 0, then u≡0u \equiv 0; the proof differentiates the energy ∫∣u∣2dx\int |u|^2dx and shows that it decreases. For merely bounded solutions, uniqueness follows instead from the maximum principle.

Example(Gaussian initial data spread as a Gaussian)Original

Take g(x)=θ0 e−x2/2a2g(x) = \theta_0\,e^{-x^2/2a^2}, a bell of height θ0\theta_0 and width a>0a > 0. The convolution of two Gaussians is Gaussian, and the variances add: the datum has variance a2a^2, the kernel variance 2kt2kt, so

u(x,t)=θ0 aa2+2kt  exp⁡ ⁣(−x22(a2+2kt)).u(x,t) = \theta_0\,\frac{a}{\sqrt{a^2 + 2kt}}\;\exp\!\Bigl(-\frac{x^2}{2(a^2 + 2kt)}\Bigr) .

Check that this solves the problem. Write w(t)=a2+2ktw(t) = a^2 + 2kt, so u=θ0a w−1/2e−x2/2wu = \theta_0 a\,w^{-1/2}e^{-x^2/2w}. Then ut=θ0a e−x2/2w(kx2w−5/2−kw−3/2)u_t = \theta_0 a\,e^{-x^2/2w}\bigl(k x^2 w^{-5/2} - k w^{-3/2}\bigr) and uxx=(x2/w2−1/w)uu_{xx} = \bigl(x^2/w^2 - 1/w\bigr)u, so ut=k uxxu_t = k\,u_{xx}; and w(0)=a2w(0) = a^2 gives u(x,0)=g(x)u(x,0) = g(x).

Numbers. With θ0=1\theta_0 = 1, a=1a = 1 and k=1k = 1 (any consistent units), the width grows as 1+2t\sqrt{1 + 2t} and the peak falls as 1/1+2t1/\sqrt{1+2t}. At t=1.5t = 1.5 the variance is 1+3=41 + 3 = 4, so the peak has halved exactly: u(0,1.5)=1/2u(0,1.5) = 1/2. The product (peak) ×\times (width) is θ0a\theta_0 a for all tt, which is Step 2 again: ∫u dx=∫g dx=θ0a2π\int u\,dx = \int g\,dx = \theta_0 a\sqrt{2\pi} is conserved.

Smoothing bound. Here ∥g∥∞=1\|g\|_\infty = 1 and sup⁡x∣ux∣=θ0a w−1e−1/2\sup_x|u_x| = \theta_0 a\,w^{-1}e^{-1/2}, attained at x=±wx = \pm\sqrt{w}. At t=1.5t=1.5, k=1k=1 this is e−1/2/4=0.1516e^{-1/2}/4 = 0.1516, comfortably under the general bound 1/πkt=0.46071/\sqrt{\pi k t} = 0.4607 of the smoothing statement.

Example(A box of heat, and infinite propagation speed in numbers)Original

Let g=θ0g = \theta_0 on [−L,L][-L, L] and g=0g = 0 outside: a slab of hot material, initially at temperature θ0\theta_0, placed in a cold line. This gg is bounded and continuous except at x=±Lx = \pm L, so parts 1, 2 and 4 of the theorem apply as stated and part 3 applies at every x0≠±Lx_0 \ne \pm L, by the second item of the remark on hypotheses.

Substituting z=(y−x)/4ktz = (y-x)/\sqrt{4kt} in the solution formula and using erf⁡(s)=2π∫0se−z2dz\operatorname{erf}(s) = \frac{2}{\sqrt\pi}\int_0^s e^{-z^2}dz,

u(x,t)=θ02[erf⁡ ⁣(L−x4kt)+erf⁡ ⁣(L+x4kt)].u(x,t) = \frac{\theta_0}{2}\left[ \operatorname{erf}\!\Bigl(\frac{L-x}{\sqrt{4kt}}\Bigr) + \operatorname{erf}\!\Bigl(\frac{L+x}{\sqrt{4kt}}\Bigr) \right] .

Take θ0=1\theta_0 = 1, L=1L = 1, k=1k = 1.

  1. Centre. u(0,1)=erf⁡(1/2)=0.520500u(0,1) = \operatorname{erf}(1/2) = 0.520500: after a time L2/kL^2/k the centre has cooled by nearly half.
  2. Outside the slab. u(2,1)=12[erf⁡(−1/2)+erf⁡(3/2)]=0.222803u(2,1) = \frac12[\operatorname{erf}(-1/2) + \operatorname{erf}(3/2)] = 0.222803.
  3. Far outside. u(10,1)=12[erf⁡(−9/2)+erf⁡(11/2)]=9.83×10−11u(10,1) = \frac12[\operatorname{erf}(-9/2)+\operatorname{erf}(11/2)] = 9.83 \times 10^{-11}. It is positive, as part 4 demands, and utterly negligible: this is what infinite propagation speed amounts to in practice.
  4. At the jump. u(L,t)=12[erf⁡(0)+erf⁡(L/kt)]→12u(L,t) = \frac12\bigl[\operatorname{erf}(0) + \operatorname{erf}(L/\sqrt{kt})\bigr] \to \tfrac12 as t→0+t \to 0^+, the average of the two one-sided limits of gg — not g(L)g(L), whatever value we assign there. Part 3 genuinely fails at a jump.
  5. Smoothing. Differentiating, ux(x,t)=(4πkt)−1/2[e−(L+x)2/4kt−e−(L−x)2/4kt]u_x(x,t) = (4\pi kt)^{-1/2}\bigl[e^{-(L+x)^2/4kt} - e^{-(L-x)^2/4kt}\bigr]. At t=1t = 1 its largest absolute value is 0.206040.20604, at x=±1.54340x = \pm 1.54340, against the bound ∥g∥∞/πkt=0.56419\|g\|_\infty/\sqrt{\pi k t} = 0.56419. The initial datum was not even continuous; a moment later the solution is C∞C^\infty with a derivative bounded by 0.570.57.
ApplicationOriginal

The diffusion length. Every use of the kernel in the laboratory is really a use of its width: after a time tt, matter or heat initially at a point has spread over a distance of order 2kt\sqrt{2kt} (one standard deviation) or 4kt\sqrt{4kt} (the length appearing in the exponent). Turned around, the time to spread a distance ℓ\ell is of order ℓ2/k\ell^2/k, quadratic in the distance, which is why diffusion is fast over micrometres and hopeless over metres.

  • Molecules in water. A small molecule in water has DD of order 10−5 cm2/s10^{-5}\,\mathrm{cm^2/s}. Spreading one standard deviation of 1 cm1\,\mathrm{cm} takes t=ℓ2/2D≈5×104 st = \ell^2/2D \approx 5\times10^4\,\mathrm{s}, about 1414 hours: unstirred solutions do not mix. Across a 10 μm=10−3 cm10\,\mu\mathrm{m} = 10^{-3}\,\mathrm{cm} cell the same estimate gives 10−6/(2×10−5)=5×10−2 s10^{-6}/(2\times10^{-5}) = 5\times10^{-2}\,\mathrm{s}, which is why diffusion suffices inside a cell and circulation is needed between cells.
  • Heat in metal. Copper has thermal diffusivity of order 1.1 cm2/s1.1\,\mathrm{cm^2/s}. Heat applied to one face of a 1 cm1\,\mathrm{cm} plate is felt on the other in ℓ2/4k≈0.23 s\ell^2/4k \approx 0.23\,\mathrm{s}; for a stainless steel of diffusivity 0.04 cm2/s0.04\,\mathrm{cm^2/s} the same thickness takes about 6 s6\,\mathrm{s}. This single number governs quench rates, soldering times and the thermal lag of furnace walls.
  • Probability. The kernel is the transition density of Brownian motion. Strauss states this as: the probability that a particle starting at xx lies in (a,b)(a,b) at time tt is ∫abS(x−y,t) dy\int_a^b S(x-y,t)\,dy for some constant kk, so that a concentration profile and a probability density obey the same equation (Strauss (2008), p. 51). He does not fix the constant; matching the kernel's variance 2kt2kt against the convention in which the motion has variance σ2t\sigma^2 t gives k=σ2/2k = \sigma^2/2, half the diffusion coefficient in that normalisation. See Brownian motion and the Fokker-Planck equation.
  • Smoothing, and its reverse. The derivative bound ∣∂xmu∣≤γm∥g∥∞(2kt)−m/2|\partial_x^m u| \le \gamma_m\|g\|_\infty(2kt)^{-m/2} says that diffusion erases detail at a rate set by t−m/2t^{-m/2}: a feature of width λ\lambda in the data is invisible once 2kt≫λ\sqrt{2kt} \gg \lambda. Recovering the data from a later profile therefore amplifies small errors without bound, which is the reason inverse heat-conduction problems (inferring a surface temperature history from an interior measurement) must be regularised.

The kernel is also the building block for the inhomogeneous problem and for bounded domains: convolving it in time against a source gives Duhamel's formula (Green's functions for the wave and heat equations), and reflecting it in a boundary gives the kernel of a half-line or an interval (diffusion in bounded domains).

Theorem

Maximum principle for the heat equation

Adapted

A solution of the heat equation in a bounded space-time cylinder takes its largest and smallest values on the initial slice or the lateral boundary, which gives uniqueness and a quantitative stability bound for the initial-boundary-value problem without solving it.

Prerequisites: Classification of second-order equations, Types of boundary and initial condition

Definition(Parabolic cylinder and parabolic boundary)AdaptedAdapted from Evans (2010), §2.3.2, pp. 49–50; Stakgold & Holst (2011), §8.2, Fig. 8.8, p. 483

Let U⊂RnU \subset \mathbb{R}^n be open and bounded and let T>0T > 0. The parabolic cylinder is

Ω=U×(0,T],\Omega = U \times (0, T] ,

which contains its top face U×{t=T}U \times \{t = T\} but no part of the lateral surface. Its closure is Ω‾=U‾×[0,T]\overline{\Omega} = \overline{U}\times[0,T], and the parabolic boundary is what the closure adds:

Γ=Ω‾∖Ω=(U‾×{t=0})∪(∂U×(0,T]),\Gamma = \overline{\Omega} \setminus \Omega = \bigl(\overline{U}\times\{t=0\}\bigr) \cup \bigl(\partial U \times (0,T]\bigr) ,

the bottom together with the lateral sides. Evans (Evans (2010), pp. 49–50) writes UTU_T and ΓT\Gamma_T for these and stresses that UTU_T includes the top. For n=1n = 1 and U=(0,ℓ)U = (0,\ell) the picture is a rectangle in the (x,t)(x,t) plane whose parabolic boundary is its bottom edge and its two vertical edges, the top edge excluded; this is the setting of Strauss (Strauss (2008), §2.3, p. 42).

A function uu is a subsolution of the heat equation with diffusivity k>0k > 0 on Ω\Omega if uu is continuous on Ω‾\overline{\Omega}, has continuous utu_t and second spatial derivatives in Ω\Omega (the derivative in tt at t=Tt = T being the left derivative), and satisfies

ut−k Δu≤0in Ω.u_t - k\,\Delta u \le 0 \qquad\text{in } \Omega .

Physically ut−kΔuu_t - k\Delta u is the rate at which heat is being supplied, so a subsolution is one with no interior source.

Theorem(Weak maximum principle)AdaptedAdapted from Stakgold & Holst (2011), §8.2, Thm 8.2.1, p. 484; Strauss (2008), §2.3, p. 42

Let U⊂RnU \subset \mathbb{R}^n be open and bounded, T>0T > 0, k>0k > 0, and let uu be a subsolution of the heat equation on Ω=U×(0,T]\Omega = U\times(0,T]. If u≤Mu \le M on the parabolic boundary Γ\Gamma, then u≤Mu \le M on all of Ω‾\overline{\Omega}. Equivalently,

max⁡Ω‾ u=max⁡Γ u.\max_{\overline{\Omega}}\, u = \max_{\Gamma}\, u .

Applying this to −u-u: if ut−kΔu≥0u_t - k\Delta u \ge 0 in Ω\Omega and u≥mu \ge m on Γ\Gamma, then u≥mu \ge m on Ω‾\overline{\Omega}.

NoteAdaptedAdapted from Stakgold & Holst (2011), §8.2, Thm 8.2.1, p. 484; Strauss (2008), §2.3, p. 42; Evans (2010), §2.3.3, Thm 4, pp. 52–53

The three sources state this result with different generality, and the version above is the one followed from Stakgold and Holst (Stakgold & Holst (2011), Thm 8.2.1, p. 484): a differential inequality, in nn space dimensions, on a parabolic domain. Their constant is k=1k = 1; the diffusivity is carried along here, which changes nothing in the argument. Strauss (Strauss (2008), p. 42) states the equation case in one dimension on a rectangle, with the diffusivity kk. Evans (Evans (2010), Thm 4, pp. 52–53) proves the sharper strong maximum principle, also for the equation: if a solution attains its maximum over UT‾\overline{U_T} at a point (x0,t0)(x_0,t_0) of UTU_T and UU is connected, then uu is constant on Ut0‾\overline{U_{t_0}}, that is, at all earlier times. Strauss remarks that the strong version is considerably harder to prove and refers the reader to Protter and Weinberger (Strauss (2008), p. 43); Evans derives it from a mean-value property over "heat balls" (Evans (2010), Thm 3, p. 50). Nothing below uses the strong form.

Idea of the proofOriginal

At an interior maximum of a function of xx alone, calculus gives Δu≤0\Delta u \le 0; at an interior maximum in tt, ut=0u_t = 0. Together these say ut−kΔu≥0u_t - k\Delta u \ge 0, which just fails to contradict ut−kΔu≤0u_t - k\Delta u \le 0: the inequality is not strict, so the maximum could sit inside. The repair is to add a small bump that makes the inequality strict, v=u+ε∣x∣2v = u + \varepsilon|x|^2, whose Laplacian is larger than uu's by the fixed amount 2nε2n\varepsilon. For vv the contradiction is real, so vv has no interior maximum; then let ε→0\varepsilon \to 0. The top face needs separate attention, because a maximum there is one-sided in tt and gives only ut≥0u_t \ge 0 — which is still the wrong sign for the contradiction, so the argument survives.

ProofAdaptedAdapted from Stakgold & Holst (2011), §8.2, Lemma and Thm 8.2.1, pp. 484–485; Strauss (2008), §2.3, pp. 43–44

Step 1: a strict subsolution has no maximum in Ω\Omega. Suppose vv is continuous on Ω‾\overline{\Omega}, has the required derivatives in Ω\Omega, and satisfies the strict inequality vt−kΔv<0v_t - k\Delta v < 0 there. Assume, for contradiction, that vv attains its maximum over the compact set Ω‾\overline{\Omega} at a point P=(x0,t0)∈ΩP = (x_0, t_0) \in \Omega, so that x0∈Ux_0 \in U and 0<t0≤T0 < t_0 \le T.

  • Space. Since UU is open, x0x_0 is an interior maximum of the function x↦v(x,t0)x \mapsto v(x, t_0) on UU. Hence for each ii the function of one variable s↦v(x0+sei,t0)s \mapsto v(x_0 + s e_i, t_0) has an interior maximum at s=0s = 0, so its second derivative there is ≤0\le 0: that is, ∂2v/∂xi2≤0\partial^2 v/\partial x_i^2 \le 0 at PP. Summing, Δv(P)≤0\Delta v(P) \le 0.
  • Time. If t0<Tt_0 < T, then t↦v(x0,t)t \mapsto v(x_0, t) has an interior maximum at t0t_0, so vt(P)=0v_t(P) = 0. If t0=Tt_0 = T, the maximum is one-sided: v(x0,T)≥v(x0,T−δ)v(x_0, T) \ge v(x_0, T - \delta) for small δ>0\delta > 0, so the difference quotients (v(x0,T)−v(x0,T−δ))/δ\bigl(v(x_0,T) - v(x_0, T-\delta)\bigr)/\delta are ≥0\ge 0 and their limit, the left derivative vt(P)v_t(P), satisfies vt(P)≥0v_t(P) \ge 0.

In both cases vt(P)≥0≥k Δv(P)v_t(P) \ge 0 \ge k\,\Delta v(P), using k>0k > 0 in the second inequality, so vt(P)−kΔv(P)≥0v_t(P) - k\Delta v(P) \ge 0. This contradicts the strict inequality. Hence the maximum of vv over Ω‾\overline{\Omega} is attained only on Γ\Gamma.

Step 2: from ≤\le to <<. Let uu be as in the statement and let ε>0\varepsilon > 0. Because UU is bounded, there is a>0a > 0 with ∣x∣≤a|x| \le a for all x∈U‾x \in \overline{U}. Put

v(x,t)=u(x,t)+ε∣x∣2.v(x,t) = u(x,t) + \varepsilon |x|^2 .

Then vt=utv_t = u_t, while Δ∣x∣2=2n\Delta|x|^2 = 2n, so Δv=Δu+2nε\Delta v = \Delta u + 2n\varepsilon and

vt−k Δv=(ut−k Δu)−2nkε≤−2nkε<0,v_t - k\,\Delta v = \bigl(u_t - k\,\Delta u\bigr) - 2nk\varepsilon \le -2nk\varepsilon < 0 ,

where the first inequality is the hypothesis on uu and the second needs k>0k > 0 and ε>0\varepsilon > 0. So Step 1 applies to vv.

Step 3: conclusion. For any (x,t)∈Ω‾(x,t) \in \overline{\Omega},

u(x,t) ≤ v(x,t) ≤ max⁡Γv ≤ max⁡Γu+εa2 ≤ M+εa2,u(x,t) \ \le\ v(x,t) \ \le\ \max_{\Gamma} v \ \le\ \max_{\Gamma} u + \varepsilon a^2 \ \le\ M + \varepsilon a^2 ,

the first step because ε∣x∣2≥0\varepsilon|x|^2 \ge 0, the second by Step 2 and Step 1, the third because ∣x∣≤a|x| \le a on Γ\Gamma, the fourth by hypothesis. The left-hand side does not depend on ε\varepsilon, so letting ε→0+\varepsilon \to 0^+ gives u(x,t)≤Mu(x,t) \le M. Since Γ⊂Ω‾\Gamma \subset \overline\Omega, taking M=max⁡ΓuM = \max_\Gamma u gives the displayed equality of maxima. □\square

Theorem(Comparison, uniqueness and stability)AdaptedAdapted from Stakgold & Holst (2011), §8.2, Thms 8.2.2–8.2.5, pp. 485–486; Strauss (2008), §2.3, uniqueness p. 44 and Eq. (6) p. 45

Let UU, TT, kk, Ω\Omega, Γ\Gamma be as above, and let all functions named be continuous on Ω‾\overline{\Omega} with continuous utu_t and second spatial derivatives in Ω\Omega.

  1. Two-sided bound. If ut=kΔuu_t = k\Delta u in Ω\Omega and m≤u≤Mm \le u \le M on Γ\Gamma, then m≤u≤Mm \le u \le M throughout Ω‾\overline{\Omega}.
  2. Comparison. If ut−kΔu≤vt−kΔvu_t - k\Delta u \le v_t - k\Delta v in Ω\Omega and u≤vu \le v on Γ\Gamma, then u≤vu \le v throughout Ω‾\overline{\Omega}.
  3. Uniqueness. For given ff on Ω\Omega and gg on Γ\Gamma there is at most one uu with ut−k Δu=f  in Ω,u=g  on Γ.u_t - k\,\Delta u = f \ \text{ in } \Omega, \qquad u = g \ \text{ on } \Gamma .
  4. Stability. Let u1,u2u_1, u_2 satisfy ∂tui−kΔui=fi\partial_t u_i - k\Delta u_i = f_i in Ω\Omega, and suppose ∣f1−f2∣≤α  in Ω,∣u1−u2∣≤β  on Γ.|f_1 - f_2| \le \alpha \ \text{ in } \Omega, \qquad |u_1 - u_2| \le \beta \ \text{ on } \Gamma . Then ∣u1−u2∣≤αT+β|u_1 - u_2| \le \alpha T + \beta throughout Ω‾\overline{\Omega}. In particular, for the same source (α=0\alpha = 0) the solution never departs from its data by more than the data departed: max⁡Ω‾∣u1−u2∣≤max⁡Γ∣u1−u2∣\max_{\overline\Omega}|u_1 - u_2| \le \max_{\Gamma}|u_1-u_2|.
ProofAdaptedAdapted from Stakgold & Holst (2011), §8.2, proofs of Thms 8.2.3–8.2.5, pp. 485–486

Each part reduces to the maximum principle applied to a suitable combination.

  1. The principle gives u≤Mu \le M; applied to −u-u, which satisfies (−u)t−kΔ(−u)=0≤0(-u)_t - k\Delta(-u) = 0 \le 0 and −u≤−m-u \le -m on Γ\Gamma, it gives −u≤−m-u \le -m, that is, u≥mu \ge m.
  2. Let w=u−vw = u - v. Then wt−kΔw≤0w_t - k\Delta w \le 0 in Ω\Omega by hypothesis, so ww is a subsolution, and w≤0w \le 0 on Γ\Gamma. The principle with M=0M = 0 gives w≤0w \le 0 on Ω‾\overline\Omega.
  3. If u1u_1 and u2u_2 both solve the problem, then each of the hypotheses of part 2 holds with (u,v)=(u1,u2)(u,v) = (u_1,u_2) and also with (u,v)=(u2,u1)(u,v) = (u_2,u_1), since the two differential expressions are equal and the two boundary functions are equal. Hence u1≤u2u_1 \le u_2 and u2≤u1u_2 \le u_1.
  4. Let w=u1−u2w = u_1 - u_2, so that wt−kΔw=f1−f2w_t - k\Delta w = f_1 - f_2 in Ω\Omega and ∣w∣≤β|w| \le \beta on Γ\Gamma. Put z(x,t)=w(x,t)−αt−β.z(x,t) = w(x,t) - \alpha t - \beta . Then zt−kΔz=(f1−f2)−α≤0z_t - k\Delta z = (f_1 - f_2) - \alpha \le 0 in Ω\Omega, using the bound on f1−f2f_1 - f_2; and on Γ\Gamma we have z≤β−αt−β≤0z \le \beta - \alpha t - \beta \le 0, using ∣w∣≤β|w|\le\beta and α,t≥0\alpha, t \ge 0. By the maximum principle z≤0z \le 0 on Ω‾\overline\Omega, that is, w≤αt+β≤αT+βw \le \alpha t + \beta \le \alpha T + \beta. Repeating the argument with −w-w in place of ww (which satisfies the same two bounds) gives −w≤αT+β-w \le \alpha T + \beta. □\square
Remark(Where the hypotheses are used)Original
  • UU bounded is used twice: to know that the continuous function uu attains a maximum on the compact set Ω‾\overline\Omega at all, and in Step 3 to bound ε∣x∣2\varepsilon|x|^2 by εa2\varepsilon a^2 uniformly. On an unbounded domain the conclusion is false without a growth restriction; see the note below.
  • k>0k > 0 enters in Step 1 (to turn Δv≤0\Delta v \le 0 into kΔv≤0k\Delta v \le 0) and in Step 2 (to make −2nkε-2nk\varepsilon negative). It cannot be dropped: for the backward equation ut=−kuxxu_t = -k u_{xx} on 0≤x≤10 \le x \le 1, the function u(x,t)=eπ2ktsin⁡πxu(x,t) = e^{\pi^2 k t}\sin \pi x is a solution which vanishes on the two lateral sides and has u≤1u \le 1 at t=0t=0, yet u(12,T)=eπ2kTu(\tfrac12, T) = e^{\pi^2 k T}, which exceeds every bound as TT grows. The example also shows why Γ\Gamma must contain the bottom and not the top: for the backward equation the natural data sit on the top.
  • The top face belongs to Ω\Omega, not to Γ\Gamma. This is the only delicate point of Step 1, and it works because a one-sided maximum in tt gives vt≥0v_t \ge 0, which has the same sign as the two-sided conclusion vt=0v_t = 0 needs. Consequently the principle, applied for every TT, bounds the solution for all time by its initial and lateral data.
  • Only an inequality is assumed. Nothing in the proof uses ut=kΔuu_t = k\Delta u. This is what makes the comparison and stability statements cheap: each is obtained by feeding an explicitly built subsolution, such as w−αt−βw - \alpha t - \beta, into the same theorem.
  • The conclusion does not say the maximum is attained only on Γ\Gamma. A solution with constant data is constant, and its maximum is attained everywhere. Stakgold and Holst (Stakgold & Holst (2011), Remark, p. 485) note that constant initial and boundary values up to the time of an interior extremum are the only way this can happen; that sharper statement is the strong maximum principle.
NoteAdaptedAdapted from Evans (2010), §2.3.3, Thm 6, pp. 55–56

On the whole space the principle needs a growth hypothesis. Evans proves that if uu is continuous on Rn×[0,T]\mathbb{R}^n\times[0,T], solves the heat equation (with k=1k=1) in Rn×(0,T)\mathbb{R}^n\times(0,T), equals gg at t=0t=0, and satisfies

u(x,t)≤A ea∣x∣2(x∈Rn, 0≤t≤T)u(x,t) \le A\,e^{a|x|^2} \qquad (x\in\mathbb{R}^n,\ 0 \le t \le T)

for some constants A,a>0A, a > 0, then sup⁡Rn×[0,T]u=sup⁡Rng\sup_{\mathbb{R}^n\times[0,T]} u = \sup_{\mathbb{R}^n} g; uniqueness for the Cauchy problem follows for solutions obeying the two-sided version of that bound (Evans (2010), Thms 6 and 7, pp. 55–56). The proof compares uu with the explicit solutions μ(T+ε−t)−n/2e∣x−y∣2/4(T+ε−t)\mu(T+\varepsilon-t)^{-n/2}e^{|x-y|^2/4(T+\varepsilon-t)} on large balls, and the restriction 4aT<14aT < 1 it needs is removed by stepping through short time intervals. The solution built in the heat kernel is bounded, hence covered.

Example(A decaying mode on top of a steady state)Original

Take n=1n = 1, U=(0,1)U = (0,1), k=1k = 1, and

u(x,t)=x+12 e−π2tsin⁡(πx).u(x,t) = x + \tfrac12\, e^{-\pi^2 t}\sin(\pi x) .

It is a solution. ut=−π22e−π2tsin⁡πxu_t = -\tfrac{\pi^2}{2}e^{-\pi^2t}\sin\pi x and uxx=−π22e−π2tsin⁡πxu_{xx} = -\tfrac{\pi^2}{2}e^{-\pi^2 t}\sin \pi x, since xx is annihilated by ∂xx\partial_{xx}; so ut=uxxu_t = u_{xx} everywhere, and uu is continuous on Ω‾\overline\Omega for any TT.

Its data. On the lateral sides u(0,t)=0u(0,t) = 0 and u(1,t)=1u(1,t) = 1; on the bottom u(x,0)=x+12sin⁡πxu(x,0) = x + \tfrac12\sin\pi x.

The maximum over Γ\Gamma. The bottom profile has derivative 1+π2cos⁡πx1 + \tfrac{\pi}{2}\cos\pi x, which vanishes where cos⁡πx=−2/π\cos \pi x = -2/\pi, that is at

x∗=1πarccos⁡(−2/π)=0.7196679…,x_* = \tfrac1\pi\arccos(-2/\pi) = 0.7196679\ldots,

and there sin⁡πx∗=1−4/π2\sin \pi x_* = \sqrt{1 - 4/\pi^2}, so the bottom maximum is

M=x∗+121−4/π2=1.1052568…M = x_* + \tfrac12\sqrt{1 - 4/\pi^2} = 1.1052568\ldots

The lateral values 00 and 11 are smaller, so max⁡Γu=M=1.10526\max_\Gamma u = M = 1.10526 and min⁡Γu=0\min_\Gamma u = 0.

The theorem's prediction, checked. Part 1 says 0≤u≤1.105260 \le u \le 1.10526 in the whole rectangle, for every TT. Directly: u≥0u \ge 0 because both terms are non-negative on [0,1][0,1], and max⁡xu(x,t)\max_x u(x,t) decreases from 1.105261.10526 at t=0t = 0 to 1.041631.04163 at t=0.02t = 0.02. Beyond t∗=π−2ln⁡(π/2)=0.045755…t_* = \pi^{-2}\ln(\pi/2) = 0.045755\ldots it equals exactly 11, attained at the end x=1x = 1: indeed ux=1+π2e−π2tcos⁡πx≥1−π2e−π2tu_x = 1 + \tfrac{\pi}{2}e^{-\pi^2t}\cos \pi x \ge 1 - \tfrac{\pi}{2}e^{-\pi^2 t}, which is non-negative precisely for t≥t∗t \ge t_*, so from then on uu increases in xx. The maximum over the closed rectangle is therefore attained only at t=0t = 0, as the strong principle would also predict. Note that uu is not monotone in xx at early times, and its maximum over Γ\Gamma is attained at an interior point of the bottom edge: the principle locates the maximum on the parabolic boundary, not at a corner.

Stability in numbers. Let u~\tilde u solve the same equation with the initial profile changed by at most β=10−2\beta = 10^{-2} and the same lateral data. Part 4 with α=0\alpha = 0 gives ∣u−u~∣≤10−2|u - \tilde u| \le 10^{-2} for all xx and all tt, with no computation of u~\tilde u. If instead a source of size at most α=0.1\alpha = 0.1 is switched on, then over T=2T = 2 the two solutions can differ by at most αT+β=0.21\alpha T + \beta = 0.21.

What fails for the backward equation. The function v(x,t)=eπ2tsin⁡πxv(x,t) = e^{\pi^2 t}\sin \pi x solves vt=−vxxv_t = -v_{xx} with v=0v = 0 on both lateral sides and v≤1v \le 1 at t=0t = 0; but v(12,0.1)=e0.1π2=2.6831v(\tfrac12, 0.1) = e^{0.1\pi^2} = 2.6831, nearly three times the bound its parabolic data would suggest. Running diffusion backwards is a different business, and the principle genuinely needs k>0k > 0.

ApplicationOriginal

Bounds before solutions. The principle is the cheapest tool in the subject: it bounds a solution using only the data, with no formula, no series and no mesh. If a reactor wall starts between 20∘20^\circ and 300∘C300^\circ\mathrm{C} and its two faces are held in that range, the interior stays in that range for ever, whatever the geometry. If a diffusing concentration is non-negative initially and at the boundary, and there are no sinks, it stays non-negative — which is what makes a concentration a concentration. For a model with a source ff, part 4 converts an uncertainty α\alpha in the source and β\beta in the data into the guaranteed error bar αT+β\alpha T + \beta on the answer, a model-validation statement that holds before any numerics.

Comparison with explicit barriers. Part 2 is used by choosing vv to be something one can write down. To show that a temperature in a cooled body decays at least exponentially, compare it with a multiple of the slowest decaying mode; to bound a reaction-diffusion solution, compare it with the solution of the ordinary differential equation obtained by deleting the Laplacian, which is a subsolution or supersolution according to the sign of the reaction term (see advection, diffusion and reaction).

Numerical schemes that cannot overshoot. Discretise ut=kuxxu_t = k u_{xx} on a grid xj=j Δxx_j = j\,\Delta x, tn=n Δtt_n = n\,\Delta t by the explicit scheme

Ujn+1=λ Uj−1n+(1−2λ) Ujn+λ Uj+1n,λ=k ΔtΔx2.U_j^{n+1} = \lambda\,U_{j-1}^{n} + (1 - 2\lambda)\,U_j^{n} + \lambda\,U_{j+1}^{n}, \qquad \lambda = \frac{k\,\Delta t}{\Delta x^2} .

The three weights sum to 11, and they are all non-negative exactly when λ≤12\lambda \le \tfrac12. In that case each new value is a weighted average of three old ones, so min⁡jUjn≤Ujn+1≤max⁡jUjn\min_j U^n_j \le U^{n+1}_j \le \max_j U^n_j: the scheme obeys a discrete maximum principle and can never manufacture a temperature outside the range of the data. For λ>12\lambda > \tfrac12 the middle weight is negative and the computed solution oscillates with growing amplitude. This is the same threshold that von Neumann's Fourier analysis of the scheme produces, reached here without any Fourier analysis. For copper, k≈1.1 cm2/sk \approx 1.1\,\mathrm{cm^2/s}, a 1 mm1\,\mathrm{mm} grid forces Δt≤Δx2/2k=4.5×10−3 s\Delta t \le \Delta x^2/2k = 4.5\times10^{-3}\,\mathrm{s}. See finite differences and von Neumann stability.

Uniqueness as a licence. Part 3 is what allows the separation-of-variables series, the Green's-function integral and the finite-element approximation to be called "the" solution and compared with each other: any two of them that satisfy the same initial and boundary conditions must agree (see diffusion in bounded domains).

Method

Diffusion in bounded domains

Adapted

How to solve the heat equation on an interval by separating variables: the eigenvalue problem set by the boundary condition, the exponentially decaying modes it produces, the rate at which the solution settles to its equilibrium, and two ways to handle boundary data that are not zero.

Prerequisites: Eigenfunction expansions, Maximum principle for the heat equation, Uniform convergence, Integrating and differentiating series term by term

Definition(The initial-boundary-value problem and its eigenvalue problem)AdaptedAdapted from Strauss (2008), §4.1, Eqs. (13)–(16), p. 87; Strauss (2008), §4.2, Eq. (1), p. 89

On an interval 0<x<ℓ0 < x < \ell with diffusivity k>0k > 0 we consider

ut=k uxx(0<x<ℓ, t>0),u(x,0)=φ(x),u_t = k\,u_{xx} \quad (0 < x < \ell,\ t > 0), \qquad u(x,0) = \varphi(x),

together with one boundary condition at each end. The three standard homogeneous choices are

  • Dirichlet (ends held at the reference value): u(0,t)=u(ℓ,t)=0u(0,t) = u(\ell,t) = 0;
  • Neumann (ends insulated, no flux): ux(0,t)=ux(ℓ,t)=0u_x(0,t) = u_x(\ell,t) = 0;
  • mixed: one of each, for instance u(0,t)=ux(ℓ,t)=0u(0,t) = u_x(\ell,t) = 0.

A separated solution is one of the form u=X(x) T(t)u = X(x)\,T(t). Substituting and dividing by kXTkXT gives

T′kT=X′′X=−λ,\frac{T'}{kT} = \frac{X''}{X} = -\lambda ,

a quantity that depends on neither xx nor tt and so is a constant. Hence T′=−λkTT' = -\lambda k T, so T(t)=e−λktT(t) = e^{-\lambda k t} up to a factor, and XX solves the eigenvalue problem

−X′′=λXon (0,ℓ),plus the boundary condition.-X'' = \lambda X \quad \text{on } (0,\ell), \qquad \text{plus the boundary condition.}

A number λ\lambda for which this has a solution X≢0X \not\equiv 0 is an eigenvalue and such an XX an eigenfunction; Strauss (Strauss (2008), p. 88) notes that physicists and engineers call the eigenfunctions normal modes, since they are the shapes that persist for all time, decaying as a whole. We write λn\lambda_n, XnX_n for them.

Method(The modes of an interval)AdaptedAdapted from Strauss (2008), §4.1, Eq. (8), p. 85 and the eigenvalue terminology, p. 88; Strauss (2008), §4.2, Eqs. (2)–(4), p. 90 and Eq. (10), p. 91

For −X′′=λX-X'' = \lambda X on (0,ℓ)(0,\ell):

condition eigenvalues λn\lambda_n eigenfunctions Xn(x)X_n(x)
X(0)=X(ℓ)=0X(0)=X(\ell)=0 (nπ/ℓ)2(n\pi/\ell)^2, n=1,2,…n = 1,2,\dots sin⁡(nπx/ℓ)\sin(n\pi x/\ell)
X′(0)=X′(ℓ)=0X'(0)=X'(\ell)=0 (nπ/ℓ)2(n\pi/\ell)^2, n=0,1,2,…n = 0,1,2,\dots cos⁡(nπx/ℓ)\cos(n\pi x/\ell)
X(0)=X′(ℓ)=0X(0)=X'(\ell)=0 ((n+12)π/ℓ)2\bigl((n+\tfrac12)\pi/\ell\bigr)^2, n=0,1,2,…n = 0,1,2,\dots sin⁡((n+12)πx/ℓ)\sin\bigl((n+\tfrac12)\pi x/\ell\bigr)

In each case these are all the eigenvalues, including complex ones. The Dirichlet eigenvalues are strictly positive; the Neumann list contains λ0=0\lambda_0 = 0, whose eigenfunction is any constant, and its smallest positive eigenvalue is (π/ℓ)2(\pi/\ell)^2. There are infinitely many of them, in contrast with an N×NN\times N matrix, which has at most NN (Strauss (2008), p. 88).

NoteAdaptedAdapted from Strauss (2008), §4.1, p. 88; Strauss (2008), §4.2, p. 90 and Eq. (10), p. 91 with Exercises 1–2, p. 92

Strauss proves the Dirichlet claim by hand: λ=0\lambda = 0 would force X=C+DxX = C + Dx with C=D=0C = D = 0; λ=−γ2<0\lambda = -\gamma^2 < 0 would force Dsinh⁡γℓ=0D\sinh\gamma\ell = 0 with sinh⁡γℓ≠0\sinh\gamma\ell \ne 0; and for complex λ\lambda, writing X=Ceγx+De−γxX = Ce^{\gamma x}+De^{-\gamma x} with γ2=−λ\gamma^2 = -\lambda, the two boundary conditions give e2γℓ=1e^{2\gamma\ell}=1, hence γ=nπi/ℓ\gamma = n\pi i/\ell and λ=n2π2/ℓ2\lambda = n^2\pi^2/\ell^2 (Strauss (2008), p. 88). For the Neumann problem he verifies the positive eigenvalues and λ=0\lambda = 0 directly and states that the exclusion of negative and complex λ\lambda goes the same way (Strauss (2008), p. 90). For the mixed case he gives the eigenvalues (n+12)2π2/ℓ2(n+\tfrac12)^2\pi^2/\ell^2 and the eigenfunctions outright at Eq. (10) (Strauss (2008), p. 91), leaving only their derivation to Exercises 1–2 (Strauss (2008), p. 92). The general reason behind all three is that −d2/dx2-d^2/dx^2 with any of these conditions is self-adjoint and non-negative, which is the subject of Sturm-Liouville theory.

Method(Separation of variables, homogeneous boundary data)AdaptedAdapted from Strauss (2008), §4.1, pp. 87–88; Strauss (2008), §4.2, Eqs. (5)–(6), p. 90
  1. Find the modes. Solve −X′′=λX-X'' = \lambda X with the given boundary condition, obtaining λn\lambda_n and XnX_n from the table.
  2. Attach the time factors. Each Xn(x) e−λnktX_n(x)\,e^{-\lambda_n k t} solves the equation and the boundary conditions. Write the candidate solution as the superposition u(x,t)=∑nAn e−λnkt Xn(x).u(x,t) = \sum_n A_n\, e^{-\lambda_n k t}\, X_n(x) .
  3. Match the initial data. Setting t=0t = 0 requires φ=∑nAnXn\varphi = \sum_n A_n X_n, so the AnA_n are the eigenfunction coefficients of φ\varphi (eigenfunction expansions). For the interval these are Fourier sine or cosine coefficients: An=2ℓ∫0ℓφ(x) sin⁡nπxℓ dx(Dirichlet),An=2ℓ∫0ℓφ(x) cos⁡nπxℓ dx(Neumann),A_n = \frac{2}{\ell}\int_0^{\ell}\varphi(x)\,\sin\frac{n\pi x}{\ell}\,dx \quad\text{(Dirichlet)}, \qquad A_n = \frac{2}{\ell}\int_0^{\ell}\varphi(x)\,\cos\frac{n\pi x}{\ell}\,dx \quad\text{(Neumann)}, the Neumann series being written u=12A0+∑n≥1Ane−λnktcos⁡(nπx/ℓ)u = \tfrac12 A_0 + \sum_{n\ge1}A_n e^{-\lambda_n kt}\cos(n\pi x/\ell) so that the same formula gives A0A_0.
  4. Read off the long-time behaviour. The slowest-decaying mode dominates. Under Dirichlet conditions every λn>0\lambda_n > 0, so u→0u \to 0 at the rate e−λ1kte^{-\lambda_1 k t} with λ1=(π/ℓ)2\lambda_1 = (\pi/\ell)^2. Under Neumann conditions the n=0n=0 mode does not decay, so u→12A0=1ℓ∫0ℓφu \to \tfrac12 A_0 = \frac{1}{\ell}\int_0^\ell \varphi, the average of the initial data: nothing escapes through an insulated end, so the substance spreads out uniformly.
  5. Check. Verify the series term by term against the equation and the boundary conditions, and bound the answer with the maximum principle, which also guarantees that no second solution continuous on the closed rectangle [0,ℓ]×[0,T][0,\ell]\times[0,T] takes the same initial and boundary values.
Method(The series is a solution, and how fast it decays)Original

Let k>0k>0, ℓ>0\ell>0, let φ\varphi be square-integrable on (0,ℓ)(0,\ell), let AnA_n be its sine coefficients and λn=(nπ/ℓ)2\lambda_n = (n\pi/\ell)^2, and put

u(x,t)=∑n=1∞An e−λnkt sin⁡nπxℓ,t>0.u(x,t) = \sum_{n=1}^{\infty} A_n\,e^{-\lambda_n k t}\,\sin\frac{n\pi x}{\ell}, \qquad t > 0 .

Then:

  1. The series, and the series obtained by differentiating it term by term any number of times in xx and tt, converge absolutely and uniformly on [0,ℓ]×[δ,∞)[0,\ell]\times[\delta,\infty) for every δ>0\delta > 0. Hence uu is infinitely differentiable on [0,ℓ]×(0,∞)[0,\ell]\times(0,\infty).
  2. ut=k uxxu_t = k\,u_{xx} for 0<x<ℓ0<x<\ell, t>0t>0, and u(0,t)=u(ℓ,t)=0u(0,t) = u(\ell,t) = 0 for every t>0t>0.
  3. ∥u(⋅,t)−φ∥L2(0,ℓ)→0\|u(\cdot,t) - \varphi\|_{L^2(0,\ell)} \to 0 as t→0+t \to 0^{+}.
  4. ∥u(⋅,t)∥L2(0,ℓ)≤e−λ1kt ∥φ∥L2(0,ℓ)\|u(\cdot,t)\|_{L^2(0,\ell)} \le e^{-\lambda_1 k t}\,\|\varphi\|_{L^2(0,\ell)} for all t>0t>0, with λ1=(π/ℓ)2\lambda_1 = (\pi/\ell)^2. The relaxation time is therefore τ=1λ1k=ℓ2π2k.\tau = \frac{1}{\lambda_1 k} = \frac{\ell^2}{\pi^2 k} .

The same statements hold for the cosine series under Neumann conditions, with part 4 applied to u−12A0u - \tfrac12 A_0 and φ−12A0\varphi - \tfrac12 A_0, the first positive Neumann eigenvalue again being (π/ℓ)2(\pi/\ell)^2.

Idea of the proofOriginal

Everything rests on the factor e−λnkt=e−(nπ/ℓ)2kte^{-\lambda_n k t} = e^{-(n\pi/\ell)^2 k t}. For any fixed positive time it beats every power of nn, so differentiating the series as often as one likes, which multiplies the nn-th term by a power of nn, cannot stop it converging uniformly. That makes term-by-term differentiation legal for t>0t>0, and then each term does the work. At t=0t = 0 the factor is 11 and this argument collapses, which is why the initial condition is recovered only in the mean-square sense, from Parseval's identity rather than from any smoothness. The decay rate is Parseval again: every coefficient is multiplied by at most e−λ1kte^{-\lambda_1 kt}.

ProofOriginal

Write Sn(x)=sin⁡(nπx/ℓ)S_n(x) = \sin(n\pi x/\ell) and c=kδc = k\delta.

Step 1 (the coefficients are bounded). By Parseval's identity for the sine system on (0,ℓ)(0,\ell) (eigenfunction expansions),

ℓ2∑n≥1An2=∫0ℓφ2 dx<∞,\frac{\ell}{2}\sum_{n\ge1} A_n^2 = \int_0^\ell \varphi^2\,dx < \infty ,

so An→0A_n \to 0; in particular ∣An∣≤C|A_n| \le C for all nn, with C=sup⁡n∣An∣C = \sup_n |A_n|.

Step 2 (uniform convergence of every derived series). Differentiating the nn-th term jj times in tt and mm times in xx multiplies it by (−λnk)j(-\lambda_n k)^{j} and by (nπ/ℓ)m(n\pi/\ell)^{m} up to replacing the sine by a cosine, so for t≥δt \ge \delta its absolute value is at most

C (kπ2/ℓ2)j (π/ℓ)m  n2j+m e−c n2π2/ℓ2,C\,(k\pi^2/\ell^2)^{j}\,(\pi/\ell)^{m}\; n^{2j+m}\, e^{-c\,n^2\pi^2/\ell^2} ,

using ∣An∣≤C|A_n| \le C from Step 1 and e−λnkt≤e−λnce^{-\lambda_n k t} \le e^{-\lambda_n c} from t≥δt \ge \delta. The numbers npe−cn2π2/ℓ2n^{p}e^{-cn^2\pi^2/\ell^2} are summable for every fixed pp, because npe−an2≤npe−ann^{p}e^{-an^2} \le n^p e^{-an} for n≥1n \ge 1 and a>0a>0. So each derived series is dominated by a convergent series of constants, hence converges absolutely and uniformly on [0,ℓ]×[δ,∞)[0,\ell]\times[\delta,\infty) (uniform convergence). The three hypotheses of the term-by-term differentiation theorem are therefore met in each variable separately on every closed interval inside that region — the series converges uniformly, each term is continuously differentiable, and the differentiated series converges uniformly — so the series may be differentiated term by term, once in each variable and then, by the same argument applied to the differentiated series, as often as one likes. Hence uu is C∞C^\infty on [0,ℓ]×(δ,∞)[0,\ell]\times(\delta,\infty); as δ>0\delta>0 was arbitrary, part 1 follows.

Step 3 (equation and boundary conditions). By Step 2 we may compute

ut−k uxx=∑n≥1An[(−λnk)+kλn]e−λnktSn(x)=0,u_t - k\,u_{xx} = \sum_{n\ge1} A_n\Bigl[(-\lambda_n k) + k\lambda_n\Bigr] e^{-\lambda_n kt} S_n(x) = 0 ,

because −Sn′′=λnSn-S_n'' = \lambda_n S_n by the choice of λn\lambda_n. Each SnS_n vanishes at x=0x = 0 and x=ℓx = \ell, and the series converges uniformly up to those endpoints for t≥δt \ge \delta, so u(0,t)=u(ℓ,t)=0u(0,t) = u(\ell,t) = 0. This is part 2.

Step 4 (the initial data, in mean square). By Parseval again, applied to the function u(⋅,t)−φu(\cdot,t)-\varphi whose nn-th sine coefficient is An(e−λnkt−1)A_n(e^{-\lambda_n kt}-1),

∥u(⋅,t)−φ∥L22=ℓ2∑n≥1An2(1−e−λnkt)2.\|u(\cdot,t)-\varphi\|_{L^2}^2 = \frac{\ell}{2}\sum_{n\ge1}A_n^2\bigl(1 - e^{-\lambda_n k t}\bigr)^2 .

Let ε>0\varepsilon>0. Choose NN with ℓ2∑n>NAn2<ε/2\frac{\ell}{2}\sum_{n>N}A_n^2 < \varepsilon/2, possible by Step 1; the tail of the sum above is then <ε/2< \varepsilon/2 as well, since 0≤1−e−λnkt≤10 \le 1-e^{-\lambda_n kt} \le 1. The remaining finite sum has at most NN terms, each tending to 00 as t→0+t\to0^+, so it is <ε/2<\varepsilon/2 for tt small. This is part 3.

Step 5 (decay). Since λ1≤λn\lambda_1 \le \lambda_n for all nn and k,t>0k, t > 0, we have e−λnkt≤e−λ1kte^{-\lambda_n kt} \le e^{-\lambda_1 kt}, so

∥u(⋅,t)∥L22=ℓ2∑n≥1An2e−2λnkt≤e−2λ1kt ℓ2∑n≥1An2=e−2λ1kt ∥φ∥L22,\|u(\cdot,t)\|^2_{L^2} = \frac{\ell}{2}\sum_{n\ge1}A_n^2 e^{-2\lambda_n kt} \le e^{-2\lambda_1 kt}\,\frac{\ell}{2}\sum_{n\ge1}A_n^2 = e^{-2\lambda_1 kt}\,\|\varphi\|^2_{L^2} ,

which is part 4. For the Neumann case, replace the sine system by the cosine system; Parseval reads ∫0ℓf2=ℓ(A0/2)2+ℓ2∑n≥1An2\int_0^\ell f^2 = \ell(A_0/2)^2 + \frac{\ell}{2}\sum_{n\ge1}A_n^2, the n=0n = 0 term is unaffected by the time factor e−λ0kt=1e^{-\lambda_0 kt} = 1, and the estimate above applies to the remaining terms, whose eigenvalues are all at least (π/ℓ)2(\pi/\ell)^2. □\square

Remark(Where the hypotheses are used, and two warnings)Original
  • Only square-integrability of φ\varphi is used, through Step 1. No continuity, and certainly no compatibility with the boundary conditions, is needed: the solution is smooth for every t>0t>0 regardless, which is the smoothing already seen in the heat kernel.
  • t≥δ>0t \ge \delta > 0 is essential in Step 2, and so part 1 says nothing at t=0t = 0. If φ\varphi is continuous with φ(0)=φ(ℓ)=0\varphi(0)=\varphi(\ell)=0 and piecewise C1C^1, its sine series converges uniformly and then u→φu \to \varphi uniformly as well; without such a hypothesis part 3 is all that is available.
  • k>0k>0 again. Reversing the sign of kk turns every factor e−λnkte^{-\lambda_n kt} into e+λn∣k∣te^{+\lambda_n|k|t}, and the series diverges for every t>0t>0 unless the coefficients decay faster than every exponential. Backwards diffusion on an interval is as ill-posed as on the line.
  • Uniqueness is not part of the construction. It comes from the maximum principle, which also gives the bound min⁡{0,inf⁡φ}≤u≤max⁡{0,sup⁡φ}\min\{0,\inf\varphi\} \le u \le \max\{0,\sup\varphi\} under Dirichlet conditions — a useful check on a truncated series, which can oscillate. Both need more than this statement supplies: the principle is about functions continuous on the closed rectangle [0,ℓ]×[0,T][0,\ell]\times[0,T] with finite data, so it applies when φ\varphi is bounded with φ(0)=φ(ℓ)=0\varphi(0)=\varphi(\ell)=0 and uu extends continuously to t=0t=0, as in the previous bullet, and not to a merely square-integrable φ\varphi, for which inf⁡φ\inf\varphi and sup⁡φ\sup\varphi may be infinite and uu need have no limit at t=0t=0 at each point.
  • Term-by-term differentiation at the boundary. Strauss (Strauss (2008), §5.6, p. 147) makes this a cautionary tale: with inhomogeneous boundary data, inserting the sine series into the equation and differentiating twice term by term yields un′+kλnun=0u_n' + k\lambda_n u_n = 0, which cannot meet the boundary data at all, and he draws the moral that the differentiation step is the illegal one. The correct version is in the next method.
Method(Inhomogeneous boundary data)AdaptedAdapted from Strauss (2008), §5.6, Method of shifting the data, pp. 149–150; Strauss (2008), §5.6, Expansion method, Eqs. (2)–(10), pp. 147–148

Now let the ends be driven:

ut=k uxx,u(0,t)=h(t),u(ℓ,t)=j(t),u(x,0)=φ(x).u_t = k\,u_{xx}, \qquad u(0,t) = h(t), \quad u(\ell,t) = j(t), \qquad u(x,0) = \varphi(x) .

No separated solution can satisfy these boundary conditions, so one of two routes is needed.

Route A: shift the data. Subtract any known function that meets the boundary conditions. With

uˉ(x,t)=(1−xℓ)h(t)+xℓ j(t),\bar u(x,t) = \Bigl(1 - \frac{x}{\ell}\Bigr)h(t) + \frac{x}{\ell}\,j(t) ,

the difference v=u−uˉv = u - \bar u has homogeneous Dirichlet conditions, initial data φ−uˉ(⋅,0)\varphi - \bar u(\cdot,0), and the source term −(uˉt−kuˉxx)=−uˉt-(\bar u_t - k\bar u_{xx}) = -\bar u_t on the right-hand side. When hh and jj are constants this is the best possible choice: uˉ\bar u is then the steady state, uˉt=0\bar u_t = 0, and vv solves the homogeneous problem of the previous method exactly. The physical reading is that the solution is the equilibrium profile plus a transient that dies at the rate e−t/τe^{-t/\tau}, τ=ℓ2/π2k\tau = \ell^2/\pi^2 k.

Route B: expand, and keep the boundary terms. Expand the unknown itself, u(x,t)=∑n≥1un(t)sin⁡(nπx/ℓ)u(x,t) = \sum_{n\ge1}u_n(t)\sin(n\pi x/\ell) with un(t)=2ℓ∫0ℓu(x,t)sin⁡(nπx/ℓ)dxu_n(t) = \frac2\ell\int_0^\ell u(x,t)\sin(n\pi x/\ell)dx, and differentiate under the integral sign rather than term by term. Then un′=2ℓ∫0ℓut Sn dx=2kℓ∫0ℓuxxSn dxu_n' = \frac2\ell\int_0^\ell u_t\, S_n\,dx = \frac{2k}{\ell}\int_0^\ell u_{xx}S_n\,dx, and integrating by parts twice, with Sn(0)=Sn(ℓ)=0S_n(0)=S_n(\ell)=0 and Sn′(0)=nπ/ℓS_n'(0) = n\pi/\ell, Sn′(ℓ)=(−1)nnπ/ℓS_n'(\ell) = (-1)^n n\pi/\ell:

∫0ℓuxxSn dx=−[u Sn′]0ℓ−λn∫0ℓu Sn dx=nπℓ(h(t)−(−1)nj(t))−ℓλn2un(t).\int_0^\ell u_{xx}S_n\,dx = -\bigl[u\,S_n'\bigr]_0^{\ell} - \lambda_n\int_0^\ell u\,S_n\,dx = \frac{n\pi}{\ell}\Bigl(h(t) - (-1)^n j(t)\Bigr) - \frac{\ell\lambda_n}{2}u_n(t) .

The boundary data enter here, and nowhere else. So each coefficient obeys a forced linear ordinary differential equation,

un′(t)+kλnun(t)=2nπkℓ2(h(t)−(−1)nj(t)),un(0)=2ℓ∫0ℓφ Sn dx,u_n'(t) + k\lambda_n u_n(t) = \frac{2n\pi k}{\ell^2}\Bigl(h(t) - (-1)^n j(t)\Bigr), \qquad u_n(0) = \frac{2}{\ell}\int_0^\ell \varphi\, S_n\,dx ,

whose solution by the integrating factor ekλnte^{k\lambda_n t} is

un(t)=un(0) e−kλnt+2nπkℓ2∫0te−kλn(t−s)(h(s)−(−1)nj(s)) ds.u_n(t) = u_n(0)\,e^{-k\lambda_n t} + \frac{2n\pi k}{\ell^2}\int_0^t e^{-k\lambda_n(t-s)}\Bigl(h(s) - (-1)^n j(s)\Bigr)\,ds .

Route B needs no guess and handles time-dependent data directly; Route A is quicker whenever the data are steady or share a single time dependence, for instance h=Hcos⁡ωth = H\cos\omega t, j=Jcos⁡ωtj = J\cos\omega t, when one looks for uˉ=u0(x)cos⁡ωt\bar u = u_0(x)\cos\omega t (Strauss (2008), p. 150).

Example(A Dirichlet transient, with numbers)Original

Take ℓ=1\ell = 1, k=1k = 1, Dirichlet ends, and φ(x)=x(1−x)\varphi(x) = x(1-x).

  1. Coefficients. An=2∫01x(1−x)sin⁡(nπx) dx=4(1−(−1)n)n3π3A_n = 2\int_0^1 x(1-x)\sin(n\pi x)\,dx = \dfrac{4\bigl(1-(-1)^n\bigr)}{n^3\pi^3}, which is 8/(n3π3)8/(n^3\pi^3) for odd nn and 00 for even nn — as it must be, since φ\varphi is symmetric about x=12x = \tfrac12 and the even modes are antisymmetric.
  2. Solution. u(x,t)=∑n odd8n3π3 e−n2π2tsin⁡(nπx)u(x,t) = \displaystyle\sum_{n \text{ odd}} \frac{8}{n^3\pi^3}\,e^{-n^2\pi^2 t}\sin(n\pi x).
  3. Numbers at the midpoint. u(12,0)=14u(\tfrac12,0) = \tfrac14. At t=0.1t = 0.1 the series gives u(12,0.1)=0.0961619u(\tfrac12,0.1) = 0.0961619, of which the first mode alone contributes 8π3e−π2/10=0.0961632\frac{8}{\pi^3}e^{-\pi^2/10} = 0.0961632: after one relaxation time the higher modes have gone, the error from truncating after one term being 1.3×10−61.3\times10^{-6}. At t=0.5t = 0.5, u(12,0.5)=0.00185559u(\tfrac12,0.5) = 0.00185559.
  4. Decay bound, checked. Here ∥φ∥L2=1/30=0.1825742\|\varphi\|_{L^2} = 1/\sqrt{30} = 0.1825742 and λ1=π2\lambda_1 = \pi^2. Part 4 of the statement predicts ∥u(⋅,0.1)∥L2≤e−π2/10/30=0.0680468\|u(\cdot,0.1)\|_{L^2} \le e^{-\pi^2/10}/\sqrt{30} = 0.0680468; the actual value from Parseval is 0.06799760.0679976, just inside, the small slack being the contribution of the third mode.
  5. Relaxation time. τ=1/π2=0.101321\tau = 1/\pi^2 = 0.101321. Doubling the length to ℓ=2\ell = 2 multiplies τ\tau by four: a bar twice as long takes four times as long to cool, the same quadratic law as the diffusion length.
  6. Maximum principle, checked. 0≤u≤140 \le u \le \tfrac14 everywhere, consistent with the bound from the data.
Example(Insulated ends settle to the mean)Original

Same interval and diffusivity, but with insulated ends ux(0,t)=ux(1,t)=0u_x(0,t) = u_x(1,t) = 0 and the initial ramp φ(x)=x\varphi(x) = x.

Cosine coefficients: A0=2∫01x dx=1A_0 = 2\int_0^1 x\,dx = 1 and An=2∫01xcos⁡(nπx) dx=2((−1)n−1)/(n2π2)A_n = 2\int_0^1 x\cos(n\pi x)\,dx = 2\bigl((-1)^n-1\bigr)/(n^2\pi^2), which is −4/(n2π2)-4/(n^2\pi^2) for odd nn and 00 for even nn. Hence

u(x,t)=12−∑n odd4n2π2 e−n2π2tcos⁡(nπx).u(x,t) = \frac12 - \sum_{n\text{ odd}}\frac{4}{n^2\pi^2}\,e^{-n^2\pi^2 t}\cos(n\pi x) .

The n=0n=0 term is 12A0=12=∫01x dx\tfrac12 A_0 = \tfrac12 = \int_0^1 x\,dx: the average of the data, which is conserved because no flux leaves through an insulated end. Indeed ddt∫01u dx=k∫01uxxdx=k[ux]01=0\frac{d}{dt}\int_0^1 u\,dx = k\int_0^1 u_{xx}dx = k[u_x]_0^1 = 0.

Numbers at the cold end. u(0,t)u(0,t) rises from 00 towards 12\tfrac12: u(0,0.05)=0.252044u(0,0.05) = 0.252044, u(0,0.5)=0.497085u(0,0.5) = 0.497085. At the hot end u(1,0.05)=0.747956u(1,0.05) = 0.747956, and u(0,t)+u(1,t)=1u(0,t)+u(1,t) = 1 exactly for every tt, by the antisymmetry of φ−12\varphi - \tfrac12 about x=12x = \tfrac12. The deviation from the mean decays like e−π2te^{-\pi^2 t}, so after t=3τ=3/π2=0.304t = 3\tau = 3/\pi^2 = 0.304 it has fallen by a factor e−3≈0.05e^{-3} \approx 0.05, which is what "settled" means in practice.

Example(A driven end: the steady state plus a transient)Original

Take ℓ=1\ell = 1, k=1k = 1, u(0,t)=0u(0,t) = 0, u(1,t)=1u(1,t) = 1 (a bar with one end suddenly clamped at temperature 11), and u(x,0)=0u(x,0) = 0. The boundary data are inhomogeneous but constant, so Route A applies with the steady state uˉ(x)=x\bar u(x) = x.

  1. Shift. v=u−xv = u - x has v(0,t)=v(1,t)=0v(0,t)=v(1,t)=0 and v(x,0)=−xv(x,0) = -x.
  2. Expand. The sine coefficients of −x-x on (0,1)(0,1) are −2∫01xsin⁡(nπx)dx=2(−1)n/(nπ)-2\int_0^1 x\sin(n\pi x)dx = 2(-1)^{n}/(n\pi).
  3. Solution. u(x,t)=x+2π∑n=1∞(−1)nn e−n2π2t sin⁡(nπx).u(x,t) = x + \frac{2}{\pi}\sum_{n=1}^{\infty}\frac{(-1)^n}{n}\,e^{-n^2\pi^2 t}\,\sin(n\pi x) . At t=0t=0 the series is the sine series of −x-x, so u(x,0)=0u(x,0)=0, as required; for t>0t>0 it decays and u→xu \to x.
  4. Numbers at the midpoint. u(12,0.01)=0.000407u(\tfrac12,0.01) = 0.000407, u(12,0.05)=0.113844u(\tfrac12,0.05) = 0.113844, u(12,0.2)=0.4115664u(\tfrac12,0.2) = 0.4115664. The last value is 12−2πe−π2/5=0.5−0.0884336\tfrac12 - \tfrac{2}{\pi}e^{-\pi^2/5} = 0.5 - 0.0884336 to seven digits, again because only the first mode survives. The midpoint reaches 99%99\% of its final value 12\tfrac12 when 2πe−π2t<0.005\frac{2}{\pi}e^{-\pi^2 t} < 0.005, that is t>0.4911t > 0.4911, about five relaxation times.
  5. Where the modes come from. Note that the nn-th coefficient decays only like 1/n1/n, because −x-x does not vanish at x=1x=1: the shifted initial data are incompatible with the boundary condition there. The series therefore converges slowly at t=0t = 0 — and converges beautifully for every t>0t>0, which is exactly the content of part 1 of the statement.
ApplicationOriginal

Which number actually matters. For a bounded body the whole of the long-time behaviour is in the smallest eigenvalue: the solution relaxes as e−t/τe^{-t/\tau} with τ=1/λ1k\tau = 1/\lambda_1 k, and λ1\lambda_1 is set by the geometry alone. For an interval of length ℓ\ell with both ends held fixed, τ=ℓ2/π2k\tau = \ell^2/\pi^2 k. A 2 cm2\,\mathrm{cm} copper rod (k≈1.1 cm2/sk \approx 1.1\,\mathrm{cm^2/s}) has τ=4/(π2⋅1.1)=0.37 s\tau = 4/(\pi^2\cdot1.1) = 0.37\,\mathrm{s}; a 2 cm2\,\mathrm{cm} layer of dry soil (k≈2×10−3 cm2/sk \approx 2\times10^{-3}\,\mathrm{cm^2/s}) has τ=200 s\tau = 200\,\mathrm{s}. Designers of thermal insulation, annealing schedules and reactor shields quote this one number.

Mode truncation is a numerical method. Because mode nn decays as e−n2t/τe^{-n^2 t/\tau}, the series is its own error estimate: after one relaxation time the second mode is down by e−3=0.05e^{-3} = 0.05 relative to the first and the third by e−8=3×10−4e^{-8} = 3\times10^{-4}. Two or three terms then give several digits, as the examples show, which is why spectral methods are so efficient for diffusion and so delicate at t=0t = 0 (see spectral methods).

Insulated versus open ends. The difference between the Dirichlet and Neumann tables is a single eigenvalue, λ0=0\lambda_0 = 0, and it changes the physics entirely: with open ends the contents of the interval drain away to zero; with insulated ends the total amount is conserved and the profile flattens to its average. A calorimeter is designed to realise the second case, a diffusion cell with large reservoirs at both ends the first.

The same answer as the Green's function. Stakgold and Holst (Stakgold & Holst (2011), Eq. (8.2.36a), p. 482) write the Dirichlet heat Green's function for (0,ℓ)(0,\ell) both as an image sum of Gaussians and as the eigenfunction series 2ℓ∑n≥1sin⁡nπxℓsin⁡nπξℓe−kλnt\frac{2}{\ell}\sum_{n\ge1}\sin\frac{n\pi x}{\ell}\sin\frac{n\pi \xi}{\ell}e^{-k\lambda_n t}, the two being linked by the theta-function identity. Convolving either against φ\varphi reproduces the series of this unit, so the modal method and the Green's-function method (Green's functions for the wave and heat equations) are two faces of one formula; the Gaussian form is the practical one at very early times, the modal form at late times.

Beyond the interval. Steps 1 to 5 are unchanged in higher dimensions and in other coordinate systems: only the eigenvalue problem changes, giving Bessel functions on a disc and spherical harmonics with spherical Bessel functions on a ball (separation of variables). The decay law e−λ1kte^{-\lambda_1 k t} and the identification of the limit with the λ=0\lambda = 0 mode survive verbatim.

Application

Advection, diffusion and reaction

Adapted

Adding transport and reaction to the diffusion equation: the Peclet number that says which of advection and diffusion wins, the change to a moving frame that solves the linear problem exactly, and the travelling fronts that a bistable reaction term supports.

Prerequisites: The heat kernel, First-order equations and characteristics, Travelling-wave solutions

Definition(Advection, diffusion, reaction)AdaptedAdapted from Stakgold & Holst (2011), §0.1, Remark 1, Eq. (0.1.9), p. 6; Stakgold & Holst (2011), §0.3, Eq. (0.3.1), p. 12, Eq. (0.3.11), p. 14 and Eqs. (0.3.13)–(0.3.18), pp. 15–16; Strauss (2008), §1.3, p. 15

Let u(x,t)u(x,t) be the concentration of a substance carried along a pipe. Conservation of mass on an arbitrary interval says ut=−Jx+pu_t = -J_x + p, where JJ is the flux and pp the volume rate of production. Two mechanisms contribute to JJ:

  • diffusion, by Fick's law Jdiff=−D uxJ_{\mathrm{diff}} = -D\,u_x with D>0D>0 the diffusivity, as in (Strauss (2008), p. 15);
  • advection (also called convection), the bodily transport of the substance by a fluid moving with velocity VV: Jadv=VuJ_{\mathrm{adv}} = V u. Stakgold and Holst (Stakgold & Holst (2011), Remark 1, p. 6) introduce exactly this term by replacing Fourier's law J=−k grad uJ = -k\,\mathrm{grad}\,u with J=−k grad u+CuvJ = -k\,\mathrm{grad}\,u + Cu\mathbf{v} for a medium moving with velocity v\mathbf{v}, and note that for an incompressible fluid, where div v=0\mathrm{div}\,\mathbf{v} = 0, this adds a term proportional to v⋅grad u\mathbf{v}\cdot\mathrm{grad}\,u to the heat equation.

With DD and VV constant and p=0p = 0 this gives the advection-diffusion equation

ut+V ux=D uxx.u_t + V\,u_x = D\,u_{xx} .

If instead the production term depends on the concentration itself, p=f(u)p = f(u), the result is a reaction-diffusion equation

ut=D uxx+f(u).u_t = D\,u_{xx} + f(u) .

Stakgold and Holst (Stakgold & Holst (2011), §0.3, Eq. (0.3.11), p. 14) derive such systems for a first-order irreversible reaction in a catalyst pellet, where ff carries the Arrhenius factor e−B/ue^{-B/u} of their Eq. (0.3.1) (Stakgold & Holst (2011), p. 12); later in the same section they build an energy-balance climate model of the same shape, with f(u)=QS(x)a(u)−(A+Bu)f(u) = QS(x)a(u) - (A + Bu) (Stakgold & Holst (2011), Eqs. (0.3.13)–(0.3.18), pp. 15–16). Dropping DD leaves the first-order equation ut+Vux=0u_t + Vu_x = 0 of characteristics; dropping VV and ff leaves the heat equation of the heat kernel.

Definition(The Peclet number)Original

Fix a length LL characteristic of the problem — a pipe length, the width of an initial release, the size of a grid cell. Advection moves the substance across that length in the time L/VL/V; diffusion spreads it across that length in the time L2/DL^2/D. The ratio of these times is the dimensionless Peclet number

Pe=L2/DL/V=VLD.\mathrm{Pe} = \frac{L^2/D}{L/V} = \frac{V L}{D} .

Equivalently, scaling x=Lξx = L\xi and t=(L2/D)τt = (L^2/D)\tau in the advection-diffusion equation gives

uτ+Pe uξ=uξξ,u_\tau + \mathrm{Pe}\,u_\xi = u_{\xi\xi} ,

so Pe\mathrm{Pe} is the only parameter left: all advection-diffusion problems with the same Peclet number and the same shaped data are the same problem. Large Pe\mathrm{Pe} means transport dominates and the equation is nearly the first-order one; small Pe\mathrm{Pe} means diffusion dominates and the velocity is a small correction.

Application(Solution in a moving frame)Original

Let D>0D > 0 and V∈RV \in \mathbb{R} be constants, let gg be continuous and bounded on R\mathbb{R}, and let

SD(x,t)=14πDt e−x2/4DtS_D(x,t) = \frac{1}{\sqrt{4\pi D t}}\,e^{-x^2/4Dt}

be the heat kernel with diffusivity DD. Then

u(x,t)=∫−∞∞SD(x−Vt−y, t) g(y) dy,t>0,u(x,t) = \int_{-\infty}^{\infty} S_D\bigl(x - Vt - y,\, t\bigr)\, g(y)\,dy , \qquad t>0 ,

is infinitely differentiable for t>0t>0, solves ut+Vux=Duxxu_t + Vu_x = D u_{xx}, and tends to g(x0)g(x_0) as (x,t)→(x0,0)(x,t)\to(x_0,0) with t>0t>0. In words: the profile diffuses exactly as if VV were zero, while the whole pattern is carried along at speed VV. Three consequences:

  1. Mean and width. Suppose in addition that g≥0g \ge 0, that its total mass M=∫gM = \int g is finite and positive, and that its second moment is finite, ∫y2g(y) dy<∞\int y^2 g(y)\,dy < \infty. Then ∫u(x,t) dx=M\int u(x,t)\,dx = M for all tt, the centre of mass is at xˉ(t)=xˉ(0)+Vt\bar x(t) = \bar x(0) + Vt, and the variance about it is var(t)=var(0)+2Dt\mathrm{var}(t) = \mathrm{var}(0) + 2Dt. (A finite first moment need not be assumed: Cauchy-Schwarz applied to ∣y∣g⋅g|y|\sqrt{g}\cdot\sqrt{g} gives ∫∣y∣ g≤(∫y2g)1/2(∫g)1/2<∞\int |y|\,g \le \bigl(\int y^2 g\bigr)^{1/2}\bigl(\int g\bigr)^{1/2} < \infty. Some decay hypothesis is needed, and the second moment is the stronger of the two: g(y)=(1+y2)−1g(y) = (1+y^2)^{-1} is bounded, continuous and non-negative with finite mass but with neither a mean nor a variance, while g(y)=(1+∣y∣3)−1g(y) = (1+|y|^3)^{-1} has a finite mass and a finite mean, the integrands there decaying like ∣y∣−3|y|^{-3} and ∣y∣−2|y|^{-2}, yet ∫y2g=∞\int y^2 g = \infty because there the integrand decays only like ∣y∣−1|y|^{-1}.)
  2. Relative spread. Keep the hypotheses of part 1 and let V>0V > 0. By the time the cloud has travelled a distance LL, that is at t=L/Vt = L/V, diffusion has added 2DL/V2DL/V to the variance, so the standard deviation is var(0)+2DL/V.\sqrt{\mathrm{var}(0) + 2DL/V} . For a release that starts concentrated, meaning var(0)\mathrm{var}(0) negligible beside 2DL/V2DL/V, this is close to 2DL/V=L2/Pe\sqrt{2DL/V} = L\sqrt{2/\mathrm{Pe}} with Pe=VL/D\mathrm{Pe} = VL/D. (The hypotheses of part 1 force var(0)>0\mathrm{var}(0) > 0 strictly, since a continuous g≥0g \ge 0 of positive mass cannot be concentrated at a point; the limiting value var(0)=0\mathrm{var}(0)=0 belongs to the point release of the example below, which the statement does not cover but the kernel itself handles.) The cloud therefore stays sharp relative to the distance travelled exactly when Pe\mathrm{Pe} is large and the initial width is small compared with LL.
  3. A linear decay term. If ut+Vux=Duxx−ruu_t + Vu_x = Du_{xx} - r u with rr constant, then u=e−rtwu = e^{-rt}w where ww solves the equation without the decay term, so the formula above acquires the factor e−rte^{-rt}.
Idea of the proofOriginal

The equation treats xx and tt asymmetrically only through the drift, and a drift is exactly what a change of observer removes. Sitting on the fluid, that is substituting y=x−Vty = x - Vt, the advection term and the time derivative combine into the material derivative, and what is left is the heat equation. Everything then follows from the heat kernel, read in the new coordinate.

ProofOriginal

Step 1 (change of frame). Suppose ww is a solution of wt=Dwyyw_t = D w_{yy} and set u(x,t)=w(x−Vt,t)u(x,t) = w(x - Vt, t). By the chain rule, with y=x−Vty = x - Vt,

ut(x,t)=wt(y,t)−V wy(y,t),ux=wy,uxx=wyy,u_t(x,t) = w_t(y,t) - V\,w_y(y,t), \qquad u_x = w_y, \qquad u_{xx} = w_{yy} ,

so ut+Vux=wt=Dwyy=Duxxu_t + V u_x = w_t = D w_{yy} = D u_{xx}: the change of variable converts solutions of the heat equation into solutions of the advection-diffusion equation. The computation is reversible, so it is a bijection between the two solution sets.

Step 2 (apply the heat kernel). Let w(y,t)=∫SD(y−z,t)g(z) dzw(y,t) = \int S_D(y-z,t)g(z)\,dz. By the heat-kernel theorem, applied with diffusivity DD, ww is C∞C^\infty for t>0t>0, solves wt=Dwyyw_t = Dw_{yy}, and w(y,t)→g(y0)w(y,t)\to g(y_0) as (y,t)→(y0,0)(y,t)\to(y_0,0). Step 1 turns this into the stated uu, which is therefore C∞C^\infty and solves the equation; and since (x,t)→(x0,0)(x,t)\to(x_0,0) forces (x−Vt,t)→(x0,0)(x-Vt,t)\to(x_0,0), the initial condition carries over.

Step 3 (mass, mean, variance). Each is a property of SDS_D transported by Step 1. ∫SD(⋅,t)=1\int S_D(\cdot,t) = 1 gives conservation of mass by Tonelli's theorem, the integrand being non-negative. Treating u(⋅,t)/Mu(\cdot,t)/M as a probability density — legitimate because MM is finite and positive by hypothesis — it is the convolution of the two densities g/Mg/M and SD(⋅,t)S_D(\cdot,t), translated by VtVt. The mean and variance of g/Mg/M exist because its second moment was assumed finite, which as noted in part 1 also makes its first moment finite, and those of SD(⋅,t)S_D(\cdot,t) are 00 and 2Dt2Dt by the definition of SDS_D. Convolution of two densities with finite second moments adds their means and adds their variances, and a translation adds to the mean only. This is part 1. Substituting t=L/Vt = L/V into var(t)=var(0)+2Dt\mathrm{var}(t) = \mathrm{var}(0) + 2Dt gives part 2, with 2DL/V=L2⋅2D/(VL)=2L2/Pe2DL/V = L^2\cdot 2D/(VL) = 2L^2/\mathrm{Pe}, so that the term diffusion contributes to the standard deviation is L2/PeL\sqrt{2/\mathrm{Pe}}.

Step 4 (decay term). If u=e−rtwu = e^{-rt}w then ut+Vux−Duxx+ru=e−rt(wt−rw+Vwx−Dwxx+rw)=e−rt(wt+Vwx−Dwxx)u_t + Vu_x - Du_{xx} + ru = e^{-rt}\bigl(w_t - rw + Vw_x - Dw_{xx} + rw\bigr) = e^{-rt}(w_t + Vw_x - Dw_{xx}), which vanishes precisely when ww solves the undecayed equation. □\square

NoteAdaptedAdapted from Stakgold & Holst (2011), §8.2, Exercise 8.2.1, p. 486; Strauss (2008), §2.4, Exercises 16 and 18, p. 54

Both reductions used above are the ones the books themselves point to. Strauss (Strauss (2008), Exercises 16 and 18, p. 54) sets the moving frame y=x−Vty = x - Vt for ut−kuxx+Vux=0u_t - ku_{xx} + Vu_x = 0 and the factor e−bte^{-bt} for ut−kuxx+bu=0u_t - ku_{xx} + bu = 0 as exercises with exactly those hints. Stakgold and Holst (Stakgold & Holst (2011), Exercise 8.2.1, p. 486) pose the same problem for a pollutant of concentration CC with constant diffusivity DD and a time-dependent wind U(t)U(t), asking for the transformation t′=tt' = t, x′=x−V(t)x' = x - \mathcal{V}(t) that removes the convection term, and they call the curves x−V(t)=constantx - \mathcal{V}(t) = \text{constant} drift curves. For V(t)=∫0tV(s) ds\mathcal{V}(t) = \int_0^t V(s)\,ds Step 1 goes through unchanged with VtVt replaced by V(t)\mathcal{V}(t), since ∂tV=V(t)\partial_t \mathcal{V} = V(t) is all that the chain rule uses: the cloud follows the drift curve through its release point while spreading as 2Dt\sqrt{2Dt}.

Application(Travelling fronts of a bistable reaction-diffusion equation)AdaptedAdapted from Evans (2010), §4.2.1c, Eqs. (12)–(16) and (26), pp. 170–175

Consider the scalar reaction-diffusion equation

ut−uxx=f(u)in R×(0,∞),u_t - u_{xx} = f(u) \qquad \text{in } \mathbb{R}\times(0,\infty) ,

where f:R→Rf : \mathbb{R}\to\mathbb{R} is smooth and, for some point 0<a<10 < a < 1, satisfies

  • (a) f(0)=f(a)=f(1)=0f(0) = f(a) = f(1) = 0;
  • (b) f<0f < 0 on (0,a)(0,a) and f>0f > 0 on (a,1)(a,1);
  • (c) f′(0)<0f'(0) < 0 and f′(1)<0f'(1) < 0;
  • (d) ∫01f(z) dz>0\int_0^1 f(z)\,dz > 0.

A travelling wave is a solution of the form u(x,t)=v(x−σt)u(x,t) = v(x - \sigma t). Substituting into the equation gives the ordinary differential equation

v′′+σv′+f(v)=0,v'' + \sigma v' + f(v) = 0 ,

and to it one imposes the conditions that make the wave a front between the two stable states, Evans' (16):

lim⁡s→+∞v(s)=1,lim⁡s→−∞v(s)=0,lim⁡s→±∞v′(s)=0.\lim_{s\to+\infty}v(s) = 1,\qquad \lim_{s\to-\infty}v(s) = 0,\qquad \lim_{s\to\pm\infty}v'(s)=0 .

These limits do not follow from the substitution; they are part of what is being asked for. Evans shows by a phase-plane argument that there exists a velocity σ<0\sigma < 0 for which this problem has a solution, so the equation has a travelling wave interpolating between the two stable states 00 and 11; and he states that a more refined analysis shows this velocity is unique (Evans (2010), p. 175). Hypothesis (c) is what makes 00 and 11 stable as constant solutions, with the intermediate constant aa unstable; the front is therefore an invasion of one stable state by the other. This is the existence theorem of travelling waves, restated here because the identity below and the examples need its hypotheses in front of them; that unit works Evans' argument through in detail.

NoteAdaptedAdapted from Evans (2010), §4.2.1c, pp. 171–175

No proof is given here, for two reasons. The phase-plane route — writing w=v′w = v', reading a front as a trajectory joining the saddle at (0,0)(0,0) to the saddle at (1,0)(1,0), and moving σ\sigma until the unstable and stable curves meet — is set out step by step in travelling waves, and repeating it here would duplicate that unit. And the source itself stops short of a complete argument: Evans says he outlines the analysis "without complete proofs" (Evans (2010), p. 171), and the uniqueness of σ\sigma is asserted rather than demonstrated (Evans (2010), p. 175). What this unit adds is what can be settled in full: the identity below, which fixes the sign of σ\sigma from ff alone, and the exact front in the second example.

Application(The velocity is fixed by the areas)AdaptedAdapted from Evans (2010), §4.2.1c, the function $E$ and its derivative, p. 173

Let ff be continuous and let vv solve v′′+σv′+f(v)=0v'' + \sigma v' + f(v) = 0 on R\mathbb{R} with v(−∞)=0v(-\infty) = 0, v(+∞)=1v(+\infty) = 1 and v′(±∞)=0v'(\pm\infty) = 0, with v′∈L2(R)v' \in L^2(\mathbb{R}). Then

σ∫−∞∞v′(s)2 ds  =  −∫01f(z) dz.\sigma \int_{-\infty}^{\infty} v'(s)^2\,ds \;=\; -\int_0^1 f(z)\,dz .

In particular σ\sigma has the opposite sign to ∫01f\int_0^1 f, so Evans' hypothesis (d) forces σ<0\sigma<0: the state 11, the one with the greater "area" under ff, advances. If ∫01f=0\int_0^1 f = 0 the front is stationary.

ProofAdaptedAdapted from Evans (2010), p. 173

Evans' energy is E(v,w)=12w2+∫0vf(z) dzE(v,w) = \tfrac12 w^2 + \int_0^{v} f(z)\,dz evaluated along a trajectory, with w=v′w = v'. Along a solution,

ddsE(v(s),v′(s))=v′v′′+f(v) v′=v′(v′′+f(v))=−σ v′(s)2,\frac{d}{ds}E\bigl(v(s),v'(s)\bigr) = v'v'' + f(v)\,v' = v'\bigl(v'' + f(v)\bigr) = -\sigma\, v'(s)^2 ,

the last step by the differential equation. The right-hand side is integrable on R\mathbb{R} because v′∈L2v'\in L^2, so s↦E(v(s),v′(s))s \mapsto E(v(s),v'(s)) is an antiderivative of an integrable function. It is EE itself, not its derivative, that has limits at the two ends: EE is continuous, and v→0v\to 0, v′→0v'\to 0 as s→−∞s\to-\infty while v→1v\to1, v′→0v'\to0 as s→+∞s\to+\infty, so E(v(s),v′(s))→E(0,0)=0E(v(s),v'(s))\to E(0,0)=0 and →E(1,0)=∫01f\to E(1,0)=\int_0^1 f respectively. Hence, by the fundamental theorem of calculus,

∫−∞∞ddsE ds=E(1,0)−E(0,0)=∫01f(z) dz,\int_{-\infty}^{\infty}\frac{d}{ds}E\,ds = E(1,0) - E(0,0) = \int_0^1 f(z)\,dz ,

the two end values being the limits just identified. Equating this with the integral of −σ(v′)2-\sigma (v')^2 gives ∫01f=−σ∫(v′)2\int_0^1 f = -\sigma\int (v')^2. Since ∫(v′)2>0\int (v')^2 > 0 (otherwise vv is constant and cannot have two different limits), the sign statement follows. □\square

Remark(Where the hypotheses are used)Original
  • D>0D>0 in the moving-frame theorem. Step 2 is the heat-kernel theorem, which needs D>0D>0. With D=0D = 0 the solution is g(x−Vt)g(x-Vt), pure translation with no spreading, and the problem is the first-order one; the moving frame is then the characteristic (characteristics).
  • VV constant is used only in Step 1, and only through ∂t(Vt)=V\partial_t(Vt) = V; a VV depending on tt alone is as easy, as the note above says. A VV depending on xx is a different problem: the frame change is no longer a rigid shift, the flux VuVu contributes VxuV_x u as well, and no reduction to the heat equation is available in general.
  • Bistability, that is Evans' (c). If f′(0)>0f'(0)>0 the state 00 is unstable and the structure of the travelling-wave problem changes: (0,0)(0,0) is then not a saddle, and the conclusion of the theorem — one wave with one velocity — need not hold. Hypotheses (a)-(d) are stated exactly as Evans gives them, and the statement above claims nothing outside them.
  • ∫01f≠0\int_0^1 f \ne 0 is what makes the front move, by the identity. It is a statement about areas, not about shapes: two nonlinearities with the same ∫01f\int_0^1 f but very different profiles give fronts of the same sign of velocity, though not the same speed, because ∫(v′)2\int(v')^2 differs.
  • The Peclet number needs a length. Pe\mathrm{Pe} is not a property of the equation alone; different choices of LL give different numbers for the same physical set-up, and a statement such as "advection dominates" is meaningless until LL is named.
Example(A release into a river)Original

A mass MM of tracer is released at x=0x=0, t=0t=0 into a channel with mean speed V=0.5 m/sV = 0.5\,\mathrm{m/s} and longitudinal dispersion coefficient D=5 m2/sD = 5\,\mathrm{m^2/s}.

A point release is not one of the continuous bounded data the statement above admits, so we do not use its formula. What we use instead is the drifting kernel itself: by Step 1 of the proof, u(x,t)=M SD(x−Vt, t)u(x,t) = M\,S_D(x - Vt,\,t), that is

u(x,t)=M4πDt exp⁡ ⁣(−(x−Vt)24Dt),u(x,t) = \frac{M}{\sqrt{4\pi D t}}\,\exp\!\Bigl(-\frac{(x-Vt)^2}{4Dt}\Bigr) ,

solves ut+Vux=Duxxu_t + Vu_x = Du_{xx} for every t>0t>0, carries mass MM at every time, and concentrates at x=0x = 0 as t→0+t \to 0^+ — the point-source reading of the kernel described in the heat kernel. It is a Gaussian of mean VtVt and variance 2Dt2Dt, which is what parts 1 and 2 of the statement would say if var(0)=0\mathrm{var}(0)=0 were allowed in them. It is not — those parts need a continuous g≥0g\ge0, whose variance is positive — so read the point release as the limiting case they approach, and the formulas below as read off the kernel directly rather than quoted from the statement.

Take L=1000 mL = 1000\,\mathrm{m}, the distance to a water intake downstream.

  1. Peclet number. Pe=VL/D=(0.5)(1000)/5=100\mathrm{Pe} = VL/D = (0.5)(1000)/5 = 100. Advection dominates: the tracer arrives as a recognisable pulse, not a slow seepage.
  2. Arrival. The maximum of the travelling profile reaches the intake at t=L/V=2000 s=33.3 mint = L/V = 2000\,\mathrm{s} = 33.3\,\mathrm{min}. The concentration measured at the intake peaks a little earlier, at t=1980.1 st = 1980.1\,\mathrm{s}: the t−1/2t^{-1/2} prefactor is still falling while the cloud arrives, and it pulls the maximum about 1%1\% early.
  3. Width. At t=L/Vt = L/V the standard deviation of the cloud is 2Dt=2⋅5⋅2000=141.4 m\sqrt{2Dt} = \sqrt{2\cdot5\cdot2000} = 141.4\,\mathrm{m}, which is L2/Pe=10000.02=141.4 mL\sqrt{2/\mathrm{Pe}} = 1000\sqrt{0.02} = 141.4\,\mathrm{m}: the formula of part 2 in its var(0)=0\mathrm{var}(0)=0 limit.
  4. Peak concentration. umax⁡=M/4πDt=M/354.5u_{\max} = M/\sqrt{4\pi D t} = M/354.5, in units of mass per metre: a release of 10 kg10\,\mathrm{kg} gives 28.2 g/m28.2\,\mathrm{g/m} at the peak.
  5. Duration. Two standard deviations either side of the centre the Gaussian factor is e−2=0.135e^{-2} = 0.135, so the intake sees concentrations above about 14%14\% of the peak for a time 42Dt/V=4(141.4)/0.5=1131 s4\sqrt{2Dt}/V = 4(141.4)/0.5 = 1131\,\mathrm{s}, about 19 min19\,\mathrm{min}. (The letter σ\sigma is reserved in this unit for the velocity of a travelling front.)
  6. What would change at low Peclet number. Were the channel ten times slower, Pe=10\mathrm{Pe} = 10 and the relative spread 2/Pe=0.45\sqrt{2/\mathrm{Pe}} = 0.45: the cloud would be nearly as long as its journey, and tracer would have reached the intake long before the peak did, since the Gaussian is positive everywhere: the leading edge of the cloud runs ahead of its centre, downstream of the peak.
Example(An exact bistable front)Original

Take the cubic f(u)=u(1−u)(u−a)f(u) = u(1-u)(u-a) with 0<a<120 < a < \tfrac12, so that Evans' hypotheses hold: ff vanishes at 0,a,10,a,1; f<0f<0 on (0,a)(0,a) and f>0f>0 on (a,1)(a,1); f′(0)=−a<0f'(0) = -a < 0 and f′(1)=a−1<0f'(1) = a-1 < 0; and

∫01f(z) dz=∫01(z2−z3−az+az2)dz=112−a6=1−2a12>0.\int_0^1 f(z)\,dz = \int_0^1\bigl(z^2 - z^3 - az + az^2\bigr)dz = \frac{1}{12} - \frac{a}{6} = \frac{1-2a}{12} > 0 .

Find the front. Try the logistic profile v(s)=(1+e−bs)−1v(s) = \bigl(1+e^{-bs}\bigr)^{-1}, which satisfies v′=b v(1−v)v' = b\,v(1-v) and therefore v′′=b v′(1−2v)=b2v(1−v)(1−2v)v'' = b\,v'(1-2v) = b^2 v(1-v)(1-2v). Substituting into v′′+σv′+f(v)=0v''+\sigma v'+f(v)=0 and dividing by v(1−v)v(1-v), which is positive,

b2(1−2v)+σb+(v−a)=0⟺(1−2b2) v+(b2+σb−a)=0.b^2(1-2v) + \sigma b + (v - a) = 0 \qquad\Longleftrightarrow\qquad (1 - 2b^2)\,v + \bigl(b^2 + \sigma b - a\bigr) = 0 .

This holds for all vv exactly when both brackets vanish:

b=12,σ=a−b2b=2(a−12).b = \frac{1}{\sqrt2}, \qquad \sigma = \frac{a - b^2}{b} = \sqrt2\Bigl(a - \tfrac12\Bigr) .

So the front and its velocity are

u(x,t)=11+exp⁡(−(x−σt)/2),σ=2 (a−12)<0,u(x,t) = \frac{1}{1 + \exp\bigl(-(x-\sigma t)/\sqrt2\bigr)}, \qquad \sigma = \sqrt{2}\,\bigl(a-\tfrac12\bigr) < 0 ,

with v(−∞)=0v(-\infty)=0, v(+∞)=1v(+\infty)=1, v′(±∞)=0v'(\pm\infty)=0, exactly as the statement requires — and σ<0\sigma<0, as the area identity demands.

Check the identity. With a=14a = \tfrac14: σ=2(−14)=−0.353553\sigma = \sqrt2(-\tfrac14) = -0.353553 and ∫01f=124=0.0416667\int_0^1 f = \tfrac{1}{24} = 0.0416667. For the integral of (v′)2(v')^2, use v′=12v(1−v)v' = \tfrac{1}{\sqrt2}v(1-v) and v(1−v)=14sech⁡2(s/22)v(1-v) = \tfrac14\operatorname{sech}^2(s/2\sqrt2), together with ∫sech⁡4θ dθ=43\int\operatorname{sech}^4\theta\,d\theta = \tfrac43:

∫−∞∞(v′)2ds=12⋅116∫sech⁡4 ⁣(s22)ds=132⋅22⋅43=212=0.117851.\int_{-\infty}^{\infty}(v')^2 ds = \frac12\cdot\frac{1}{16}\int \operatorname{sech}^4\!\Bigl(\frac{s}{2\sqrt2}\Bigr)ds = \frac{1}{32}\cdot 2\sqrt2 \cdot \frac43 = \frac{\sqrt2}{12} = 0.117851 .

Then σ∫(v′)2=(−0.353553)(0.117851)=−0.0416667=−∫01f\sigma\int(v')^2 = (-0.353553)(0.117851) = -0.0416667 = -\int_0^1 f. The identity is satisfied to every digit, for every aa. (The front itself, and the way the guess v′=b v(1−v)v' = b\,v(1-v) selects bb and σ\sigma, is worked out at more length in travelling waves; what is new here is the check against the area identity.)

Numbers with dimensions. For ut=Duxx+r u(1−u)(u−a)u_t = D u_{xx} + r\,u(1-u)(u-a), scaling x=D/r ξx = \sqrt{D/r}\,\xi and t=τ/rt = \tau/r returns the equation above, so the physical speed is Dr ∣σ∣\sqrt{Dr}\,|\sigma| and the front thickness is D/r\sqrt{D/r} times the dimensionless one. The profile rises from 0.10.1 to 0.90.9 over 22ln⁡9=6.2152\sqrt2\ln 9 = 6.215 dimensionless units. For a gas-phase front with D=0.2 cm2/sD = 0.2\,\mathrm{cm^2/s} and r=104 s−1r = 10^4\,\mathrm{s^{-1}} and a=14a = \tfrac14, the speed is 2000⋅0.353553=15.8 cm/s\sqrt{2000}\cdot0.353553 = 15.8\,\mathrm{cm/s} and the front is 6.2152×10−5=0.028 cm6.215\sqrt{2\times10^{-5}} = 0.028\,\mathrm{cm} thick: thin and fast, which is what a flame looks like.

ApplicationOriginal

Which term to keep. The Peclet number decides how to model, how to measure and how to compute. In a river or a ventilation duct Pe\mathrm{Pe} is in the hundreds, so a pollutant arrives as a translating pulse and the measurement that matters is its arrival time L/VL/V; in a stagnant pore, a gel, or across a cell membrane Pe\mathrm{Pe} is far below one and the velocity can be dropped. Chromatography lives in between: the retention time is set by VV and the peak width, which sets the resolution, by DD — and by part 2 of the moving-frame statement the peak width relative to the distance travelled is 2/Pe\sqrt{2/\mathrm{Pe}}, so the resolving power of a column improves only as Pe\sqrt{\mathrm{Pe}}, that is as the square root of its length.

Numerical warning. When the advection-diffusion equation is discretised, the relevant Peclet number uses the cell size: Pecell=VΔx/D\mathrm{Pe}_{\text{cell}} = V\Delta x/D. Centred differences for VuxVu_x combined with centred differences for DuxxDu_{xx} produce a scheme whose coefficients lose their sign once Pecell>2\mathrm{Pe}_{\text{cell}} > 2, and the computed solution then oscillates around steep fronts — the same loss of a discrete maximum principle seen in the maximum principle. The classical responses are to refine until Pecell≤2\mathrm{Pe}_{\text{cell}} \le 2 or to use one-sided (upwind) differences for the advection term; see finite differences.

The probabilistic reading. Grimmett and Stirzaker (Grimmett & Stirzaker (2020), Example (10), p. 584) derive, for a one-dimensional Brownian particle with constant drift rate mm and instantaneous variance β2\beta^2, the forward equation ∂tf=−m ∂yf+12β2∂yyf\partial_t f = -m\,\partial_y f + \tfrac12\beta^2\partial_{yy} f and observe that the corresponding process is βW(t)+mt\beta W(t) + mt. (They write σ\sigma for what is called β\beta here; in this unit σ\sigma is the front velocity.) That is precisely the moving-frame theorem, in probabilistic clothing: V=mV = m, D=12β2D = \tfrac12\beta^2, and "carry the diffusing profile along at speed VV" is "add a deterministic drift mtmt to a Wiener path". The same correspondence makes the advection-diffusion equation the simplest Fokker-Planck equation.

Fronts. The bistable front is the mechanism behind a long list of propagating transitions: the nerve impulse in the Nagumo model, where uu is a membrane potential and the two stable states are rest and excitation; flame propagation, where uu is a scaled temperature and the Arrhenius factor of (Stakgold & Holst (2011), §0.3, Eq. (0.3.1), p. 12) supplies the nonlinearity; the advance of an advantageous gene through a population; and phase transitions in which one phase invades another. In every case the two numbers the model has to deliver are the ones computed above: the speed, which the area identity ties to ∫01f\int_0^1 f, and the thickness D/r\sqrt{D/r}, which says how fine a mesh or how fast a camera is needed to see it. When a reaction is coupled to two diffusing species with different diffusivities, uniform states that are stable without diffusion can become unstable with it — the Turing instability, which Evans (Evans (2010), §4.1, pp. 165–166) analyses as a condition on the eigenvalues, and which is the standard account of biological pattern formation.