Defines elliptic, parabolic and hyperbolic second-order equations by the sign of the discriminant (and, in many variables, by the eigenvalue signs of the coefficient matrix), identifies the type with the number of real characteristic directions, reduces the two-variable constant-coefficient equation to Laplace, wave or heat canonical form, and states what well-posedness in Hadamard's sense asks for.
Definition(The equation, and how nonlinear it is)AdaptedAdapted from Evans (2010), §1.1, Definitions (i)–(iv), p. 2; Arfken, Weber & Harris (2013), §9.3, Eq. (9.17), p. 410
Throughout, u is the unknown and subscripts denote partial derivatives. A partial differential equation of order k is linear if it is a sum of the derivatives of u of order at most k with coefficients depending on the independent variables alone, equal to a given function of those variables; semilinear if its order-k terms have that form and the remaining terms may depend on u and its lower derivatives; quasilinear if the coefficients of the order-k derivatives may depend on u and its derivatives of order up to k−1; and fully nonlinear if it depends nonlinearly on the derivatives of order k themselves.
Classification concerns the order-k terms only, so the whole hierarchy up to quasilinear is covered by one computation. For second order in two variables we write
with a,b,c real and not all zero at the point under discussion. The factor 2 on the mixed term is a convention; it makes the second-order part the quadratic form of the symmetric matrix (abbc). The discriminant of (1) at a point is
δ=b2−ac.
Riley, Hobson and Bence instead write Auxx+Buxy+Cuyy, so that their discriminant is B2−4AC; the two agree because B=2b, and all statements below are unchanged if δ is replaced by B2−4AC.
Definition(Elliptic, parabolic, hyperbolic)AdaptedAdapted from Stakgold & Holst (2011), §8.1, pp. 465–466; Strauss (2008), §1.6, Thm 1 and Example 1, pp. 28–29
Equation (1) is called, at the pointP,
elliptic if δ<0 at P,
parabolic if δ=0 at P,
hyperbolic if δ>0 at P.
It is called elliptic (parabolic, hyperbolic) on a region if it is so at each of its points. The names come from the conic aξ2+2bξη+cη2=const, which is an ellipse, a parabola or a hyperbola in the same three cases.
The prototypes, with (x,y) read as (x,t) where a time appears, are Laplace's equation uxx+uyy=0 (δ=−1, elliptic), the wave equation utt−c2uxx=0 (δ=c2>0, hyperbolic) and the diffusion equation ut−kuxx=0 (δ=0, parabolic, since there is no utt term and no mixed term).
Definition(The type counts the real characteristic directions)AdaptedAdapted from Stakgold & Holst (2011), §8.1, Eqs. (8.1.14)–(8.1.15) and the three cases, pp. 465–466; Hassani (2013), Example 21.1.6, Eq. (21.7), pp. 641–642
Let Γ be a smooth curve in the x–y plane, let P∈Γ, and suppose that u and both of its first derivatives are prescribed along Γ (Cauchy data). Call Γcharacteristic at P if these data together with equation (1) fail to determine all three second derivatives uxx,uxy,uyy at P. Then Γ is characteristic at P if and only if its direction (dx,dy) there satisfies
ady2−2bdxdy+cdx2=0.(2)
Consequently, if a(P)=0, the characteristic directions at P are the solutions of
dxdy=ab±b2−ac,(3)
and there are two of them when δ>0, one when δ=0, and none (in the reals) when δ<0. A curve characteristic at each of its points is a characteristic curve; where the equation is hyperbolic, integrating the two branches of (3) gives two families of characteristic curves, and where it is parabolic, one family.
Idea of the proofOriginal
Cauchy data on Γ give ux and uy along Γ, so differentiating those two functions along Γ gives two linear relations among the three second derivatives at P. The equation itself gives a third. Three linear equations in three unknowns are solvable exactly when their determinant does not vanish, and that determinant is the quadratic form in (dx,dy) appearing in (2). So the characteristic directions are the null directions of that form, and how many there are is decided by the sign of its discriminant.
Write p=ux and q=uy, both known on Γ by hypothesis, and let (dx,dy) be a tangent direction to Γ at P.
Step 1 (two relations from the data). Moving along Γ by the infinitesimal step (dx,dy) changes p and q by amounts the data already know. Since p and q are differentiable, the chain rule gives
dp=uxxdx+uxydy,dq=uxydx+uyydy,
with dp,dq computable from the prescribed p,q along Γ.
Step 2 (one relation from the equation). Evaluating (1) at P and using that u,ux,uy are known there, the right-hand side F is a known number −f, so
auxx+2buxy+cuyy=−f.
Step 3 (solve or not). Steps 1 and 2 are three linear equations for (uxx,uxy,uyy) with coefficient matrix
M=dx0adydx2b0dyc,detM=cdx2−2bdxdy+ady2.
(The determinant is computed by expanding along the first row.) The system has a unique solution precisely when detM=0, so by the definition of "characteristic at P", Γ is characteristic at P exactly when detM=0, which is (2).
Step 4 (count the directions). A direction is fixed up to scale, so put m=dy/dx when dx=0. Dividing (2) by dx2 gives am2−2bm+c=0. If a=0 this is a genuine quadratic with discriminant 4(b2−ac)=4δ, whence the formula (3) and the count two, one or none according to δ>0, δ=0, δ<0. If a=0 then δ=−ac+b2=b2≥0, so the elliptic case cannot occur, and (2) becomes dy(−2bdx+cdy)=0: the direction dy=0 is characteristic, and it is the only one when b=0 (then δ=0), while a second direction dy/dx=2b/c appears when b=0 and c=0 (then δ=b2>0). The count is as stated in both cases. □
RemarkOriginal
Where the hypotheses are used, and what the count means.
Cauchy data, not just u. Step 1 needs ux and uy along Γ. If only u is given, there is one relation instead of two and the argument says nothing; the Dirichlet problem is not a Cauchy problem.
Three unknowns, three equations. The determinant condition is what makes the classification a statement about the second-order coefficients only. The lower-order terms enter only through the known number f in Step 3, which is why F may depend on u,ux,uy in any way at all, linearly or not.
Quasilinear equations. If a,b,c depend on u,ux,uy as well as on x,y, the argument still works at a point once a solution is fixed there, because those arguments are known from the data. The type can then differ from solution to solution.
Why "none" is not the same as "harmless". The absence of real characteristics means no direction is singled out for propagation, which is why elliptic equations have no wave-like behaviour. It does not mean the Cauchy problem for an elliptic equation is solvable; the example below shows it is not.
Definition(Reduction to canonical form)AdaptedAdapted from Strauss (2008), §1.6, Thm 1, pp. 28–29
Write the two-variable linear equation with six real constant coefficients as
whose discriminant is δ=a122−a11a22, and exclude the degenerate case in which a11,a12,a22 all vanish. Then some invertible linear change of the independent variables, (x,y)↦(ξ,η), turns the second-order part of (4) into exactly
uξξ+uηη(δ<0),uξξ−uηη(δ>0),uξξ(δ=0),
up to an overall nonzero factor, while the terms of order one and zero remain terms of order one and zero. Strauss records this as the reduction of (4) to uxx+uyy+⋯=0, uxx−uyy+⋯=0 or uxx+⋯=0, with the dots standing for the lower-order terms, and calls these the elliptic, hyperbolic and parabolic cases respectively. So each of Laplace's equation, the wave equation and the one-dimensional diffusion equation is not merely an instance of its class but a normal form for the whole class.
Idea of the proofOriginal
The second-order part is a quadratic form in the two differentiation operators. Completing the square turns it into (∂x+a12∂y)2 plus a multiple of ∂y2, and the sign of that multiple is the sign of −δ. A linear change of variables can be chosen so that the squared operator becomes ∂ξ and the leftover ∂y becomes ∂η, which is exactly the three canonical forms. The only work beyond the square is arranging a11=0 first, which costs at most a swap of the variables or one preliminary rotation.
ProofAdaptedAdapted from Strauss (2008), §1.6, proof of Thm 1, Eqs. (2)–(4), p. 29
Linear changes of variable act on the second-order coefficient matrix A=(a11a12a12a22) by A↦BABT, so they multiply detA=a11a22−a122=−δ by (detB)2>0 and cannot change the sign of δ. Hence the three cases are mutually exclusive and preserved, and we may normalise freely.
Step 1 (make a11=1). Suppose first that some diagonal coefficient is nonzero. If a11=0 and a22=0, interchange x and y; this is linear and leaves a12 and δ unchanged. So assume a11=0 and divide the whole equation by a11: the new coefficients are 1, a12/a11, a22/a11, and the new discriminant is δ/a112, of the same sign. Rename them 1,a12,a22, so now δ=a122−a22.
Step 2 (complete the square). With ∂x,∂y written as operators,
as expanding the square confirms. The constant-coefficient operators commute, so no ordering question arises.
Step 3 (the elliptic case δ<0). Put β=−δ=(a22−a122)1/2>0 and change variables by
x=ξ,y=a12ξ+βη,
which is invertible since β=0. By the chain rule, ∂ξ=∂x+a12∂y and ∂η=β∂y. Substituting into Step 2 turns the second-order part into ∂ξ2+β2∂y2=∂ξ2+∂η2, Laplace's operator. The first-order and zeroth-order terms become first-order and zeroth-order terms in ξ,η, because the transformation is linear.
Step 4 (the hyperbolic case δ>0 with a11=0). Now put β=δ>0 and use the same change of variables x=ξ, y=a12ξ+βη. Step 2 becomes ∂ξ2−β2∂y2=∂ξ2−∂η2, the wave operator.
Step 5 (the parabolic case δ=0). Here Step 2 leaves only (∂x+a12∂y)2. Take x=ξ, y=a12ξ+η, so that ∂ξ=∂x+a12∂y and ∂η=∂y; the second-order part is ∂ξ2, and the remaining terms are of order 1 or 0. This is case 3.
Step 6 (both diagonal coefficients zero). If a11=a22=0 then δ=a122, and the excluded case a11=a12=a22=0 aside, a12=0, so δ>0: the equation must be hyperbolic, and Step 1 is unavailable. Take x=ξ+η, y=ξ−η, so ∂ξ=∂x+∂y and ∂η=∂x−∂y, whence
∂ξ2−∂η2=(∂x+∂y)2−(∂x−∂y)2=4∂x∂y.
So 2a12uxy=2a12(uξξ−uηη), and dividing by a12/2 gives case 2. □
RemarkOriginal
What the reduction does and does not give. Steps 3 to 5 use a single linear map, so for constant coefficients one change of variables works on the whole plane. If a,b,c vary with x and y, the same algebra works at each point separately, so the type is still well defined pointwise, but the transformation then varies from point to point and one must integrate (3) to produce coordinates; the canonical form is achieved only locally, and only where the type does not change. Arfken reaches the same conclusion by the explicit substitution ξ=c1/2x−c−1/2by, η=c−1/2y, which requires c>0, and obtains L=(ac−b2)∂ξ2+∂η2; the coefficient ac−b2=−δ again carries the sign that decides the type.
Definition(Many variables)AdaptedAdapted from Strauss (2008), §1.6, pp. 29–31
For n variables x1,…,xn and a linear equation
i,j=1∑naijuxixj+i=1∑naiuxi+a0u=0(5)
with real constants and aij=aji, let d1,…,dn be the eigenvalues of A=(aij). A linear change of variables ξ=Bx sends A to BABT, and by the spectral theorem for real symmetric matrices there is a rotation B making this diagonal; a further change of scale replaces each nonzero diagonal entry by ±1. Equation (5) is called
elliptic if d1,…,dn are either all positive or all negative — equivalently, if A or −A is positive definite;
hyperbolic if 0 is not among them and the sign pattern is n−1 of one sign against a single one of the other;
ultrahyperbolic if 0 is not among them and each sign occurs two or more times;
parabolic if 0 occurs exactly once among them and one sign accounts for the remaining n−1.
With xn=t, Laplace's and Poisson's equations are elliptic, the wave and Klein-Gordon equations are hyperbolic, and the diffusion equation is parabolic. Ultrahyperbolic equations occur rarely in physics and are not pursued here. For variable coefficients the same test is applied at each point, and the type may differ from region to region.
The classification is a statement about a signature. Diagonalising A by A↦BABT does not preserve the eigenvalues, only how many are positive, negative and zero; that is Sylvester's law of inertia (see quadratic forms). The four cases above are phrased only in terms of those counts, so they are invariant under every invertible linear change of variables, which is what makes the type a property of the equation.
Sources differ on "parabolic". Hassani, writing the equation with (Ajk) already diagonal as ∑jajuxjxj+F=0, calls it elliptic at x0 if all aj(x0) are nonzero with the same sign, hyperbolic if all are nonzero with exactly one of opposite sign, ultrahyperbolic if all are nonzero but with at least two of each sign, and parabolic if at least one aj(x0) vanishes. That is weaker than the definition used here, which is Strauss's: it also calls parabolic, for instance, an equation whose coefficient matrix has one zero eigenvalue and both signs among the rest. This unit follows Strauss throughout; readers comparing with Hassani should check which convention a given statement needs. The two agree on all of the standard equations of physics listed above.
A third formulation, standard in the modern theory, replaces signs by a uniform bound: Evans calls ∂t+L with Lu=−∑aij(x,t)uxixj+∑biuxi+cuuniformly parabolic if there is a constant θ>0 with ∑i,jaij(x,t)ξiξj≥θ∣ξ∣2 for all (x,t) in the region and all ξ∈Rn, so that L is uniformly elliptic in x at each fixed time. This is the pointwise condition "all eigenvalues positive" made quantitative and uniform, which is what the estimates of the modern theory need.
Definition(Well-posedness in Hadamard's sense)AdaptedAdapted from Strauss (2008), §1.5, pp. 25–26
A problem consisting of a partial differential equation in a domain together with initial and/or boundary conditions is well posed if
existence: there is at least one solution satisfying all the conditions;
uniqueness: there is at most one;
stability: the solution depends on the data in a stable way, in that a small change in the data produces only a small change in the solution.
Condition 3 presupposes a notion of nearness, that is, a norm or metric on the data and on the solutions, and a problem can be well posed for one choice and ill posed for another; which choice is intended must always be said. Too few auxiliary conditions and the problem is underdetermined, with many solutions; too many and it is overdetermined, with none. Stability is not a mathematical luxury: measured data carry errors, and a problem that magnifies them without bound cannot be solved from measurements at all.
Example(Cauchy data for Laplace's equation: no stability)AdaptedAdapted from Strauss (2008), §1.5, Eq. (2), p. 27
Take Laplace's equation uxx+uyy=0 in the upper half-plane D={−∞<x<∞,y>0}, and prescribe both u and uy on the boundary y=0. Laplace's equation is elliptic, so by the statement above it has no real characteristics anywhere, and the obstruction of a characteristic initial curve is absent. Nevertheless the problem is not well posed. For n=1,2,3,… put
un(x,y)=n1e−nsin(nx)sinh(ny).
Each un is a solution. Differentiating, ∂x2un=−n2un and ∂y2un=+n2un, so un,xx+un,yy=0 in D.
The data go to zero. On y=0, sinh0=0 gives un(x,0)=0, and ∂yun(x,y)=e−nsin(nx)cosh(ny) gives ∂yun(x,0)=e−nsin(nx). Hence supx∣un(x,0)∣=0 and supx∣∂yun(x,0)∣=e−n→0 as n→∞, and the same is true of every derivative of the data in x, since differentiating k times multiplies the bound by nk and nke−n→0.
The solutions do not. Fix any y0>0. Since sinh(ny0)≥21eny0−log2 for ny0≥1, at the points x=π/(2n) we get
un(2nπ,y0)=ne−nsinh(ny0)≥4neny0−n⟶∞.
(The inequality for sinh holds because sinhz≥ez/4 as soon as e2z≥2, hence for z≥1.) For y0=1 and n=25 the bound reads e20/100≈4.9×106, and the exact value is e−5sinh25/25≈9.70×106, while the data are of size e−5≈6.7×10−3.
Conclusion. Data arbitrarily close to zero, whose own solution is u≡0, produce solutions that are arbitrarily large at every interior height. Stability fails in the supremum norm, so the Cauchy problem for Laplace's equation is ill posed. Compare this with the hyperbolic case, where Cauchy data on a non-characteristic curve do give a unique, stably dependent solution; and note that for elliptic equations it is the boundary value problem, with u or ∂u/∂n given on a closed boundary, that is well posed instead.
ExampleOriginal
(a) Classify and reduce 3uxx+10uxy+3uyy=0.
Read off the coefficients in the convention of (1).a=3, 2b=10 so b=5, and c=3. Then δ=b2−ac=25−9=16>0: hyperbolic in the whole plane.
Characteristics. By (3), dy/dx=(5±4)/3, that is 3 or 31. Integrating, the two families are y−3x=const and 3y−x=const.
Canonical form. Divide by a11=3 to get uxx+310uxy+uyy=0, so a12=35, a22=1 and δ′=925−1=916, with β=δ′=34. Step 4 of the proof prescribes x=ξ, y=35ξ+34η, that is ξ=x, η=43y−5x. Substituting gives 3uxx+10uxy+3uyy=3(uξξ−uηη), so the equation becomes the wave equation uξξ−uηη=0.
Check against the factorisation. The operator factors as 3∂x2+10∂x∂y+3∂y2=(3∂x+∂y)(∂x+3∂y), so u=f(x−3y)+g(3x−y) solves it for all twice-differentiable f,g; direct substitution confirms this. The level sets of x−3y have slope 31 and those of 3x−y have slope 3: the arbitrary functions travel along the characteristics found in step 2, as they must.
(b) An equation of mixed type. Take the equation of Tricomi type
uxx+yuyy=0,
for which a=1, b=0 and c=y, so that
δ=b2−ac=−y.
Type. The equation is hyperbolic in the open half-plane y<0, parabolic on the line y=0, and elliptic in y>0 — for every x. One equation thus carries both behaviours, separated by a line on which it degenerates.
Characteristics where they exist. Equation (2) reads dy2+ydx2=0, so for y<0 the two real slopes are dy/dx=±−y, which is also what (3) gives since a=1. Separating variables, dy/−y=±dx integrates to −2−y=±x+const, so the two families of characteristic curves are
x±2−y=const(y<0),
two families of parabolas y=−41(x−const)2 tangent to the line y=0 from below. Differentiating this parabola gives dy/dx=(const−x)/2=±−y, confirming the slopes.
What happens at the degeneracy. The two slopes ±−y coalesce as y→0−, so the two families merge into the single family dy=0 predicted on the parabolic line, and every characteristic is tangent to that line. A problem posed across y=0 needs data appropriate to a hyperbolic equation below it and to an elliptic one above it; no single prescription serves both, which is what makes equations of mixed type hard.
ApplicationOriginal
Steady compressible flow, and why the type changes at Mach 1. The linearised potential equation for steady two-dimensional flow past a thin body at free-stream Mach number M∞ is
(1−M∞2)ϕxx+ϕyy=0,
with ϕ the perturbation potential and x along the flow. Here a=1−M∞2, b=0, c=1, so δ=M∞2−1. Subsonic flow (M∞<1) is elliptic: there are no characteristics, every point of the flow feels every part of the body, and the computation needs data on a closed boundary around the whole field. Supersonic flow (M∞>1) is hyperbolic, with characteristic slopes dy/dx=∓1/M∞2−1 from (3); these are the Mach lines, inclined at the Mach angle μ=arctan(1/M∞2−1), and disturbances travel only along them, which is why a supersonic body influences only the wedge downstream of it. At M∞=1 the equation is parabolic and both descriptions break down; transonic flow is modelled instead by equations of mixed type, whose coefficients change sign inside the domain, exactly as in part (b) of the example above.
The same classification governs practical choices elsewhere. It decides which data a solver must be given — Cauchy data on a non-characteristic surface for hyperbolic problems (seismic wave propagation, electromagnetics in the time domain), boundary data on a closed surface for elliptic ones (electrostatics, steady heat conduction, incompressible pressure fields) — and which are hopeless: running diffusion backwards in time, or recovering a source from potential measurements on a surface, are precisely the ill-posed problems whose instability the Laplace example above exhibits, and they are attacked in practice only by regularisation, which deliberately replaces the problem by a nearby well-posed one.
Turns a first-order quasilinear equation with data on a curve into a system of ordinary differential equations along characteristics, gives the recipe and the non-characteristic condition under which it determines a unique local solution, proves it, and works out the transport equation and three further examples.
Definition(Quasilinear first-order equations and their characteristics)AdaptedAdapted from Evans (2010), §3.2.2b, Eq. (20), p. 97, and §3.2.5b, Eq. (54), p. 107 (the quasilinear form); Stakgold & Holst (2011), §8.1, Eq. (8.1.8) with the linear and semilinear cases, p. 463, and Eqs. (8.1.9)–(8.1.10), p. 464 (the determinant condition)
A first-order equation in two independent variables is quasilinear if it can be written
a(x,y,u)ux+b(x,y,u)uy=c(x,y,u),(1)
so that the derivatives of u appear linearly but their coefficients may involve u. This generality is Evans's: his Eq. (20) is exactly the case in which u may enter the coefficient of every derivative. Stakgold and Holst's first-order equation (8.1.8) is the narrower a(x,y)ux+b(x,y)uy+c(x,y,u)=0, in which a and b do not depend on u at all; the two narrower cases named next are theirs. Equation (1) is semilinear if a and b do not depend on u but c does, and linear if in addition c=−q(x,y)u+F(x,y).
In n variables Evans writes the quasilinear equation with its source term on the left,
b(x,u)⋅Du+c(x,u)=0,x∈Rn,
where b is the whole coefficient vector of the gradient — not the scalar b of (1) — and consequently his c is the negative of the right-hand side of (1).
The characteristic equations of (1) are the ordinary differential equations
dsdx=a(x,y,z),dsdy=b(x,y,z),dsdz=c(x,y,z),(2)
for three unknown functions x(s),y(s),z(s). A solution of (2) is a characteristic strip — a curve in (x,y,z)-space, carrying both a point of the plane and the value of u there. Its shadow s↦(x(s),y(s)) in the plane of the independent variables is a projected characteristic, or simply a characteristic curve of (1). (Stakgold and Holst use the word strip for a different object, a region of the plane, and put it in quotation marks; the statement below records that usage. Bolded, the term always means the solution of (2).) The whole point of (2) is that the third equation closes the system: no derivative of u appears in it, so the three functions can be computed without knowing u anywhere else.
A smooth curve Γ in the x–y plane carrying the data u=g is called characteristic at a pointP∈Γ if ux and uy cannot be computed at P from the data on Γ together with equation (1). Writing (dx,dy) for a tangent direction of Γ at P, differentiating u along Γ gives uxdx+uydy=du, with du known; equation (1) gives aux+buy=c, with c known once u(P) is. These two linear equations for (ux,uy) are solvable precisely when
dxadyb=bdx−ady=0,(3)
so Γ is characteristic at P exactly when bdx−ady=0 there, that is, when the vector (a,b) evaluated at P is tangent to Γ. Where a=0 this says the characteristic direction has slope dy/dx=b/a, which is (2) with s eliminated. A curve on which (3) holds at every point is called non-characteristic.
Method(Solving a quasilinear first-order equation by characteristics)AdaptedAdapted from Evans (2010), §3.2.2b and §3.2.4, pp. 97–98 and 102–105; Arfken, Weber & Harris (2013), §9.2, Eqs. (9.8)–(9.9), pp. 406–407
Given equation (1) and data u=g on a curve Γ:
Parametrise the data. Write Γ as (f(τ),h(τ)) with f,h∈C1 and (f′,h′)=(0,0), and let g(τ) be the prescribed value of u at the parameter τ.
Check that Γ is non-characteristic. Verify
J(τ)=a(f,h,g)h′(τ)−b(f,h,g)f′(τ)=0,
which is condition (3) with (dx,dy)=(f′,h′), up to sign. If J vanishes at a point, stop: the method gives nothing there.
Solve the characteristic equations. Integrate (2) in s for each fixed τ, with initial conditions
x(0,τ)=f(τ),y(0,τ)=h(τ),z(0,τ)=g(τ).
For a linear or semilinear equation the first two equations decouple from the third and are solved first; for a genuinely quasilinear equation all three must be solved together.
Invert the change of variables. Solve x=x(s,τ), y=y(s,τ) for s=s(x,y) and τ=τ(x,y). Step 2 guarantees this is possible near Γ.
Read off the solution. Set
u(x,y)=z(s(x,y),τ(x,y)).
Say where it holds. The formula is valid on the region swept out by the characteristics on which step 4 succeeded. Check the extent of that region: in the quasilinear case characteristics may cross, and the formula fails there even though every step above was legitimate.
A useful shortcut for linear equations with constant a,b: changing to the variables s′=ax+by and t′=bx−ay converts (1) into (a2+b2)∂u/∂s′+⋯=0, an ordinary differential equation in s′ with t′ as a parameter, which is steps 3 to 5 carried out in one move.
Method(Local existence and uniqueness)AdaptedAdapted from Evans (2010), §3.2.1, p. 94 (the smoothness hypothesis), §3.2.4, Lemma 2 and Thm 2, pp. 102–105, and §3.2.5b, pp. 107–108; Stakgold & Holst (2011), §8.1, p. 464
Evans fixes a standing hypothesis at the start of his treatment of characteristics: the equation and the data are smooth. In the notation of (1) that means a,b,c smooth functions of (x,y,z) on an open set, Γ a smooth curve τ↦(f(τ),h(τ)), and g smooth. Suppose that at τ=τ0
ah′(τ0)−bf′(τ0)=0,a,b evaluated at (f(τ0),h(τ0),g(τ0)).
This is Evans's non-characteristic condition b(x0,z0)⋅ν(x0)=0, with z0=g(τ0) and ν his outward unit normal to ∂U at the data point, written out for a parametrised plane curve: the tangent of Γ there is (f′,h′), so a normal is (h′,−f′) and (a,b)⋅(h′,−f′)=ah′−bf′. Then there is a neighbourhood V of the point P0=(f(τ0),h(τ0)) in which the problem
a(x,y,u)ux+b(x,y,u)uy=c(x,y,u),u=g on Γ,
has exactly one solution; that solution is C2, and it is the function produced by steps 3 to 5 of the method. The regularity of the solution is the conclusion of Evans's Theorem 2, and the uniqueness clause is his specialisation of that theorem to the quasilinear case.
The proof below is Evans's route run for the three-equation system (2) alone, which is all the quasilinear case needs, and it uses less than his hypothesis: C1 coefficients, a C1 curve and C1 data are enough for every step, and what they yield is a solution of class C1, unique among C1 solutions on V. The C2 conclusion stated above is the one Evans proves, under his smoothness hypothesis.
For a linear equation the hypothesis simplifies, because a and b do not depend on z: the condition is that the vector field (a,b) is nowhere tangent to Γ, and it involves neither the data g nor the derivatives of u. In that case Stakgold and Holst state, for the linear version of their first-order equation and without proof, a stronger conclusion: when Γ is nowhere characteristic, a unique solution exists on the whole characteristic "strip" — their word, in quotation marks, for the region of the plane that the two characteristics through the ends of Γ fence off between them — and not merely near one point, and it depends continuously on the data there. They add that a jump in the prescribed values of u at a point of Γ travels along the characteristic through that point, so that the solution is then a weak one in the sense of distributions.
Idea of the proofOriginal
Equation (1) says that one particular directional derivative of u, in the direction (a,b), equals c. So along a curve whose tangent is that direction, u satisfies an ordinary differential equation. The three equations (2) are exactly that curve and that ordinary differential equation written together, and they close because the direction depends only on x,y and the value of u, never on its derivatives. Two things then have to be checked. First, that the characteristics issuing from Γ fill out a neighbourhood without overlapping, which is the inverse function theorem applied to (s,τ)↦(x,y), and whose Jacobian determinant is precisely the non-characteristic quantity. Second, that the function so assembled really solves the equation: one line of the chain rule gives this, because ∂z/∂s is both c and the directional derivative aux+buy.
ProofAdaptedAdapted from Evans (2010), §3.2.4, Lemma 2 and Thm 2, pp. 102–105
Step 1 (the characteristic strips exist and are smooth in both variables). The right-hand sides of (2) are C1, hence locally Lipschitz in (x,y,z), so by the existence and uniqueness theorem for ordinary differential equations there is, for each τ near τ0, a unique solution s↦(x(s,τ),y(s,τ),z(s,τ)) of (2) with the initial values of step 3 of the method, defined for ∣s∣<s0 with s0>0 independent of τ on a small enough τ-interval. Because the initial data f,h,g are C1 in τ and the right-hand sides are C1, the solution depends C1 on τ as well.
Step 2 (the map (s,τ)↦(x,y) is locally invertible). At s=0 we have x(0,τ)=f(τ) and y(0,τ)=h(τ), so xτ=f′, yτ=h′ there, while (2) gives xs=a, ys=b evaluated on the data. Hence
which is nonzero by the non-characteristic hypothesis. By the inverse function theorem there are a neighbourhood W of (0,τ0) and a neighbourhood V of P0 such that (s,τ)↦(x,y) is a C1 bijection of W onto V with C1 inverse (x,y)↦(s(x,y),τ(x,y)).
Step 3 (the assembled function solves the equation). Define u(x,y)=z(s(x,y),τ(x,y)) on V; it is C1 as a composition of C1 maps. Fix (s,τ)∈W and differentiate the identity z(s,τ)=u(x(s,τ),y(s,τ)) with respect to s. By the chain rule and then by (2),
∂s∂z=ux∂s∂x+uy∂s∂y=aux+buy,
all three functions a,b and the derivatives being evaluated at the point (x(s,τ),y(s,τ)) with z=u there. But the third equation of (2) says ∂z/∂s=c. Hence aux+buy=c at every point of V, which is (1). Putting s=0 gives u(f(τ),h(τ))=z(0,τ)=g(τ), so the data are matched.
Step 4 (uniqueness). Let u~ be any C1 solution on V with u~=g on Γ. Fix τ and solve the ordinary differential equations
with x~(0)=f(τ), y~(0)=h(τ); the right-hand sides are C1 in (x~,y~) because a,b and u~ are, so a unique solution exists for small ∣s∣. Put z~(s)=u~(x~(s),y~(s)). By the chain rule and then because u~ satisfies (1),
dsdz~=au~x+bu~y=c(x~,y~,z~).
So (x~,y~,z~) solves the system (2) with the same initial values as (x(⋅,τ),y(⋅,τ),z(⋅,τ)). The right-hand sides of (2) are locally Lipschitz, so the two solutions coincide. In particular u~(x(s,τ),y(s,τ))=z(s,τ)=u(x(s,τ),y(s,τ)), and since by Step 2 these points fill V, u~=u on V. □
RemarkOriginal
Where the hypotheses are used, and what fails without them.
The non-characteristic condition is used only in Step 2, and nowhere else; it is exactly what makes the Jacobian nonzero. If it fails at τ0, the characteristic through that point of Γ is tangent to Γ, the map (s,τ)↦(x,y) is singular, and no neighbourhood of P0 is swept out. Arfken draws the three consequences explicitly: data on a curve that is a characteristic are either inconsistent with the equation or merely redundant, and in neither case do they determine u off that curve; a data curve meeting the same characteristic twice generally over-determines the problem, so no solution exists; and only a non-characteristic curve lets a boundary condition reach points off it.
Smoothness of the coefficients. Evans assumes it throughout, and he needs it for his C2 conclusion. The proof above needs only that a,b,c are C1, and it uses that twice, both times to get local Lipschitz continuity so that the ordinary differential equations have unique solutions — in Step 1 for existence and in Step 4 for uniqueness. Continuity alone would give existence but not uniqueness, and then the construction would not single out a solution.
The conclusion is local. This is not laziness. For a linear equation the characteristics are fixed curves, determined by (a,b) alone, and the solution extends along each of them as far as they go, which is Stakgold and Holst's characteristic "strip"; the obstruction is then geometric, arising where the vector field (a,b) has a zero inside the region or where a characteristic re-enters through the data curve. For a genuinely quasilinear equation the characteristics depend on the data through z, and projected characteristics starting at different points of Γ can intersect at a finite distance. Where two of them carrying different values of u meet, no single-valued C1 solution can exist: the derivatives of u blow up as that time is approached, and the solution must be continued in a weaker sense (see conservation laws and shocks).
No smoothness of the data is needed for the formula. Steps 3 to 5 produce a function whenever g is merely continuous, or even discontinuous, and it is the only sensible candidate; it is then a weak, not a classical, solution. Stakgold and Holst record that a jump in g at a point of Γ travels along the characteristic through that point and nowhere else.
Example(The transport equation)AdaptedAdapted from Evans (2010), §2.1, Eqs. (2)–(5), pp. 18–19
Let b∈Rn be a constant vector and solve
ut+b⋅Du=f in Rn×(0,∞),u=g on Rn×{t=0},
where Du is the gradient in x alone. In the notation of (1), with (x,t) in place of (x,y), the coefficient vector of the derivatives is (b,1)∈Rn+1 and the right-hand side is f.
Data curve and the non-characteristic check. The data surface is Γ={t=0}, with unit normal (0,…,0,1). The coefficient vector has last component 1, so (b,1)⋅(0,1)=1=0 everywhere on Γ: the condition of step 2 holds for every b and every point, which is why the initial-value problem for transport is always solvable.
Characteristics. The characteristic equations are x˙=b, t˙=1, z˙=f. The first two give t=s and x=x0+sb, so we may use t as the parameter: the projected characteristics are the straight lines through (x0,0) with direction (b,1).
The equation along a characteristic. On the line through (x,t) put ζ(s)=u(x+(s−t)b,s), which traces the values of u along that line and equals u(x,t) at s=t and g(x−tb) at s=0. By the chain rule ζ′(s)=ut+b⋅Du evaluated on the line, which is f(x+(s−t)b,s).
Integrate. Integrating ζ′ from 0 to t,
u(x,t)=g(x−tb)+∫0tf(x+(s−t)b,s)ds.
For f≡0 this is u(x,t)=g(x−tb): the initial profile is carried rigidly at velocity b, unchanged in shape.
A number. Take n=2, b=(3,−1), f≡0 and g(x)=e−∣x∣2. Then u(x,t)=e−∣x−tb∣2, and at x=(1,2), t=1 we get x−b=(−2,3), so u=e−13=2.2603×10−6, while u at the same point at t=0 is e−5=6.7379×10−3: the pulse has moved away.
Regularity. The formula with f≡0 defines a function for any g whatever. It is a classical solution exactly when g∈C1; for rougher g it is the weak solution, and a jump in g at x0 travels along the line x=x0+tb.
ExampleOriginal
(a) A linear equation with absorption and a source. Solve
ut+2ux+3u=e−x,u(x,0)=cosx.
Form and check. Here (a,b)=(2,1) in the variables (x,t), and c=e−x−3u. The data curve t=0 has tangent (1,0), so J=2⋅0−1⋅1=−1=0: non-characteristic everywhere.
Characteristics.x˙=2, t˙=1 give t=s, x=x0+2t, so the projected characteristics are the lines x−2t=x0.
The ordinary differential equation along a characteristic. With z(t)=u(x0+2t,t),
dtdz=ut+2ux=e−x−3u=e−x0−2t−3z,z(0)=cosx0.
Solve it. Multiplying by the integrating factor e3t gives (e3tz)′=et−x0, so e3tz=cosx0+e−x0(et−1) and
z(t)=e−3tcosx0+e−x0(e−2t−e−3t).
Return to (x,t). Substituting x0=x−2t and simplifying e−(x−2t)(e−2t−e−3t)=e−x(1−e−t),
u(x,t)=e−3tcos(x−2t)+e−x(1−e−t).
Check.u(x,0)=cosx, and substituting into the equation gives ut+2ux+3u=e−x identically. As t→∞ the transient e−3tcos(x−2t) dies and u→e−x, the steady state of 2ux+3u=e−x. At x=1, t=21 the two terms are e−3/2cos0=e−3/2 and e−1(1−e−1/2)=e−1−e−3/2, which cancel to give exactly u(1,21)=e−1=0.3678794.
(b) A genuinely quasilinear equation. Solve ut+uux=0 with u(x,0)=1+x.
Characteristics.t˙=1, x˙=z, z˙=0. So z≡1+x0 is constant along each characteristic, and then x=x0+(1+x0)t. The non-characteristic quantity on t=0 is again 1=0.
Invert. From x=x0(1+t)+t we get x0=(x−t)/(1+t), which is legitimate for t>−1.
Solution.u=1+x0=1+t1+x. Substituting back, ut=−(1+x)/(1+t)2 and uux=(1+x)/(1+t)2, so the equation holds, and u(x,0)=1+x.
Where it holds, and why. The characteristics are lines of slope dx/dt=1+x0, which increases with x0: they fan out for t>0 and never meet, so the formula is valid for all t>0 and the solution flattens like 1/(1+t). Extended backwards they converge, and all of them pass through (x,t)=(−1,−1); the solution indeed blows up as t→−1+. Had the initial data been decreasing instead, the characteristics would have crossed at a positive time and the classical solution would have ceased to exist there.
(c) Data on a characteristic. For 2ux+3uy=0 the characteristics are the lines 3x−2y=const. Prescribing u on the line Γ={3x=2y}, parametrised by (2τ,3τ), gives J=ah′−bf′=2⋅3−3⋅2=0: the data curve is characteristic at every point. The equation forces u to be constant along Γ, so prescribing u=τ there admits no solution at all, while prescribing the constant u=5 admits infinitely many, namely u=F(3x−2y) for every C1 function F with F(0)=5. The two failure modes — no existence and no uniqueness — appear in the same example, depending only on the data.
ApplicationOriginal
The transport equation is the advection step of every atmosphere and ocean model. A tracer — water vapour, ozone, a pollutant, a dye — of concentration u carried by a prescribed wind field v(x,t) satisfies ut+v⋅Du=S, with S the sources and sinks; its characteristics are the trajectories of air parcels, and solving along them is what "Lagrangian" and "semi-Lagrangian" advection schemes do literally: to find u at a grid point at the new time level, they trace the characteristic backwards to the previous level and interpolate there. The method also explains the Courant condition for an explicit grid-based scheme, which says that the numerical domain of dependence of a grid point must contain the characteristic through it; violating it means computing a value from data that the exact solution does not depend on, and the result is unstable (see von Neumann stability analysis).
Elsewhere, the eikonal picture of geometrical optics and the ray equations of seismology are characteristic systems of first-order equations; the Hamilton-Jacobi equation of mechanics is one too, with the characteristics being the trajectories in phase space (see the Hamilton-Jacobi equation). In traffic and in gas dynamics the quasilinear case is the physical one, and part (b) of the example is the whole story in miniature: where characteristics spread, a smooth solution persists and flattens; where they converge, the gradient steepens without bound and a shock forms.
Shows how a scalar conservation law in one space dimension loses its classical solution at a computable breaking time, gives the weak formulation that lets the solution be continued past it, derives and proves the Rankine-Hugoniot speed of the resulting jump and the entropy condition that picks out the physical one, and carries a Burgers ramp through from the data to a checked shock position.
Definition(Scalar conservation laws, flux, and Burgers' equation)AdaptedAdapted from Evans (2010), §3.4, Eq. (1), p. 130, and Example 1, Eq. (13), p. 134; Strauss (2008), §14.1, Eq. (1), p. 380, the three lettered principles $(\alpha)$, $(\beta)$, $(\gamma)$ of Example 3, p. 382, Eq. (13), p. 384, and the general-flux slope with Eq. (14), p. 385
A scalar conservation law in one space dimension is an equation in divergence form
ut+(F(u))x=0,x∈R,t>0,(1)
for an unknown u=u(x,t) and a given flux functionF:R→R. We always pair (1) with initial data
u(x,0)=g(x),x∈R.(2)
Equation (1) is Evans's Eq. (1); the name records the physics, since u is a density whose total amount changes only through the flux F(u) at the ends of an interval.
Wherever u is C1 the chain rule turns (1) into the quasilinear equation
ut+a(u)ux=0,a:=F′,(3)
which is Strauss's Eq. (1). We call a(u) the characteristic speed. The two forms are equivalent for smooth u and they are not equivalent for discontinuous u: only (1) survives the passage to weak solutions below, because only (1) says what is conserved. This is why the flux, and not just the speed, has to be named.
Burgers' equation is the case F(u)=u2/2, so a(u)=u:
ut+(21u2)x=0equivalentlyut+uux=0.(4)
Following Evans we call Funiformly convex when F′′≥θ for some constant θ>0; Burgers' flux has F′′=1, so it qualifies. Under uniform convexity a=F′ is strictly increasing, a fact used repeatedly below.
Equation (3) is the quasilinear equation of first-order equations and characteristics with (a,b,c)=(a(u),1,0) in the variables (x,t). Its characteristic equations are therefore x˙=a(z), t˙=1, z˙=0, and from them come the three facts that organise everything here: u is constant along each projected characteristic, each projected characteristic is consequently a straight line, and the slope dx/dt of that line is the characteristic speed a(u) carried on it. Strauss sets out the three facts as the lettered principles (α), (β), (γ) on p. 382, but he derives them there inside his Example 3, which is Burgers' equation, a(u)=u; his third principle therefore equates the slope with u itself, an identification special to a=id and not available for a general flux. The general-flux version is his p. 385, where the line through (x,t) and (z,0) has slope (x−z)/t=a(u(x,t))=a(φ(z)), and it is the version used throughout this unit. The line through (y,0) is
x=y+ta(g(y)),u=g(y)on it.(5)
Inverting (5) for y gives u(x,t)=g(y(x,t)), which is Strauss's implicit solution (14). The data curve {t=0} is never characteristic, since the coefficient of ut is 1=0, so the only obstruction to this construction is that two lines (5) may meet.
Method(Breaking: how long the classical solution lasts)AdaptedAdapted from Strauss (2008), §14.1, Eq. (14) and the crossing criterion $a(\varphi(z)) \le a(\varphi(w))$ for $z \le w$, pp. 383–385
Assume F∈C2(R) and g∈C1(R) with g, g′, a∘g and (a∘g)′ all bounded, where a=F′. Put
m:=y∈Rinf(a∘g)′(y)=y∈Rinfa′(g(y))g′(y).
No crossing. If m≥0 then for each t>0 the map y↦y+ta(g(y)) is a strictly increasing bijection of R onto itself, and (5) defines a bounded C1 solution of (1)–(2) on the whole half-plane t>0. Strauss's criterion for this, that a(g(⋅)) be nondecreasing, is exactly m≥0; he calls the resulting solution an expansive or rarefaction wave.
Breaking. If m<0, set the breaking time
t∗:=−m1=infy(a∘g)′(y)1>0.
Then (5) defines a bounded C1 solution on the strip 0≤t<t∗, and it is the only bounded C1 solution there. If the infimum is attained at some y∗, then
x∈Rsup∣ux(x,t)∣⟶∞as t↑t∗,
so no bounded C1 solution exists on any strip 0≤t<T with T>t∗, while supx∣u(x,t)∣=supx∣g∣ for every t<t∗.
The quantity that blows up is the slope, not the solution. The derivation of the explicit number t∗ from Strauss's implicit formula is carried out in the proof below; Strauss states only the sign criterion that separates case 1 from case 2 and describes the breaking in case 2 geometrically, as the crest of the wave overtaking its foot.
Idea of the proofOriginal
Read (5) backwards. At time t the characteristic that started at y has arrived at x=y+ta(g(y)), so the whole initial line has been stretched by the map y↦x, and the stretching factor is 1+t(a∘g)′(y). The solution is obtained by undoing that map, which is possible exactly while the factor stays positive. Since u keeps the value g(y) along the characteristic, its slope is the initial slope divided by the stretching factor; where the factor shrinks to zero the graph of u has been compressed to a vertical tangent. The first time this happens is the first zero of 1+t(a∘g)′(y) over all y, and that is −1/m.
ProofAdaptedAdapted from Strauss (2008), §14.1, pp. 383–385
Write α:=a∘g, which is C1 and bounded with bounded derivative, and define
Φ(y,t):=y+tα(y).
Step 1 (the stretching factor).∂yΦ(y,t)=1+tα′(y). If m≥0 this is at least 1 for all t>0; if m<0 and 0≤t<t∗=−1/m it is at least 1+tm>0. In either case, on the stated range of t the function y↦Φ(y,t) is strictly increasing.
Step 2 (it is onto).α is bounded, say ∣α∣≤M, so Φ(y,t)≥y−tM→∞ and Φ(y,t)≤y+tM→−∞ as y→±∞. A continuous strictly increasing function with these limits is a bijection of R onto R. Hence for each t in range and each x there is exactly one root y=y(x,t) of Φ(y,t)=x.
Step 3 (the root is a C1 function of (x,t)). The map (y,t)↦(Φ(y,t),t) is C1 with Jacobian determinant ∂yΦ=1+tα′(y)=0 at every point of the strip. By the inverse function theorem it has a C1 inverse near every point, and by Step 2 the inverse is globally single-valued; so y(x,t) is C1 on the strip.
Step 4 (the formula solves the problem). Put u(x,t):=g(y(x,t)), a C1 function bounded by sup∣g∣. Differentiating the identity g(y)=u(Φ(y,t),t) in y and then in t, at fixed t and fixed y respectively,
g′(y)=ux⋅(1+tα′(y)),0=uxα(y)+ut.
The second identity is ut+a(g(y))ux=0, and g(y)=u at that point, so ut+a(u)ux=0, which is (3) and hence (1) for a C1 function. Setting t=0 in Φ gives y(x,0)=x and so u(x,0)=g(x). Every value taken by u is a value of g, which gives the bound supx∣u(⋅,t)∣=sup∣g∣.
Step 5 (the slope blows up at t∗). From the first identity of Step 4,
ux(Φ(y,t),t)=1+tα′(y)g′(y).(6)
Suppose m<0 is attained at y∗, so α′(y∗)=a′(g(y∗))g′(y∗)=m. A product is negative only if both factors are nonzero, so g′(y∗)=0. Evaluating (6) at y∗ gives ∣ux∣=∣g′(y∗)∣/(1+tm), whose denominator decreases to 0 as t↑t∗=−1/m. Hence supx∣ux(⋅,t)∣→∞. A C1 solution on a strip reaching beyond t∗ would, by the uniqueness of Step 6, agree with u below t∗ and so have unbounded derivative on a compact set, which is impossible.
Step 6 (uniqueness). Let u~ be a bounded C1 solution on the strip. Fix a point (x,t) in the strip and solve ξ˙(τ)=a(u~(ξ(τ),τ)) backwards from ξ(t)=x. The right-hand side is C1 in ξ, hence locally Lipschitz, so the solution is unique, and it is bounded because u~ is bounded and a is continuous; therefore it continues down to τ=0. Along it, dτdu~(ξ,τ)=u~t+a(u~)u~x=0, so u~ keeps the value g(ξ(0)) and ξ˙ keeps the value a(g(ξ(0))). Integrating, x=ξ(0)+ta(g(ξ(0))), so ξ(0) is a root of Φ(⋅,t)=x; by Step 2 it is the root y(x,t), and u~(x,t)=g(y(x,t))=u(x,t). This is the backward-characteristic argument of first-order equations and characteristics, run globally on the strip rather than near one point. □
RemarkOriginal
Where the hypotheses are used, and what fails without them.
F∈C2 and g∈C1 are used in Step 3, to make α=F′∘g continuously differentiable so that the inverse function theorem applies, and in Step 6, to make a(u~) locally Lipschitz so that the backward characteristic is unique. With F merely C1 the map Φ need not be differentiable in y and the breaking time is not defined by the formula above.
Boundedness of α is used only in Step 2, and only to get surjectivity. Without it the characteristics may fail to cover the half-plane, so the formula would define a solution on a smaller region even before any crossing.
The infimum being attained is used only in Step 5. If it is approached but not attained the solution still ceases to be C1 at t∗, but the blow-up is then at spatial infinity rather than at a point.
m<0 is not an accident. If F is uniformly convex, a′=F′′>0, so m<0 as soon as g is strictly decreasing anywhere. Thus for Burgers' equation any initial profile with a descending part breaks in finite time, no matter how smooth or how small. This is the characteristic difference from the linear transport equation, where a is constant, α′≡0 and t∗=∞.
What the theorem does not say. It says nothing about t≥t∗. The solution does not become multivalued — a function cannot — but the construction (5) does: past t∗ it assigns several values to the same point, which is the folded profile Strauss draws as a breaking wave. Continuing past t∗ therefore needs a notion of solution that does not mention ux at all.
Definition(Integral solutions)AdaptedAdapted from Evans (2010), §3.4.1a, Eqs. (2)–(4) and the definition of an integral solution, pp. 131–132; Strauss (2008), §14.1, Eq. (15), p. 386
Call v:R×[0,∞)→R a test function if it is smooth and vanishes outside a bounded set. Multiply (1) by v, integrate over the half-plane and move both derivatives onto v: the x-integration by parts has no boundary term because v has compact support, and the t-integration by parts leaves the boundary term at t=0, where u=g. The result is an identity that contains no derivative of u, and this is taken as the definition.
A function u∈L∞(R×(0,∞)) is an integral solution (a weak solution) of (1)–(2) if
for every test function v. This is Evans's Eq. (4) and his definition. Note where the flux enters: it is F(u), not a(u)ux, that is differentiated, so (7) makes sense for a merely bounded u, and a smooth integral solution is a classical solution — reverse the integrations by parts and use that v is arbitrary.
Two conventions. Strauss's Eq. (15) is (7) without the data term: his test functions live in the open half-plane, so his identity constrains u only for t>0 and the initial condition is imposed separately. Evans's (7) carries the initial data inside the identity. We follow Evans, so that "integral solution" below always means a solution of the initial-value problem; when only the first integral in (7) vanishes we say u solves (1) weakly in the open half-plane. The two agree for a u that attains g continuously as t↓0, and the results quoted from Strauss are unaffected, because the jump conditions he derives are local in t>0.
Method(The Rankine-Hugoniot condition)AdaptedAdapted from Evans (2010), §3.4.1a, Eqs. (10)–(12) with the jump notation, pp. 132–133; Strauss (2008), §14.1, Eq. (17), p. 387
Let V⊂R×(0,∞) be open and let C={(x,t):x=s(t)} be a C1 curve dividing V into a left part Vl and a right part Vr. Suppose u is a bounded integral solution of (1) which, together with its first derivatives, is uniformly continuous on Vl and on Vr separately. Write
and use the jump brackets [u]:=ul−ur, [F(u)]:=F(ul)−F(ur), and σ:=s˙ for the speed of the curve. Then
u is a classical solution of (1) in Vl and in Vr; and
at every point of C,
[F(u)]=σ[u],equivalentlyσ=ul−urF(ul)−F(ur) when ul=ur.(8)
This is the Rankine-Hugoniot condition. It is Evans's Eq. (12); Strauss's Eq. (17) is the same equation written as a difference quotient, with his u− and u+ for the limits from the left and from the right, so that his u−=ul and u+=ur and his s(t) is our σ. The three quantities ul, ur and σ may each vary along C; what (8) fixes is the relation between them at each point. Nothing in (8) requires F to be convex.
Note what the condition is a statement about: the flux, not the characteristic speed. Replacing F by a different flux with the same F′ on the two states would change nothing in (3) but would change σ — one more reason the conservation form (1) is the primitive object.
Idea of the proofOriginal
A weak solution satisfies the conservation law in its book-keeping form: for any fixed interval, the amount of u inside changes at a rate equal to the flux in at the left end minus the flux out at the right end. Freeze an interval straddling the jump. The rate of change splits into two pieces: the smooth evolution on each side of the jump, which is accounted for by the fluxes at the two ends and at the jump, and the sweeping of the discontinuity across the interval, which transfers an amount σ[u] per unit time from the right state to the left state. For the book-keeping to balance, that transfer must equal the mismatch [F(u)] in the flux across the jump. Writing that out is the whole proof.
ProofAdaptedAdapted from Evans (2010), §3.4.1a, pp. 131–133
Step 1 (the equation holds classically off C). Let v be a test function supported in Vl. Then only the first integral in (7) survives, and since u is C1 there we may integrate by parts back again with no boundary terms, getting ∫∫Vl(ut+F(u)x)vdxdt=0. The integrand's first factor is continuous on Vl and v is arbitrary, so ut+F(u)x=0 throughout Vl. The same argument applies in Vr. This is part 1.
Step 2 (the control-volume identity). Fix a<b and 0<t1<t2 with the closed rectangle R=[a,b]×[t1,t2] contained in V, and with the vertical sides x=a and x=b not meeting C. We claim
To see it, take v(x,t)=χε(x)θε(t) in (7), where χε is smooth, equal to 1 on [a+ε,b−ε], equal to 0 outside [a,b], and monotone on each of the two transition intervals, and θε is built the same way from [t1,t2]. Since R⊂V and t1>0, this v is a test function and the data term in (7) is absent. Now θε′ integrates to +1 over the first transition and to −1 over the second, and u is bounded and continuous in t at each fixed x off C; so the first double integral in (7) tends to ∫abu(x,t1)dx−∫abu(x,t2)dx. Likewise χε′ concentrates at a with total mass +1 and at b with total mass −1, and x↦F(u(x,t)) is continuous near x=a and x=b because those lines avoid C; so the second double integral tends to ∫t1t2[F(u(a,t))−F(u(b,t))]dt. Both passages are dominated by the bound on u and the continuity of F on a bounded set. Adding gives (9).
Step 3 (differentiate in time). Fix t with t1<t<t2. Dividing (9) by t2−t1 and letting t2↓t1=t, both sides have limits and
dtd∫abu(x,t)dx=F(u(a,t))−F(u(b,t)).(10)
Step 4 (split the interval at the jump). Assume a<s(t)<b. Then
∫abudx=∫as(t)udx+∫s(t)budx,
and each piece may be differentiated by the Leibniz rule, legitimately because u and ut extend continuously to the closure of each side and s is C1:
dtd∫abudx=σul−σur+∫as(t)utdx+∫s(t)butdx.
By Step 1, ut=−F(u)x on each side separately, so the two integrals evaluate to −[F(ul)−F(u(a,t))] and −[F(u(b,t))−F(ur)]. Hence
Step 5 (compare). Subtracting (10) from this leaves 0=σ(ul−ur)−F(ul)+F(ur), which is (8). The point t was arbitrary. □
Method(The entropy condition and the definition of a shock)AdaptedAdapted from Evans (2010), §3.4.1b, Eqs. (16)–(19), pp. 135–137, and §3.4.3b, Definition and Thm 3, p. 143; Strauss (2008), §14.1, Eq. (18), pp. 388–389
Integral solutions are not unique: for one two-state problem for Burgers' equation Evans exhibits two, a discontinuous one whose jump he checks against (8) and a continuous one with no jump at all. A further condition is therefore needed to single out the physical solution.
Entropy inequalities. Along a curve of discontinuity of a piecewise-smooth integral solution, Evans requires
F′(ul)>σ>F′(ur).(11)
These are the entropy inequalities, so named by analogy with the thermodynamic requirement that entropy not decrease. A curve of discontinuity is called a shock when both (8) and (11) hold on it. Strauss's criterion (18) is the same pair of inequalities written with a=F′ and his left and right limits, and he too declares the definition of a shock wave complete only once both conditions are imposed.
Why these inequalities. The characteristic through a point of C carries the speed F′(ul) on the left and F′(ur) on the right. Condition (11) says both characteristics run into the curve as t increases, so that going backwards in time from any point one never crosses a discontinuity; Evans obtains (11) exactly by imposing that backward-tracing property. Physically, as Strauss puts it, the wave behind the shock is overtaking the wave in front of it.
The convex case. If in addition F is uniformly convex, then F′ is strictly increasing and (11) is equivalent to the single inequality
ul>ur(12)
along the shock curve. For Burgers' equation (F′=id) condition (11) reads ul>σ>ur, and (8) gives σ=(ul+ur)/2, the average of the two states; the inequalities are then automatic once ul>ur.
Uniqueness. Evans turns the pointwise inequality into a condition that a merely bounded function can satisfy: u∈L∞ is an entropy solution of (1)–(2) if it satisfies (7) for every test function and, for some constant C≥0,
His Theorem 3 states that if F is convex and smooth, then there is at most one entropy solution of (1)–(2), up to a set of measure zero. Condition (13) is a one-sided bound on how fast u may increase in x; at a jump it forces ul≥ur, which is (12).
Riemann's problem. For F uniformly convex and C2, with G:=(F′)−1, Evans's Theorem 4 gives the entropy solution for the two-state data g=ul for x<0, g=ur for x>0:
with σ given by (8). The first is a shock of constant speed, the second a rarefaction wave. The two formulas (14a) and (14b) are the building blocks out of which the solution past a breaking time is assembled.
RemarkOriginal
Where the hypotheses are used, and what fails without them.
Piecewise smoothness with uniformly continuous one-sided limits is used in Steps 1 and 4 of the Rankine-Hugoniot proof: Step 1 needs u to be C1 in the interior of each side, and Step 4 needs u and ut to extend continuously up to C from each side so that the Leibniz rule may be applied. Without it a bounded integral solution can have a much wilder discontinuity set and (8) has nothing to be about.
The vertical sides of the rectangle avoiding C is used only in Step 2, to make x↦F(u(x,t)) continuous where χε′ concentrates. Any a,b with a<s(t)<b on the time interval considered will do.
The divergence form is used throughout, and which divergence form matters. Multiplying ut+uux=0 by 2u turns it into (u2)t+(32u3)x=0, a conservation law for w=u2 with flux 32w3/2. The two laws have exactly the same C1 solutions, but not the same jump speeds. For the states ul=3, ur=1 the first gives σ=21(ul+ur)=2, while the second gives (32)(27−1)/(9−1)=613. Only one of the two can be the physically correct front, and which one is settled by which quantity is actually conserved, not by the differential equation. A conservation law is specified by its flux.
Convexity is needed for (12) but not for (8) or (11). The general inequalities (11) are the ones to use for a nonconvex or concave flux; the traffic-flow model in the application below has F′′<0, and there (11) forces ul<ur, the opposite of (12).
Why a non-entropic jump has to be rejected. This is Evans's Example 2 (p. 135) with different states: take Burgers' equation with ul=1 and ur=3 in place of his 0 and 1; the arithmetic below is ours. The jump u=1 for x<2t, u=3 for x>2t satisfies (8), since (F(1)−F(3))/(1−3)=(21−29)/(−2)=2, and it is an integral solution. But F′(ul)=1<2, so (11) fails at once. The entropy solution is instead the rarefaction of (14b): u=1 for x<t, u=x/t for t<x<3t, u=3 for x>3t. Both have the same initial data, so without (11) the initial-value problem would not determine the solution. Observe that the characteristics leave the rejected jump on both sides, so the state behind it is not determined by the data at all — that is precisely what the backward-tracing requirement forbids.
Method(Solving a scalar conservation law through a shock)AdaptedAdapted from Evans (2010), §3.4.1, pp. 131–138, and §3.4.4, Thm 4, pp. 147–148; Strauss (2008), §14.1, pp. 383–389
Given ut+F(u)x=0 with u(x,0)=g(x):
Put the equation in divergence form and identify F and a=F′. If the equation is handed to you as ut+a(u)ux=0, choose F with F′=a; the constant of integration does not matter, but the choice of which quantity is conserved does.
Draw the characteristics. Each is the line x=y+ta(g(y)) carrying the constant value g(y).
Find the breaking time. Compute m=infy(a∘g)′(y). If m≥0 the classical solution is global and step 4 onwards is unnecessary. Otherwise t∗=−1/m, and the classical solution is given implicitly by u=g(y), x=y+ta(g(y)) for t<t∗.
Insert the right wave at each jump of the data using (14a)–(14b): where the data jumps so that the characteristics converge, a shock; where they diverge, a rarefaction fan u=G(x/t) centred at the jump, with G=(F′)−1.
Start the shock. At t=t∗ the characteristics first cross; take the crossing point as the initial point of the shock curve x=s(t).
Propagate the shock. Read off ul(t) and ur(t) as the limits of the solution already constructed on either side of s(t), and integrate the ordinary differential equation
When both states are constant this is a straight line; when one side is a fan it is a genuine ordinary differential equation in s and t.
Check the entropy inequalitiesF′(ul)>s˙>F′(ur) at each time. If they fail, the jump you inserted is not a shock and step 4 was done wrongly.
Stop and restart at interactions. The construction is valid until the shock meets another shock, the edge of a fan, or a new breaking point; at such a time recompute ul, ur and go back to step 6.
Verify. Check the control-volume identity (9) on an interval containing the shock: the amount of u in [a,b] must change at the rate F(u(a,t))−F(u(b,t)). This catches an error in F, in σ or in the solution on either side.
Example(A Burgers ramp: breaking, shock and a conserved count)Original
Solve Burgers' equation ut+(21u2)x=0 with
g(x)=⎩⎨⎧3,3−2x,1,x≤0,0≤x≤1,x≥1.
Here F(u)=u2/2 and a(u)=F′(u)=u, so a∘g=g. The data are continuous and piecewise C1 but not C1, because of the corners at x=0 and x=1, so the hypotheses of the breaking statement are not literally met. The corners cause no trouble: the characteristic speeds match across them, so the lines (5) still fill the strip without gaps, and the construction goes through on each piece separately. The price is that what comes out is C1 only off the two characteristics x=3t and x=1+t carried by the corners, and merely Lipschitz across those two lines; we call it the piecewise-classical solution. The breaking time is unaffected, since the stretching factor 1+tg′(y) is computed piece by piece, and no number below depends on the distinction.
1. Characteristics. The line from (y,0) is x=y+tg(y), carrying the value g(y). So
for y≤0: x=y+3t, speed 3;
for 0≤y≤1: x=y+t(3−2y)=y(1−2t)+3t, speed 3−2y;
for y≥1: x=y+t, speed 1.
2. Breaking time.(a∘g)′=g′ equals 0 outside (0,1) and −2 inside it, so m=−2 and
t∗=−m1=21.
3. Where the crossing happens. At t=21 the middle family collapses: x=y(1−2t)+3t becomes x=23 for everyy∈[0,1]. All the characteristics carrying the values between 1 and 3 arrive at the single point (x,t)=(23,21).
4. The piecewise-classical solution for t<21. Inverting x=y(1−2t)+3t gives y=(x−3t)/(1−2t) and hence u=3−2y=(3−2x)/(1−2t). Altogether
The two branch points agree with the ends of the middle family, and the formula is continuous across them: at x=3t it gives (3−6t)/(1−2t)=3 and at x=1+t it gives (1−2t)/(1−2t)=1. A check at an interior point: at x=1, t=41 the formula gives
u(1,41)=1−213−2=2,
and indeed the characteristic through (1,41) started at y=(1−43)/21=21, where g=3−1=2. The slope at that point is ux=−2/(1−2t)=−4, which does run to −∞ as t↑21, as Step 5 of the proof predicts.
5. The shock. For t>21 the states on the two sides of the crossing point are the constants ul=3 and ur=1. By (8),
σ=3−1F(3)−F(1)=229−21=2,
constant, so the shock curve is the straight line through (23,21) of slope dx/dt=2:
s(t)=23+2(t−21)=2t+21.
6. Entropy.F′(ul)=3, F′(ur)=1, and 3>2>1: the inequalities (11) hold, so this is a genuine shock. (Equivalently, ul=3>1=ur, since F is uniformly convex with F′′=1.) The solution for t≥21 is therefore
u(x,t)={3,1,x<2t+21,x>2t+21.
Nothing further happens: the characteristics on the left have speed 3>2 and on the right speed 1<2, so both run into the shock for all later times and no new interaction occurs.
7. A checkable number. At t=3 the shock sits at
s(3)=2⋅3+21=6.5.
Verify this against the conservation identity (9) on the fixed interval [−10,10], which contains the shock for all 0≤t≤3 (at t=3 it is at 6.5<10) and whose ends sit in the constant states. Write N(t):=∫−1010(u(x,t)−1)dx; since the constant 1 contributes nothing to the right-hand side of (9) beyond a cancelling pair, (9) gives
At t=3 the profile takes the value u−1=2 on [−10,6.5) and 0 beyond, so
N(3)=2⋅(6.5−(−10))=33.
The difference is 33−21=12=4⋅3, exactly as required. Had the shock been placed anywhere other than x=6.5 at t=3, the count would have been wrong: the Rankine-Hugoniot speed is precisely the speed that keeps the books balanced.
ApplicationOriginal
Traffic. The Lighthill-Whitham-Richards model treats the density ρ(x,t) of vehicles on a single lane as a conserved quantity whose flux is F(ρ)=vmρ(1−ρ/ρm): drivers choose the speed vm(1−ρ/ρm), full speed on an empty road and zero at the jam density ρm. Here F′′=−2vm/ρm<0, so the flux is concave, not convex, and the entropy inequalities must be used in the general form (11).
Take vm=100km/h and ρm=180 vehicles per km, and let traffic of density ρ0=36 per km run into a standing queue at ρ=ρm behind a red light. The queue's tail is a jump with ρl=36 upstream and ρr=180 downstream, and (8) gives
σ=36−180F(36)−F(180)=−1442880−0=−20km/h:
the back of the queue travels upstream at 20km/h while every car in it moves forwards or stands still. The entropy check is F′(36)=60>−20>−100=F′(180), so this is a shock. Over three minutes the tail retreats 1km, so the queue grows by 180 vehicles; and indeed 144 cars arrive in that time at 2880 per hour, while 36 were already on that kilometre of road. The two counts agree, which is the control-volume check of step 9 of the method. When the light turns green the jump runs the other way, ρl=ρm>ρr, the characteristics diverge, and (14b) supplies a rarefaction fan instead: this is why a queue dissolves gradually from the front while it builds abruptly at the back.
Gas dynamics. The equations of compressible flow are a system of conservation laws for mass, momentum and energy, and the jump relations across a shock front — the original Rankine-Hugoniot conditions, from which the name here is borrowed — are the system version of (8), one equation per conserved quantity. They are what determines the pressure, density and temperature behind a blast wave or a bow shock from the conditions ahead of it and the shock speed, without any knowledge of the internal structure of the front. The entropy inequalities are, in that setting, the statement that the thermodynamic entropy of a fluid element increases as it crosses the front, which is where the name comes from; a jump violating them would be a rarefaction shock, never observed.
River and glacier waves, and why the front steepens. Any model in which the propagation speed increases with the amplitude produces the same phenomenon: a flood wave in a channel steepens at its front and decays at its back, and a wave on a glacier or a dune field does the same. The breaking-time formula of this unit gives the time scale on which that steepening is complete, and the Rankine-Hugoniot speed gives the velocity of the resulting front — which, note, is neither the speed of the material behind it nor that in front of it, but a weighted mean determined by the flux.
Numerics. The reason finite-difference schemes for these equations are written in conservative form, as updates of cell averages by numerical fluxes at cell faces, is Step 2 above: a scheme that discretises ut+a(u)ux=0 rather than ut+F(u)x=0 satisfies no discrete analogue of (9), and will converge to a jump travelling at the wrong speed, even as the mesh is refined. The entropy condition plays the matching role of excluding the spurious stationary jumps such a scheme can otherwise admit. See finite differences for the discretisations and von Neumann stability analysis for the separate question of stability, which is a condition on the time step, not on the form of the scheme.
Defines the Dirichlet, Neumann, Robin, mixed, Cauchy and periodic conditions, tabulates which of them give a unique and stable solution for elliptic, parabolic and hyperbolic equations on open and on closed boundaries, and explains each verdict — with a proof of uniqueness for the elliptic case and the compatibility condition the Neumann problem needs.
Definition(The six kinds of condition)AdaptedAdapted from Strauss (2008), §1.4, pp. 20–22, and §4.1 Exercises 1 and 4, p. 92; Arfken, Weber & Harris (2013), §9.3, pp. 411–412; Hassani (2013), Definitions 21.1.7–21.1.8, pp. 642–643
Let the equation hold in a domain D with boundary ∂D, let n be the outward unit normal and write ∂u/∂n=n⋅∇u for the outward normal derivative. On ∂D, or on the part of it under discussion, the condition is called
Name
Condition
Prescribed data
Dirichlet
u=g
the value of u
Neumann
∂u/∂n=g
the normal derivative of u
Robin
∂u/∂n+au=g
a combination, with a a given function
Mixed
Dirichlet on one part of ∂D, Neumann (or Robin) on another
one condition at each boundary point
Cauchy
u=gand∂u/∂n=h
both, at the same points
Periodic
u and ∂u/∂n agree at identified boundary points
nothing; the domain is closed up
A condition is homogeneous if the prescribed function vanishes, and inhomogeneous otherwise. An initial condition is a boundary condition imposed at one end of the range of the time variable: u(x,0)=φ(x) for the diffusion and Schrödinger equations, and the pair u(x,0)=φ(x), ut(x,0)=ψ(x) for the wave equation — which is Cauchy data on the surface t=0. Dirichlet and Neumann conditions are the two cases in which Cauchy data are split; Robin interpolates between them, reducing to Neumann when a≡0 and approaching Dirichlet as a→∞ with g/a held fixed. Hassani defines the Dirichlet and Neumann boundary-value problems specifically as those in which the datum is given on a closed hypersurface, which is the case in which they are well posed for elliptic equations.
Physically, for a vibrating string held at its ends the condition is homogeneous Dirichlet; a free end sliding without resistance gives ux=0, a Neumann condition; an end attached to a spring obeying Hooke's law gives a Robin condition, through which the string exchanges energy with the spring; and an end moved in a prescribed way gives an inhomogeneous Dirichlet condition. For heat flow, a perfectly insulated boundary is Neumann with g=0, a boundary in perfect contact with a reservoir at temperature g is Dirichlet, and Newton cooling into an ambient temperature is Robin. In electrostatics, Dirichlet prescribes the potential on a conductor and Neumann prescribes the normal field, hence the surface charge density. Periodic conditions arise when the domain is physically a ring: diffusion in a closed circular tube of circumference 2l, with arclength −l≤x≤l, carries the conditions u(−l,t)=u(l,t) and ux(−l,t)=ux(l,t).
Note(Which conditions suit which equation)AdaptedAdapted from Arfken, Weber & Harris (2013), §9.3, Table 9.1 and the caveats, pp. 412–413; Riley, Hobson & Bence (2006), §20.6.2, Table 20.1 and the uniqueness-to-within-a-constant qualification, p. 705; Hassani (2013), Box 21.1.9, p. 643; Strauss (2008), §4.3, Eqs. (1)–(2) and the sign discussion, pp. 92–93
The following is Arfken, Weber and Harris's table, for the three classes of second-order equation in two variables, with the prototypes Laplace or Poisson in (x,y), the wave equation in (x,t) and the diffusion equation in (x,t). "Open" and "closed" refer to the boundary on which the data are given: a curve with endpoints, or a curve enclosing the region. Part of a closed boundary may lie at infinity, provided u or ∂u/∂n is prescribed there.
Conditions
Boundary
Elliptic
Hyperbolic
Parabolic
Cauchy
open
ill posed (unstable)
well posed
over-determined
Cauchy
closed
over-determined
over-determined
over-determined
Dirichlet
open
under-determined
under-determined
well posed, forwards in time only
Dirichlet
closed
well posed
many solutions
over-determined
Neumann
open
under-determined
under-determined
well posed, forwards in time only
Neumann
closed
well posed
many solutions
over-determined
The entries have been relabelled for compactness. Arfken, Weber and Harris write, in place of "well posed", that the solution is unique and stable; in place of "over-determined", that the conditions are too restrictive; in place of "under-determined", that they are insufficient; in place of "ill posed (unstable)", that the results are unphysical because of instability; in place of "many solutions", that the solution is not unique; and in place of "forwards in time only", that the solution is unique and stable in one direction.
Reading off only the well-posed rows leaves three pairings, which are Riley, Hobson and Bence's Table 20.1 and, in m variables, Hassani's Box 21.1.9. A hyperbolic equation takes Cauchy data on an open boundary. A parabolic equation takes one condition of Dirichlet or Neumann type, again on an open boundary. An elliptic equation takes one condition of Dirichlet or Neumann type on a closed boundary.
Robin and mixed conditions impose, like Dirichlet and Neumann, one scalar condition at each boundary point. For a mixed condition — Dirichlet on part of the boundary, Neumann or Robin on the rest — the table's verdicts carry over unchanged. For Robin the sign of the coefficient matters, and Strauss is explicit about why. He writes the one-dimensional conditions as X′−a0X=0 at x=0 and X′+alX=0 at x=l, with the two constants carrying opposite signs because the outward normal points left at one end and right at the other, and he reads a0,al>0 as radiation of energy, a0,al<0 as absorption and a0=al=0 as insulation. He warns at the outset that, because of that asymmetry in the normal, each of the two constants may affect the eigenfunctions in the opposite way to the other. In the radiating case — a≥0 in the convention ∂u/∂n+au=g — the elliptic verdicts do carry over, because the boundary term in the uniqueness proof below then has a sign. A sufficiently negative coefficient does not: it can put an eigenvalue of the associated problem at zero, and uniqueness on a closed boundary then fails. Example (a) below exhibits such a case, and shows what a≥0 buys. Periodic conditions are the case in which the boundary has been removed altogether by identifying its two parts, so for a parabolic or hyperbolic equation on a ring only the initial conditions remain to be given.
Both sources warn that the table simplifies. Riley, Hobson and Bence say the general question of which conditions are appropriate is complex and do not pursue it, and they qualify "appropriate" as giving a solution that is unique — sometimes only to within an additive constant — and well defined. Arfken, Weber and Harris call the part played by boundary conditions too complicated to analyse exactly within the scope of their book, say that their Table 9.1 oversimplifies in several respects, and give the Helmholtz equation ∇2ψ±k2ψ=0 as an example the table mis-describes: with Dirichlet conditions on a closed boundary it has solutions only for certain values of k, those being the eigenvalues (see the Helmholtz equation).
Remark(Why each verdict holds)Original
The entries are not independent; most follow from two facts about characteristics and one counting principle.
Elliptic, closed, Dirichlet or Neumann: unique and stable. The uniqueness theorem below says so, and its proof turns the problem into ∫D∣∇w∣2=0 for the difference w of two solutions. The elliptic Dirichlet and Neumann problems are therefore the prototype well-posed problems, as Stakgold and Holst put it for −Δu=q in Ω with u=f on the boundary.
Elliptic, closed, Cauchy: too restrictive. Dirichlet data alone already fix the solution; the normal derivative on the boundary is then determined, not free. Prescribing it as well generally contradicts what the Dirichlet data imply. Arfken, Weber and Harris make exactly this point: since Dirichlet and Neumann conditions each give a unique solution, and the two solutions are different, Cauchy data — which are both at once — invite an inconsistency.
Elliptic, open, Cauchy: unstable. This is Hadamard's example, worked out in the classification unit: for Laplace's equation in a half-plane there are solutions whose Cauchy data on the boundary line tend to zero while the solutions themselves blow up at every interior point. The absence of real characteristics, which one might expect to make the Cauchy problem harmless, does not save it.
Elliptic, open, Dirichlet or Neumann: insufficient. An open arc leaves the solution unconstrained on the rest of the boundary, and an elliptic equation propagates nothing along curves; so the data simply do not reach the interior.
Hyperbolic, open, Cauchy: unique and stable. Here there are two families of real characteristics. Cauchy data on an arc C that is nowhere characteristic are carried along the characteristic of each family through each point of C, and the solution is determined in the region covered by both families. For the wave equation uxx−c−2utt=0 the characteristics are x±ct=const, and data on the segment t=0, 0≤x≤L determine u exactly in the triangle those lines cut out (see d'Alembert's solution).
Hyperbolic, closed, Dirichlet or Neumann: not unique; closed, Cauchy: too restrictive. One datum per point is the wrong count for an equation needing two on an initial surface, and a closed boundary generally meets the same characteristic twice. Riley, Hobson and Bence note that a boundary curve crossing a characteristic more than once can over-determine the problem so that no solution exists, and that the cure is to relax the conditions on the offending parts of the curve from Cauchy to Dirichlet or Neumann.
Parabolic, open, Dirichlet or Neumann: unique and stable in one direction. The standard parabolic problem is Evans's: the equation in U×(0,T], one condition on the lateral boundary ∂U×[0,T], and one initial condition on U×{t=0}. In the x–t plane this data set is an open curve — the bottom of a rectangle and its two sides — and it determines u on the remaining, open side. "In one direction" means forward in time only: the backward problem is ill posed, because diffusion smooths, so reversing it amplifies small, high-frequency errors without bound.
Parabolic, anything, Cauchy: too restrictive; Dirichlet or Neumann on a closed boundary: too restrictive. A parabolic equation is first order in time, so one condition per boundary point and one initial function are already enough; adding a terminal condition at t=T, which closing the boundary does, over-determines it.
Reference table(Uniqueness for the elliptic Dirichlet and Neumann problems)AdaptedAdapted from Riley, Hobson & Bence (2006), §20.7, Uniqueness theorem, p. 706
Let V be a connected region with boundary S. (Riley, Hobson and Bence state the theorem for "a region V and its boundary S" and do not say connected; the word is added here because the last step of their proof — ∇w=0, hence w constant — needs it, as the remark below records.) Suppose u is real-valued, that its first and second partial derivatives all exist and are continuous on V∪S, and that
∇2u=ρ in V,together with eitheru=f on Sor∂n∂u=g on S,
where ρ, f and g are prescribed. Then two functions satisfying all of this can differ by at most an additive constant. Under the Dirichlet condition that constant is forced to be zero, so the solution is unique; under the Neumann condition it is free, and the solution is unique only modulo constants, which is how Riley, Hobson and Bence state the theorem.
Idea of the proofOriginal
Subtracting two solutions kills both the source and the data, leaving a harmonic function whose boundary value, or whose normal derivative, vanishes. Green's first identity converts the volume integral of ∣∇w∣2 into a boundary integral of w∂w/∂n plus a volume integral of w∇2w. Each of the two boundary conditions kills the boundary term, and harmonicity kills the other; so the integral of a non-negative quantity vanishes, and the gradient must vanish identically.
Suppose u1 and u2 both satisfy the hypotheses, and set w=u1−u2.
Step 1 (the difference is harmonic). Subtracting the two equations, ∇2w=ρ−ρ=0 in V.
Step 2 (the difference has vanishing data). In the Dirichlet case u1=f=u2 on S, so w=0 there; in the Neumann case ∂u1/∂n=g=∂u2/∂n, so ∂w/∂n=0 there. The two cases are not mixed: whichever datum is prescribed, the corresponding quantity vanishes for w.
Step 3 (Green's first identity). Taking both scalar fields in Green's first identity to be w, which the assumed smoothness of u1 and u2 on V∪S permits,
∫V(w∇2w+∣∇w∣2)dV=∫Sw∂n∂wdS.
Step 4 (both unwanted terms vanish). The first term on the left vanishes by Step 1. The right-hand side vanishes by Step 2: the integrand is w∂w/∂n, and one of its two factors is identically zero on S in either case. Hence
∫V∣∇w∣2dV=0.
Step 5 (conclude). The integrand is continuous and non-negative, so it vanishes identically: ∇w=0 throughout V. Hence w takes a single value on each connected component of V, so u1 and u2 differ by a constant. With Dirichlet data w is zero on S, which pins the constant at zero and gives u1≡u2. With Neumann data nothing pins it, and two solutions may differ by any constant whatever. □
RemarkOriginal
Where the hypotheses are used, and the Neumann problem's extra condition.
Smoothness up to the boundary is used in Step 3; Green's first identity needs w differentiable in V and integrable on S. Without it the boundary integral need not exist and the argument has no first line.
Realness is used in Step 5, where ∣∇w∣2≥0 is the whole argument. For a complex-valued w one applies the same identity to wˉ and w instead.
Connectedness is used in Step 5. On a region with two components, w may be a different constant on each; with Dirichlet data each component touches S, so each constant is zero.
Uniqueness is not existence. The theorem says a solution, if found by any means at all, is the only one; this is what licenses the method of images and every other trick that guesses a solution and verifies it (see the method of images).
The Neumann problem needs a compatibility condition. For a solution of ∇2u=ρ in V with ∂u/∂n=g on S to exist at all, integrate the equation over V and apply the divergence theorem to ∇u:
∫VρdV=∫V∇⋅(∇u)dV=∫S∂n∂udS=∫SgdS.
So ∫VρdV=∫SgdS is necessary. If the data violate it, there is no solution whatever, and the table's verdict "unique, stable solution" for the elliptic Neumann problem must be read with that proviso and with the arbitrary constant of Step 5. Strauss sets precisely this calculation, for ∇2u=f with ∂u/∂n=0, as an exercise, and asks the reader for a physical interpretation without giving one; the following reading is therefore ours. For steady heat flow with ρ a source density, the displayed identity says that the total heat generated inside V must equal the total flux out through S, as it must if nothing is to accumulate. In Strauss's own case the boundary is insulated, so the flux out is zero and the identity reduces to the statement that the net heat generated must vanish.
ExampleOriginal
(a) A Robin problem, solved. Steady heat conduction in a slab 0<x<1 with no internal source satisfies u′′=0. Suppose both faces exchange heat with surroundings, giving the Robin conditions
u′(0)−2u(0)=−2,u′(1)+u(1)=4.
Every solution of u′′=0 is u=A+Bx, so u′=B and the conditions read B−2A=−2 and B+(A+B)=4, that is A+2B=4. From the first, B=2A−2; substituting, A+4A−4=4, so A=58 and B=56:
u(x)=58+56x,u(0)=1.6,u(1)=2.8.
Checking: u′(0)−2u(0)=1.2−3.2=−2 and u′(1)+u(1)=1.2+2.8=4. Two conditions, one at each end of an interval whose boundary is the pair of endpoints — a closed boundary in one dimension — give a unique solution, as the elliptic row of the table predicts.
Why the sign of the Robin coefficient was needed. In the convention ∂u/∂n+au=g the outward normal is −1 at x=0 and +1 at x=1, so the two conditions above read ∂u/∂n+2u=2 at the left end and ∂u/∂n+u=4 at the right: both have a>0, Strauss's radiating case. Take instead a=−2 at both ends with zero data, that is u′′=0 on (0,1) with
−u′(0)−2u(0)=0,u′(1)−2u(1)=0.
Then u(x)=1−2x satisfies both: u′≡−2, so the left condition is 2−2⋅1=0 and the right is −2−2⋅(−1)=0. Since u≡0 also satisfies them, uniqueness fails, and so the inhomogeneous problem is not solvable for every g. In Strauss's notation this is a0=al=−2, his absorbing case, and 1−2x is an eigenfunction of −X′′=λX with those conditions at eigenvalue λ=0. With a≥0 nothing of the sort can happen. Running Steps 1 to 4 of the proof on the difference w of two solutions, with ∂w/∂n=−aw on S, gives
∫V∣∇w∣2dV=∫Sw∂n∂wdS=−∫Saw2dS,
whose left side is non-negative and whose right side is non-positive; both therefore vanish, so w is constant, and the constant is zero wherever a>0 on S.
(b) The Neumann obstruction, in one dimension. Replace the Robin conditions by u′(0)=u′(1)=0 and allow a source: u′′=f on (0,1). Integrating once gives u′(1)−u′(0)=∫01fdx, so the compatibility condition is ∫01fdx=0 — exactly the identity of the remark, with S the two endpoints.
Incompatible data. For f≡1 we would need 0=1. No solution exists, however smooth everything is.
Compatible data. For f(x)=cos2πx we have ∫01f=0. Integrating, u′=sin(2πx)/(2π), which vanishes at both ends as required, and u(x)=−cos(2πx)/(4π2)+D for every constant D. So there are solutions, and they form a one-parameter family: uniqueness holds only up to the additive constant, as Step 5 says. Here u(0)=D−1/(4π2)=D−0.025330 and u(21)=D+0.025330.
(c) Counting conditions on the three prototypes. On 0<x<L:
Equation
Conditions needed
A standard choice
uxx+uyy=0 in a rectangle
one per boundary point, all round
u given on all four sides
ut=kuxx
one initial function, one condition at each end
u(x,0)=φ, u(0,t)=u(L,t)=0
utt=c2uxx
two initial functions, one condition at each end
u(x,0)=φ, ut(x,0)=ψ, u(0,t)=u(L,t)=0
The wave equation needs the extra initial function because it is second order in t; the mixed choice u(0,t)=ux(L,t)=0 for either evolution equation is legitimate and, for the diffusion equation, produces the eigenfunctions sin[(n+21)πx/L], n=0,1,2,…, instead of the pure sines sin(nπx/L) of the Dirichlet problem. These do satisfy both conditions: the sine vanishes at x=0, and its derivative at x=L is proportional to cos[(n+21)π]=0. The eigenvalues are [(n+21)π/L]2: the half-integer multiples of π/L, squared, in place of the integer ones. Swapping the two ends, to ux(0,t)=u(L,t)=0, replaces these by the cosines cos[(n+21)πx/L] with the same eigenvalues. On a ring of circumference 2l the periodic conditions u(−l,t)=u(l,t), ux(−l,t)=ux(l,t) replace the two end conditions, and the eigenvalues become (nπ/l)2 for n=0,1,2,…, with the value n=0 (a constant eigenfunction) present and every n≥1 doubled, since both cos(nπx/l) and sin(nπx/l) qualify.
ApplicationOriginal
Choosing the condition is the modelling step that decides whether a computation means anything, and the table is the checklist.
In a thermal or electrostatic finite-element calculation, Dirichlet conditions represent contact with a reservoir or a held potential, Neumann conditions represent insulation or a prescribed flux, and Robin conditions represent convective exchange with an ambient medium at a given temperature, with a the heat-transfer coefficient divided by the conductivity; a pure Neumann problem will not converge unless the fluxes balance to within round-off, which is the compatibility condition of the remark appearing as a solver diagnostic, and the solution it returns is pinned only after one node is anchored, which is the additive constant.
In ocean and atmosphere models the lateral walls of a regional domain are open boundaries for a hyperbolic system, so the data must be posed in the characteristic variables that enter the domain and nothing may be imposed on those that leave; imposing a full set of values on all variables there is the closed-boundary Cauchy case of the table, and it produces spurious reflections, the numerical form of "too restrictive". Periodic conditions are used for the zonal direction of a global model, where the domain really is a circle, and in molecular-dynamics and spectral computations to remove boundaries entirely.
For the reverse problems — reconstructing a past temperature field, or an interior source from measurements on an enclosing surface — the table says what is being attempted: the backward parabolic problem and the elliptic Cauchy problem, both ill posed. They are solved only after regularisation, that is, after being replaced by a nearby well-posed problem, which is why such inversions always carry a smoothing parameter.
Shows how a dilation symmetry of a partial differential equation forces solutions of the form t^{-alpha} v(x/t^beta), reduces the equation to an ordinary differential equation for the profile v, and carries this out for the diffusion equation, for the porous medium equation (the Barenblatt solution) and for the Airy equation.
Definition(Scaling symmetry, similarity variable, self-similar solution)AdaptedAdapted from Evans (2010), §2.3.1a, p. 43, and §4.2.2, pp. 175–176; Strauss (2008), §2.4, property (e), p. 47
Let an equation be posed for u(x,t) with x∈Rn, t>0. Say that the equation has a dilation symmetry with exponents (α,β) if, whenever u is a solution, so is
uλ(x,t):=λαu(λβx,λt)for every λ>0.(1)
A solution is self-similar, or a similarity solution, if it is unchanged by the whole family: u=uλ for all λ>0. Setting λ=t−1 in that identity and writing v(y):=u(y,1) gives the general form of such a solution,
u(x,t)=tα1v(tβx),(2)
in which
y=tβx
is the similarity variable and v the profile. The profile is a function of n variables instead of n+1: the symmetry has been traded for a reduction in dimension. When v is additionally radial, v(y)=w(∣y∣), the reduction is to a single ordinary differential equation.
The name says what the picture is. At two different times the graph of u is the same shape, rescaled: widened by the factor (t2/t1)β in x and shortened by (t1/t2)α in amplitude. Strauss states the symmetry of the diffusion equation ut=kuxx in the equivalent form that u(ax,at) solves it whenever u does, for every a>0, which is (1) with α=0, β=21 and λ=a; the chain rule gives it at once, since the dilation multiplies ut by a and uxx by (a)2=a.
Method(Finding a similarity solution)AdaptedAdapted from Evans (2010), §2.3.1a, pp. 43–44, and §4.2.2, pp. 175–177; Stakgold & Holst (2011), Exercise 8.2.6(c), p. 488
Find the dilation symmetry. Substitute uλ from (1) into the equation and collect the powers of λ that multiply each term. The equation is invariant exactly when all those powers agree; this gives one linear relation between α and β. (Equivalently: count the derivatives. One t-derivative scales like λ, one x-derivative like λβ, so ut and Δu balance when β=21, which is the diffusive scaling x∼t.)
Fix the remaining exponent from the side conditions. One relation leaves a one-parameter family of candidate scalings. Choose within it by asking that the data be invariant too. Three cases recur:
a conserved quantity, usually ∫udx, forces α=nβ;
initial or boundary data that are themselves dilation-invariant — a step, a constant, a delta — force the exponent that leaves them unchanged;
a radial reduction that is to simplify the resulting ordinary differential equation may itself dictate the choice.
Write the ansatz and substitute. Put u=t−αv(xt−β) into the equation and use the chain rule. With y=xt−β the time derivative contributes −t−(α+1)(αv+βy⋅Dv), and each pair of space derivatives contributes a factor t−2β.
Check that the powers of t cancel. If steps 1 and 2 were done correctly, every term carries the same power of t; divide it out. What is left is an equation for v in the variable y alone.
Reduce to an ordinary differential equation and integrate it. If the equation and the data are rotation-invariant, look for v(y)=w(r) with r=∣y∣; the reduced equation is then an ordinary differential equation in r, usually of the form (rn−1⋅)′=0 after one regrouping, so it integrates once immediately. Decay as r→∞ sets the first constant of integration to zero.
Fix the remaining constants and the domain. Impose the normalisation (total mass, or a boundary value) and check the sign of w; where the formula would go negative for a non-negative quantity, the solution is the positive part, and the boundary of its support is a free boundary.
Verify. Substitute the closed form back into the original equation. This step is not optional: steps 3 and 4 are easy to get wrong by one power.
Example(The diffusion similarity solution)AdaptedAdapted from Strauss (2008), §2.4, Steps 1–4, pp. 47–49
Solve ut=kuxx on −∞<x<∞, t>0, with the step initial datum u(x,0)=1 for x>0 and 0 for x<0. Call the solution Q.
Symmetry, and why the data pick it out. The equation admits u(x,t)↦u(ax,at) for every a>0. The step datum is also unchanged by x↦ax, because only the sign of x matters. So the problem as a whole is dilation-invariant, and the solution it determines must be too. A function of (x,t) invariant under (x,t)↦(ax,at) for all a>0 depends on x and t only through the combination x/t, since that combination is the invariant one. This is step 2 of the method in the form "invariant data".
Ansatz. Write Q(x,t)=g(p) with p=x/4kt, the constant 4k inserted only to tidy the algebra.
Reduce. By the chain rule, ∂p/∂t=−p/(2t) and ∂p/∂x=1/4kt, so
Qt=−2tpg′(p),Qx=4ktg′(p),Qxx=4ktg′′(p).
Hence 0=Qt−kQxx=−t1(2pg′+41g′′), and multiplying by −4t,
g′′+2pg′=0.
Every power of t has cancelled, as step 4 requires.
Integrate. The integrating factor is ep2, since (ep2g′)′=ep2(g′′+2pg′). So g′(p)=c1e−p2 and
g(p)=c1∫0pe−q2dq+c2.
Match the data. Letting t↓0 with x>0 sends p→+∞, and with x<0 sends p→−∞. Using ∫0±∞e−q2dq=±π/2, the two requirements 1=c1π/2+c2 and 0=−c1π/2+c2 give c1=1/π and c2=21. Therefore
Differentiate to get the kernel. Since the equation is linear with constant coefficients, ∂Q/∂x is again a solution, and
S(x,t)=∂x∂Q=4πkt1e−x2/4kt,
which is the heat kernel; convolving it with any initial datum φ solves the general initial-value problem. Note that S is itself self-similar, with α=21 and β=21 in the notation of (2): S(x,t)=t−1/2σ(x/t) with σ(y)=(4πk)−1/2e−y2/4k, and α=nβ with n=1, which is the conserved-mass condition of step 2.
Numbers. For k=1: Q(1,1)=21[1+erf(21)]=21(1+0.5204999)=0.7602499, and S(1,1)=(4π)−1/2e−1/4=0.2196956. Substituting the closed form for Q into Qt−kQxx gives zero identically.
The same method on a half-line. Stakgold and Holst treat wt=wxx for x>0 with w(x,0)=0 and w(0,t)=1, which is invariant under x∗=ax, t∗=a2t; taking a=1/(2t) turns the invariance into w(x,t)=h(x/2t), the reduced equation is h′′+2ξh′=0 with h(0)=1, h(∞)=0, and the solution is h=1−erfξ, so w(x,t)=1−erf(x/2t). The same reduced equation appears, with different boundary conditions picking a different pair of constants.
Example(The Barenblatt solution of the porous medium equation)AdaptedAdapted from Evans (2010), §4.2.2, Eqs. (27)–(36), pp. 175–177
The porous medium equation is
ut−Δ(uγ)=0in Rn×(0,∞),u≥0,γ>1,
a nonlinear diffusion in which the diffusivity grows with u. It is quasilinear and degenerate: where u=0 the diffusion switches off.
Symmetry. Substituting uλ=λαu(λβx,λt), the term ut acquires λα+1 while Δ(uγ) acquires λαγ+2β. The two balance exactly when
α+1=αγ+2β.(3)
Reduce. With u=t−αv(y), y=t−βx, the chain rule gives
αt−(α+1)v+βt−(α+1)y⋅Dv+t−(αγ+2β)Δ(vγ)=0,
so (3) makes every power of t equal and leaves αv+βy⋅Dv+Δ(vγ)=0.
Go radial. Put v(y)=w(r), r=∣y∣. Using Δf(r)=f′′+rn−1f′,
αw+βrw′+(wγ)′′+rn−1(wγ)′=0.
Choose the second exponent to make it integrable. Multiply by rn−1. The last two terms become (rn−1(wγ)′)′, and the first two become αrn−1w+βrnw′, which is the derivative β(rnw)′=β(nrn−1w+rnw′) precisely when
α=nβ.(4)
This is the conserved-mass condition of step 2 of the method, and here it is also exactly what makes the equation a total derivative:
(rn−1(wγ)′)′+β(rnw)′=0.
Integrate twice. Hence rn−1(wγ)′+βrnw=a for a constant a, and a=0 if w,w′→0 fast enough as r→∞. Dividing by rn−1 leaves (wγ)′=−βrw. Writing (wγ)′=γ−1γw(wγ−1)′, which holds wherever w>0, this becomes (wγ−1)′=−γγ−1βr, so
wγ−1=b−2γγ−1βr2
for a constant b, and taking the positive part to keep w≥0,
w(r)=(b−2γγ−1βr2)+1/(γ−1).
Solve (3) and (4) for the exponents. Substituting α=nβ into (3) gives nβ+1=nβγ+2β, so β(n(γ−1)+2)=1 and
the Barenblatt-Kompaneetz-Zeldovich solution, or Barenblatt solution, with b>0 a free parameter fixing the total mass.
Check, with numbers. For n=1, γ=2 the exponents are α=β=31 and the formula reads u=t−1/3(b−x2/(12t2/3))+. Substituting into ut=(u2)xx inside the support confirms it, as does the case n=2, γ=3, where α=31, β=61. With b=1, n=1, γ=2: at t=1 the support is ∣x∣≤12=3.4641 and the peak is u(0,1)=1; at t=8 the support has widened to ∣x∣≤12⋅81/3=6.9282 and the peak has dropped to 8−1/3=0.5. The total mass ∫udx is 3412b3/2 at both times, as α=nβ guarantees.
Why this matters. The Barenblatt solution has compact support at each time: the region {u>0} is a ball whose radius grows like tβ, with β<21 for γ>1. Evans records that the same holds generally: start a non-negative weak solution of this equation from initial data supported in a bounded set, and the set {u>0} stays bounded and spreads at finite speed — in contrast to the linear heat equation, whose kernel is positive everywhere for every t>0, so that a disturbance is felt instantly at arbitrary distance. For that reason the porous medium equation is sometimes preferred as a model of diffusive spreading.
ExampleOriginal
A dispersive similarity solution: the Airy equation from ut+uxxx=0. The method is not confined to diffusion. Take the linearised Korteweg-de Vries, or Airy, equation on the line, ut+uxxx=0, and look for the self-similar solution of unit mass.
Symmetry. Under uλ=λαu(λβx,λt) the term ut picks up λα+1 and uxxx picks up λα+3β, so invariance requires β=31: the natural scaling here is x∼t1/3, not x∼t1/2.
Second exponent. The equation conserves mass, because dtd∫udx=−∫uxxxdx=0 for u decaying at infinity. With n=1, step 2 of the method gives α=nβ=31.
Integrate once. Hence v′′=31ξv+C, and C=0 if v,v′′→0 as ξ→+∞. So v′′=31ξv.
Recognise it. Put s=ξ/31/3, so d2/dξ2=3−2/3d2/ds2 and the equation becomes 3−2/3vss=31/3sv/3=3−2/3sv, that is
ds2d2v=sv,
which is Airy's equation (see Airy functions). The solution decaying as s→+∞ is v=cAi(s); the second solution Bi grows and is rejected.
Normalise. With ∫0∞Ai=31 and ∫−∞0Ai=32 — the latter an improper integral, convergent only conditionally, since Ai(s) oscillates with envelope ∣s∣−1/4 as s→−∞ — the total is ∫−∞∞Ai(s)ds=1. Since ∫vdξ=c31/3∫Ai(s)ds, unit mass needs c=3−1/3, and
u(x,t)=(3t)1/31Ai((3t)1/3x).
Check. Differentiating this expression numerically at x=0.7, t=0.4 gives ut=−0.04886036050 and uxxx=+0.04886036050, which sum to zero to the working precision. At x=0, t=31 the value is Ai(0)=3−2/3/Γ(2/3)=0.3550280539.
Contrast with diffusion. The profile is oscillatory on one side and exponentially small on the other, and it spreads like t1/3 rather than t1/2, with amplitude falling like t−1/3. Nothing in the method changed; only the count of derivatives in step 1 did, and that is what sets the spreading rate.
RemarkOriginal
What the method needs, and what it gives.
A genuine symmetry. Step 1 fails whenever the equation contains a dimensional constant that the dilation does not respect. The equation ut−uxx=u has no dilation symmetry of the form (1), because the right-hand side scales like λα while ut scales like λα+1; the fix is to remove the offending term first, here by substituting u=etu~. A term with a fixed length or time scale in it always has to be absorbed or scaled away before step 1 can succeed.
Invariant data. The construction produces a solution of the equation, not of an arbitrary initial-value problem. It solves exactly the problems whose data are themselves invariant under the same scaling: a step, a constant boundary value, a point mass. That is why the heat-kernel and Barenblatt cases come out as fundamental solutions, with a delta as the initial condition.
Two conditions, two exponents. One relation comes from the equation (step 1), the second from the data or a conservation law (step 2). If both are supplied by the equation, as happens for some systems, there is no free exponent and the method either works outright or not at all; if neither is, a one-parameter family of similarity solutions results, which is the normal situation for second-kind self-similarity, where the exponent must be found by solving an eigenvalue problem for the profile.
Why these special solutions matter more than they look. Self-similar solutions are usually the long-time attractors of their equations: general initial data forget their shape and approach the similarity profile, with the exponents α,β setting the rates. The heat kernel plays that role for the linear diffusion equation, and the Barenblatt profile for the porous medium equation. This is also why dimensional analysis so often predicts the right power law: it is step 1 of this method, done without writing the equation down.
Degeneracy and free boundaries. In step 6 the positive part is not a cosmetic truncation: it is forced, because the equation degenerates where u=0, and the edge of the support is a genuine moving interface. Taking the positive part of a formula is legitimate only for an equation that admits weak solutions of that kind; doing it to a solution of the linear heat equation would produce something that is not a solution at all.
ApplicationOriginal
Similarity solutions are the standard way of extracting a quantitative law from a diffusive or dispersive process when the geometry is simple enough to have no intrinsic length.
In heat transfer the half-line solution w=1−erf(x/2κt) is the textbook description of a semi-infinite body whose surface is suddenly brought to a new temperature; it gives the thermal penetration depth δ≃2κt used in quenching, in welding and in estimating how deep the daily and annual temperature waves reach into soil and rock. The same formula, with κ the chemical diffusivity, gives the carburising depth in steel and the junction depth in semiconductor dopant diffusion; because the profile depends only on x/t, doubling the depth costs four times the time, a scaling that is read directly off the similarity variable.
In geophysics and hydrology the Barenblatt solution describes the spreading of a finite mass of fluid through a porous medium — a groundwater mound, an oil or gas pocket, a spreading viscous gravity current — and its finite propagation speed, with a front at radius ∝tβ, is what makes it usable: the linear diffusion equation would predict a trace of the pollutant everywhere immediately. Equations of porous-medium type also model radiative heat transport in a plasma, which is where Zeldovich and Kompaneetz met the solution.
In the theory of water waves the t1/3 Airy similarity solution is the universal shape of the leading edge of a dispersive wave train: the oscillatory tail behind a front, with wavelength shrinking and amplitude decaying as t−1/3, is seen in ship wakes, in tsunami records, and in the collapse of an initial step for the Korteweg-de Vries equation (see travelling-wave solutions for the other half of that story, the solitons that run ahead of it).
Reduces a partial differential equation to an ordinary differential equation for a profile moving at constant speed, shows when the speed is free and when it is selected by the equation, derives the Korteweg-de Vries soliton and an explicit bistable reaction-diffusion front, and states the existence theorem for such fronts.
Definition(Travelling wave, plane wave, profile, speed)AdaptedAdapted from Evans (2010), §4.2.1, Eqs. (1)–(3), p. 167; Stein & Shakarchi (2003), Ch. 1, §1.1, p. 9
Let an equation be posed for u(x,t) with x∈R. A solution of the form
u(x,t)=v(x−σt)(x∈R,t∈R)(1)
is a travelling wave with speedσ and profilev. Its graph at any time is the graph of v translated by σt: the shape never changes, only its position. With x∈Rn, a solution
u(x,t)=v(y⋅x−σt),y∈Rn∖{0},(2)
is a plane wave, with wavefronts the hyperplanes normal to y and speed σ/∣y∣ in the direction y/∣y∣. A travelling wave which decays at both ends, v→0 as s→±∞, is a solitary wave; one which connects two distinct constant states, v(−∞)=v(+∞), is a front (or a kink). For a linear equation with constant coefficients it is convenient to allow complex-valued plane waves
u(x,t)=ei(y⋅x−σt),
with y the wave numbers and σ the time frequency; substituting into the equation forces a relation σ=σ(y), the dispersion relation. Then σ(y)/∣y∣ is the phase velocity, the speed at which this single plane wave moves, and Dσ(y) is the group velocity, which is the speed at which a superposition ∫ei(y⋅x−σ(y)t)a(y)dy transports its energy: by stationary phase the main contribution at large t with x/t fixed comes from the wave numbers with Dσ(y)=x/t.
The simplest case is the linear wave equation utt=uxx: as Stein and Shakarchi observe, F(x−t) and F(x+t) solve it for every twice-differentiable F, so both speeds ±1 occur and every profile is admissible; and the change of variables ξ=x+t, η=x−t turns the equation into vξη=0, whose double integration shows that every twice-differentiable solution is a sum F(x+t)+G(x−t) of two such waves. The interesting questions arise when the equation restricts the profile, the speed, or both.
Method(The travelling-wave ansatz)AdaptedAdapted from Evans (2010), §4.2.1, pp. 169–171
Substitute. Put u=v(s) with s=x−σt into the equation. Since ∂tu=−σv′ and ∂xku=v(k), every term becomes a term in v and its derivatives: the result is an ordinary differential equation for v, of the same order as the highest x-derivative, containing σ as a parameter.
Impose the conditions at infinity. A solitary wave asks v,v′,v′′→0 as s→±∞; a front asks v→v± as s→±∞ with v′→0, where v± must be zeros of the reaction term, since they are constant solutions of the equation.
Reduce the order. Look for first integrals. A term v(k) integrates once immediately; a factor v′ makes the whole equation an exact derivative. For second-order autonomous problems, multiplying by v′ and integrating produces an energy relation of the form 21(v′)2+W(v)=const.
Use the conditions at infinity to kill the constants. This is where the ansatz earns its keep: each decay condition fixes one constant of integration, usually to zero, and what remains is a first-order separable equation.
Decide the status of σ. Three outcomes occur, and they are not a matter of technique but of the equation:
σ is free: a travelling wave exists for every σ in some range (the linear wave equation; the Korteweg-de Vries soliton);
σ is selected: exactly one value admits a solution with the required behaviour at ±∞ (the bistable front below);
no travelling wave exists at all for the required boundary behaviour.
In the selected case the mechanism is a counting argument in the phase plane: the orbit leaving one equilibrium and the orbit entering the other each form a one-parameter family in σ, and they coincide only for special σ.
Verify, and read off the physics. Substitute back. Then extract what the answer says: the relation between amplitude and speed, the width of the front, and the direction of travel (the sign of σ says which state advances).
Method(Existence of a front for a bistable nonlinearity)AdaptedAdapted from Evans (2010), §4.2.1c, hypotheses (13) and the conclusion at Eq. (26), pp. 170–175
Consider the scalar reaction-diffusion equation
ut−uxx=f(u)in R×(0,∞),(3)
and suppose f:R→R is smooth and, for some a with 0<a<1, satisfies
(a) f(0)=f(a)=f(1)=0;(b) f<0 on (0,a),f>0 on (a,1);(c) f′(0)<0,f′(1)<0;(d) ∫01f(z)dz>0.(4)
Then there is a speed σ<0 and a profile v for which u(x,t)=v(x−σt) solves (3) with
s→+∞limv(s)=1,s→−∞limv(s)=0,s→±∞limv′(s)=0.(5)
Evans adds that a more refined analysis, which he does not give, shows that this σ is unique: for a nonlinearity satisfying (4) there is exactly one speed at which such a front exists. Contrast this with the soliton below, which exists for a whole half-line of speeds.
Idea of the proofOriginal
The ansatz turns (3) into the second-order equation v′′+σv′+f(v)=0, which is the equation of a particle in the potential −∫f with friction coefficient σ. Written as a planar system it has saddle points at the two stable states (0,0) and (1,0), because hypothesis (4)(c) makes the linearisation at each have eigenvalues of opposite sign. A front is exactly an orbit running from one saddle to the other, and the saddles each emit or absorb a single orbit, so the two curves must be made to coincide. The parameter σ is the friction, and the energy 21w2+∫0vf changes along orbits at the rate −σw2. With no friction the two curves miss each other in one direction, by hypothesis (4)(d); with enough friction they miss in the other; so somewhere in between they meet.
ProofAdaptedAdapted from Evans (2010), §4.2.1c, Eqs. (14)–(26), pp. 170–175
Evans presents this argument as an outline, without complete proofs of the geometric claims about the invariant curves; the steps below follow his route, and the places where a claim is asserted rather than established are flagged in the note after the proof.
Step 1 (the ansatz and the reduced equation). Putting u=v(x−σt) in (3) gives −σv′−v′′=f(v), that is
v′′+σv′+f(v)=0,(6)
to be solved with the conditions (5). Note first why the limits must be 0 and 1 and not something else: a constant limit v± with v′→0 forces f(v±)=0, so the limits are among 0,a,1; and (4)(c) with f′(a)≥0 makes 0 and 1 the stable constant solutions of (3) and a the unstable one, so a front interpolating between stable states must join 0 to 1.
Step 2 (phase plane). Set w=v′. Then (6) becomes the autonomous planar system
v′=w,w′=−σw−f(v),(7)
and the conditions (5) become (v,w)→(1,0) as s→+∞ and (v,w)→(0,0) as s→−∞.
Step 3 (both equilibria are saddles). By (4)(a), (0,0) and (1,0) are the equilibria of (7) with v∈{0,1}. Linearising (7) at (v∗,0) gives the matrix (0−f′(v∗)1−σ), with characteristic equation λ2+σλ+f′(v∗)=0 and roots
λ±=2−σ±(σ2−4f′(v∗))1/2.
By hypothesis (4)(c), f′(v∗)<0 at both v∗=0 and v∗=1, so the discriminant exceeds σ2≥0 and the roots are real, while their product f′(v∗) is negative, so they have opposite signs. Hence both equilibria are saddle points (see linearisation). Consequently exactly one orbit leaves (0,0) into the quadrant {v>0,w>0} — call its closure the unstable curve Wu, tangent at (0,0) to the line w=λ0+v — and exactly one orbit enters (1,0) from that quadrant — the stable curve Ws, tangent at (1,0) to w=λ1−(v−1). Both curves and both eigenvalues depend on σ.
Step 4 (what is to be shown). A front exists precisely when, for some σ,
Wu=Wsin {v>0,w>0},
for then that common orbit is a heteroclinic orbit from (0,0) to (1,0), and reading it as a graph w=w(v) and integrating v′=w recovers v.
So for σ<0, E is non-decreasing along every orbit, and for σ=0 it is constant, so the orbits lie in the level sets of E.
Step 6 (both curves cross a fixed vertical line). Fix a small ε>0 with a+ε<1 and let L be the vertical segment above (a+ε,0). Let R be the region whose three straight sides are the segment of w=0, the segment of v=0, and L. Evans argues, for σ<0, that Wu enters R from the origin and can leave it only across L, at some height w0(σ), and that Ws likewise reaches L, at some height w1(σ).
Step 7 (at zero friction the stable curve is higher). For σ=0 each curve lies in a level set of E by Step 5. On Wu that level is E(0,0)=0, so at v=a+ε,
2w0(0)2=−∫0a+εf,hencew0(0)=(−2∫0a+εf)1/2,
which is a positive real number because f<0 on (0,a) and ε is small. On Ws the level is E(1,0)=∫01f, so
w1(0)=(2∫01f−2∫0a+εf)1/2.
Since ∫01f>0 by hypothesis (4)(d), the quantity under the second root exceeds that under the first, and therefore
w0(0)<w1(0).(8)
This is the only place (4)(d) is used, and it is what gives the front its direction.
Step 8 (at large friction the unstable curve is higher). Fix β>0 and consider the segment T={0≤v≤a+ε,w=βv}. On T, dividing the two equations of (7),
v′w′=w−σw−f(v)=−σ−βvf(v).
Because f is smooth with f(0)=0, the ratio ∣f(v)/v∣ is bounded by some C on 0≤v≤a+ε, so w′/v′≥−σ−C/β, which exceeds β once σ<0 with ∣σ∣ large enough. The orbit therefore crosses T more steeply than T itself and cannot escape below it, so Wu stays above the line w=βv until it reaches L, giving w0(σ)≥β(a+ε). On the other hand Evans asserts w1(σ)≤w1(0) for all σ≤0. Choosing β large enough that β(a+ε)>w1(0) and then σ sufficiently negative,
w0(σ)>w1(σ).(9)
Step 9 (intermediate value). The two heights w0 and w1 depend smoothly on σ, so by (8), (9) and continuity there is a σ<0 with
w0(σ)=w1(σ).
At that σ the two curves meet at a point of L; since both are orbits of the same autonomous system (7), and an orbit through a point is unique, they are the same orbit. This is the heteroclinic connection of Step 4, and it yields a travelling wave of (3) satisfying (5). □
NoteOriginal
Three claims in the proof are asserted by Evans rather than proved, and are repeated here on his authority: that Wu cannot leave the region R except through L and that Ws likewise reaches L (Step 6); that w1(σ)≤w1(0) for every σ≤0 (Step 8); and that w0 and w1 depend smoothly on σ (Step 9). He also states the uniqueness of the selected speed as the outcome of a more refined analysis which he does not present. The explicit example below is independent of all of this: for one particular cubic f satisfying (4), it exhibits the front and its speed in closed form and verifies them by substitution.
Remark(Plane waves and dispersion)AdaptedAdapted from Evans (2010), §4.2.1a, pp. 167–169
For linear constant-coefficient equations, inserting u=ei(y⋅x−σt) is step 1 of the method with an exponential profile, and the resulting dispersion relation already tells one most of what the equation does.
Equation
Dispersion relation
What it says
ut−Δu=0
σ=−i∣y∣2
purely imaginary σ: the factor e−∣y∣2t damps, and damps faster the shorter the wave
utt−Δu=0
σ=±∣y∣
real σ, with speed ∣σ∣/∣y∣=1 for every y: no damping, no dispersion
utt−Δu+m2u=0
σ=±(∣y∣2+m2)1/2
real, but the speed now depends on ∣y∣: dispersion, with the slowly oscillating waves travelling faster
iut+Δu=0
σ=∣y∣2
dispersion
ut+uxxx=0
σ=−y3
dispersion, with speed y2
Damping shows up as Imσ=0 and dispersion as a non-constant phase velocity σ(y)/∣y∣. Dispersion is what makes the nonlinear balance of the next example possible: in the Korteweg-de Vries equation the dispersive term uxxx spreads a pulse out while the nonlinear term uux steepens it, and a soliton is the shape for which the two exactly cancel.
Example(The Korteweg-de Vries soliton)AdaptedAdapted from Evans (2010), §4.2.1b, Eqs. (4)–(11), pp. 169–170; Strauss (2008), §14.2, Eqs. (1)–(3), pp. 390–391
Take the Korteweg-de Vries equation in Evans's and Strauss's normalisation,
ut+6uux+uxxx=0in R×(0,∞),
a model for long surface waves on shallow water, and look for a solitary wave u=v(x−σt).
Substitute. With s=x−σt, the equation becomes −σv′+6vv′+v′′′=0.
Integrate once. Every term is a derivative: (−σv+3v2+v′′)′=0, so
−σv+3v2+v′′=a
for a constant a.
Integrate again. Multiply by v′. Then −σvv′+3v2v′+v′′v′=av′, and each side is a derivative, giving
2(v′)2=−v3+2σv2+av+b
for a second constant b.
Impose decay. A solitary wave has v,v′,v′′→0 as s→±∞. Letting s→∞ in step 2 gives a=0, and then in step 3 gives b=0. Hence
(v′)2=v2(σ−2v),
which already forces σ>0 for a non-trivial non-negative profile, and bounds the amplitude by σ/2.
Solve. Separating variables and substituting v=2σsech2θ reduces the integral to ds=(2/σ)dθ, so θ=2σ(s−c) and
u(x,t)=2σsech2(2σ(x−σt−c))(σ>0,c∈R).
Substituting this expression into the equation confirms it identically.
What the formula says. There is a soliton for every speed σ>0: the speed is free, the opposite of the bistable case. Its amplitude is σ/2 and its width is of order 2/σ, so taller solitons are narrower and faster, as Strauss puts it: tall, thin and fast for large σ; short, fat and slow for small σ. Numerically, σ=2 gives amplitude 1 and σ=8 gives amplitude 4 at twice the width-inverse, so a soliton four times as tall travels four times as fast and is half as wide.
Conventions differ, and the formula with them. Arfken, Weber and Harris write the equation as ψt+ψψx+ψxxx=0, without the factor 6, and obtain ψ=3csech2(21c(x−ct)) — amplitude 3c rather than c/2. The two are the same family: replacing u by ψ/6 turns one equation into the other, and 2σ↦3σ under that substitution. Strauss remarks that the factor 6 has no special significance; it is chosen to tidy the formula. Always check which normalisation a quoted soliton formula belongs to.
Why solitons are remarkable. Strauss records the history: J. S. Russell saw a solitary heap of water run along a canal for a mile or two without changing shape in 1834, and Kruskal and Zabusky found numerically in the 1960s that when a fast soliton overtakes a slow one the two emerge from the nonlinear interaction with their shapes and speeds intact, delayed only by a phase shift, and that general initial data decompose as t→∞ into finitely many solitons plus a decaying dispersive tail. The explanation is that the equation is integrable, with an exact solution available for general data through inverse scattering; the three invariants ∫u, ∫u2 and ∫(21ux2−u3) are the first of infinitely many conserved quantities.
ExampleOriginal
An explicit bistable front, with its selected speed. Take the cubic
f(u)=u(1−u)(u−a),0<a<21,
in equation (3). It satisfies all four hypotheses (4): the zeros are 0,a,1; f<0 on (0,a) and f>0 on (a,1) by inspection of the three factors; f′(0)=−a<0 and f′(1)=−(1−a)<0; and
which is positive exactly when a<21. So the theorem applies and predicts a unique σ<0.
Guess the shape. The reduced equation is v′′+σv′+v(1−v)(v−a)=0 with v(−∞)=0, v(+∞)=1. Try an orbit on which w=v′ is the quadratic v′=κv(1−v), with κ>0: this vanishes at both equilibria and is positive between them, so it is a candidate for the heteroclinic orbit of Step 4.
Substitute. Differentiating, v′′=κ(1−2v)v′=κ2v(1−v)(1−2v). Putting both into the reduced equation,
κ2v(1−v)(1−2v)+σκv(1−v)+v(1−v)(v−a)=0,
and dividing by v(1−v), which is nonzero for 0<v<1,
κ2(1−2v)+σκ+(v−a)=0.
Match powers of v. The coefficient of v is 1−2κ2 and the constant term is κ2+σκ−a. Both must vanish, so
κ=21,σ=κa−κ2=2(a−21)=22a−1.
The guess has worked, and it has produced one value of σ and no freedom: the speed is selected, exactly as the theorem says. And σ<0 precisely when a<21, which is precisely when ∫01f>0 — the hypothesis used in Step 7 of the proof.
Integrate for the profile. Solving v′=v(1−v)/2 by separation gives the logistic profile
v(s)=1+e−s/21,sou(x,t)=1+exp(−(x−σt)/2)1,
with v(−∞)=0, v(+∞)=1, v(0)=21 and v′(±∞)=0, as (5) requires. Equivalently v(s)=21[1+tanh(s/(22))].
Check. Substituting this u into ut−uxx=u(1−u)(u−a) with σ=(2a−1)/2 gives zero identically, for every a.
Numbers. For a=41: σ=−221=−0.3535534, so the front moves to the left at that speed, meaning the state u=1 advances into the state u=0 — which is the state with the larger value of ∫f, as it should be. The front is centred where u=21, at x=σt, and its width is of order 2: u=0.8044 at s=2 and u=0.1956 at s=−2. At the balanced value a=21 the speed is zero and the front stands still; for a>21 it reverses, and u=0 invades instead.
A caution on generality. This is one explicit member of the family the theorem covers, not a proof of the theorem: the trick of guessing v′=κv(1−v) works because the nonlinearity is exactly cubic with zeros at 0 and 1, and it has no analogue for general f. Note also that if f is positive on all of (0,1), so that f′(0)>0 and hypothesis (4)(c) fails, none of the above applies: the equilibrium at the origin is then not a saddle, Step 3 breaks down, and the speed is no longer determined by this argument.
ApplicationOriginal
Fronts of exactly the bistable kind are how a transition spreads through a medium that has two stable states. In combustion, u is a scaled temperature or reactant fraction and the front is a premixed flame, whose selected speed is the laminar burning velocity — a material property, measured in cm/s, that the equation predicts from the reaction kinetics and the thermal diffusivity. In materials science the same equation with f=−W′(u) for a double-well W is the Allen-Cahn equation, and the front is the interface between two phases of a solidifying alloy or two orientations of a magnetic domain; the unequal well depths, which are hypothesis (4)(d), drive the interface towards the deeper well at the speed computed above, and the front width 2 in the example is the interface thickness in units of the diffusion length. In neurophysiology the cubic f is the fast part of the FitzHugh-Nagumo reduction of the Hodgkin-Huxley equations, and the front is the leading edge of an action potential travelling along an axon; that the conduction velocity is a definite number, not a free parameter, is exactly the speed selection of the statement above. In population biology the same structure describes an advantageous gene or an invading species spreading into territory held by a resident one.
Solitary waves appear wherever weak nonlinearity balances weak dispersion. The Korteweg-de Vries soliton is the shallow-water wave Russell chased on horseback, and it is also the model for internal waves in a stratified ocean and for ion-acoustic pulses in a plasma; the closely analogous soliton of the nonlinear Schrödinger equation is the basis of soliton transmission in optical fibres, where the pulse shape survives propagation because self-phase modulation cancels group-velocity dispersion. Dispersion relations themselves, the linear part of this unit, are the daily tool for reading a wave-bearing equation: whether it damps, at what rate the short waves go, and at what speed a wave packet actually carries energy, which is the group velocity and not the phase velocity.