DifferentialEquations
Chapter 7 · Section 7.1

7.1 Differential Operators and the Operator Method

Up to now every problem had one unknown function. Real devices rarely behave like that. Two masses joined by a spring pull on each other; the currents in two loops of a network share a branch; salt flows back and forth between connected tanks. In each case the rate of change of one quantity depends on the other quantity too, so the equations are coupled: we cannot solve one without knowing the other.

This section gives the oldest and most direct way to deal with coupled linear equations with constant coefficients: eliminate one unknown, exactly as you would in an algebraic system of two equations. To do that cleanly we need a compact notation for derivatives, the differential operator , and a few rules for calculating with it.

Throughout this chapter the independent variable is time , and the unknowns are written , (or , , …). Primes mean derivatives with respect to .

What a linear system looks like

A system of two first-order linear equations in and has the general form

Each equation may contain both derivatives. A solution on an interval is an ordered pair of functions , that make both equations true for every in . Satisfying one equation is not enough.

Systems can also contain higher derivatives. Newton's law for two connected bodies, for instance, gives two second-order equations, one for each body (Section 7.2). Systems with three or more unknowns are built in the same way.

In this section all coefficients are constants. That is the case where the operator method works. A particularly tidy type, the normal form, in which each equation is solved for one derivative,

will be studied in detail from Section 7.3 on. The operator method handles it too, but it does not need it.

The differential operator

We write for "differentiate with respect to ":

You met this notation in Section 4.1 (with as the variable there). A polynomial in means "take these derivatives, multiply by these constants, and add". For example

A lone constant in such an expression means "multiply by " (think of it as ).

Definition 7.1.1 (Linear differential operator with constant coefficients)

An expression

with real constants , is a linear differential operator of order with constant coefficients. It acts on an -times differentiable function by

The polynomial , obtained by writing in place of , is the polynomial associated with .

is not a number

is the second derivative of , not " times times " in the sense of multiplying numbers, and is not . The power of the notation is that, for constant coefficients, operators may nevertheless be added, multiplied and factored as if they were numbers. The next theorem says exactly what is allowed.

The algebra of operators

Two operators are equal if they give the same result on every (sufficiently differentiable) function. With this meaning:

Theorem 7.1.1 (Rules for constant-coefficient operators)

Let , , be linear differential operators with constant coefficients, let be constants and functions with enough derivatives.

  1. Linearity. .
  2. Products. Applying first and then gives the same result as the single operator whose associated polynomial is the product .
  3. Commutativity. : the order does not matter.
  4. Factoring. If , then .
  5. Exponentials. for every constant .

Why are these true? Rule 1 holds because derivatives of sums are sums of derivatives. For rule 2, look at a single product, say :

The last operator is exactly the one built from . The key step was moving the constant through a derivative: . Since and enter the answer symmetrically, we also get , which is rule 3. Every constant-coefficient operator is built from such factors, so the rules hold in general. Rule 5 follows from .

Commutativity needs constant coefficients

If a coefficient depends on , the order matters. Compare and acting on :

They differ by . This is why the elimination method below is used only for constant coefficients.

Example 7.1.1

Let . Compute for (a) , (b) , (c) .

Solution
  1. (a) and , so
  2. (b) Use rule 5 with : , so . (Directly: .)
  3. (c) By linearity there is nothing new to compute:
Example 7.1.2

Let , and . Compute , and , where is the operator with associated polynomial .

Solution
  1. Derivatives of . By the product rule, , , .
  2. (apply first). . Then
  3. (apply first). . Its derivatives are and , so
  4. The product operator. , so and
  5. Conclusion. All three agree, as Theorem 7.1.1 promises.

The operator method for two equations

Consider a system with constant coefficients written in operator form,

where are polynomials in (possibly constants, possibly zero). For instance, becomes .

Eliminating one unknown

Recall how you eliminate from , : multiply the first equation by , the second by , and subtract. We do exactly the same, but "multiply" now means "apply the operator".

  1. Apply to the first equation and to the second:
  2. Subtract. Because (commutativity!), the -terms cancel:
  3. Do the same for . Applying to the first equation, to the second, and subtracting the first result from the second gives

Both unknowns now satisfy a single constant-coefficient equation with the same operator on the left,

the operator determinant of the system. Equations (7.1.2) and (7.1.3) are solved with the methods of Chapter 4: characteristic equation for the homogeneous part, undetermined coefficients (or variation of parameters) for a particular solution. Notice the resemblance to Cramer's rule; the right-hand sides are "determinants" with replacing a column, but the operator must always be written in front of the function it acts on.

Too many constants

Suppose has order . Solving (7.1.2) gives with constants , and solving (7.1.3) gives with more constants . That is constants. But elimination only produced consequences of the system: every solution of the system satisfies (7.1.2) and (7.1.3), but not every pair satisfying (7.1.2) and (7.1.3) solves the system. The constants are linked, and we find the links by substituting back into the original equations.

Theorem 7.1.2 (Number of arbitrary constants)

Suppose the operator determinant of system (7.1.1) is not the zero operator, and let be its order (the degree of the polynomial ). Then the general solution of (7.1.1) contains exactly arbitrary constants.

The theorem tells us when to stop: once the relations among the constants leave exactly of them free, we are done. Two special situations deserve a word.

  • If is a nonzero constant (), then (7.1.2) and (7.1.3) give and directly, with no constants at all. The system has exactly one solution and no initial conditions can be imposed. See Example 7.1.6.
  • If is the zero operator, the two equations are not really independent. The system then has either no solution or infinitely many, with an arbitrary function in the answer (Exercise 12). Such systems are badly posed and we will not consider them further.

Why should the order of matter? Count derivatives in a simple case. In a normal-form system , we expect to choose and freely, two constants, and indeed has order 2. In two second-order equations for two masses we choose two positions and two velocities, four constants, and has order 4 (Section 7.2).

Figure 7.1.1. The operator method at a glance. The shortcut on the right (find algebraically) avoids the second differential equation and the matching of constants.
Method in a nutshell
  1. Write the system in operator form , .
  2. Compute . Its order is the number of arbitrary constants in the answer.
  3. Solve for (constants ).
  4. Solve for (new constants ). The homogeneous parts use the same basic functions as for .
  5. Substitute and into the original equations and equal the coefficients of each basic function to zero. Solve these relations for in terms of .
  6. Shortcut (often available for first-order systems): instead of steps 4–5, combine the two original equations so that (and any higher derivatives of ) cancel. The result gives algebraically in terms of , , … . Substitute the found in step 3.
Common mistakes
  • Writing down with 's and with independent 's and stopping there. That pair has constants and is not the general solution.
  • Substituting into only one equation when that equation gives no information about some term. Check that constants remain; if more remain, use the other equation as well (Example 7.1.3).
  • Computing as " times ". It means: apply to , that is, differentiate.
Example 7.1.3

Find the general solution of

Solution
  1. Operator form. and .
  2. Operator determinant. It has order , so the answer will contain two constants.
  3. Equations for and . The right-hand sides are zero, so and . The characteristic roots are and :
  4. Substitute into the first equation. Using rule 5, , , , . Hence Since and are linearly independent, both coefficients vanish: and .
  5. Check the second equation. and , so the -terms give : this equation says nothing about . For : . Consistent. (Had we used only the second equation, would have stayed free and we would have had three constants, one too many.)
  6. General solution. If you dislike fractions, rename : , . Both forms describe the same family.
Example 7.1.4

Solve first in general and then with , . Use the shortcut to find .

Solution
  1. Operator form. and . So , , , .
  2. Determinant. Order : two constants.
  3. Right-hand side for . So .
  4. Solve for . Homogeneous part: roots . Particular part: try . Then , so and , i.e. :
  5. Shortcut for . Subtract the second original equation from the first: the terms cancel and
  6. Substitute. and . So and No constants had to be matched: the shortcut produces the correct number automatically.
  7. General solution.
  8. Initial conditions. At : and . So and . Subtracting, : , .
  9. Answer. Figure 7.1.2 shows both functions.
Figure 7.1.2. The solution of Example 7.1.4. Both unknowns are driven by the forcing: appears in and , while the in comes from the forcing . The terms die out quickly.
Example 7.1.5 (A system with a second derivative)

Find the general solution of

Solution
  1. Operator form. and .
  2. Determinant. Order , so the general solution has three constants, not four, even though the first equation is of second order.
  3. Solve for . with roots :
  4. Shortcut for . Subtract the second equation from the first. The terms cancel:
  5. Substitute term by term. For the operator gives the factor : : ; : ; : .
  6. General solution. You can check that this pair satisfies both equations for every choice of .
Example 7.1.6 (A determinant that is a constant)

Solve

Solution
  1. Operator form. and .
  2. Determinant. A nonzero constant: by Theorem 7.1.2 there are no arbitrary constants.
  3. Find . Equation (7.1.2) reads :
  4. Find . Equation (7.1.3) reads :
  5. Check. , . First equation: . Second: . Both hold.
  6. Comment. The system has the single solution , . Its value at is forced to be : an initial condition such as cannot be met. Systems that are not in normal form can behave like this, which is one reason why the normal form of Section 7.3 is preferred for theory.
Other routes to the same answer

For systems in normal form there is a more systematic method based on eigenvalues (Section 7.4 and, with matrices, Sections 7.6–7.7). For initial-value problems with constant coefficients, the Laplace transform turns the whole system into algebra; see Section 9.5. The operator method remains the most flexible choice when the system mixes derivatives of different orders or is not in normal form.

Exercises

  1. Let . Compute (a) , (b) , (c) .
    Answer (a) ; (b) ; (c) .
  2. Write each operator in factored form: (a) , (b) , (c) .
    Answer (a) ; (b) ; (c) .
  3. Let . Compute and and show that both equal .
    Answer All three equal .

In Exercises 4–9 find the general solution by the operator method.

  1. , .
    Answer . , .
  2. , .
    Answer . , .
  3. , .
    Answer . , .
  4. , .
    Answer , .
  5. , . (Write it as , .)
    Answer . , .
  6. , .
    Answer , three constants. , .
  7. Solve the system of Exercise 5 with , .
    Answer , .
  8. Without solving, find the number of arbitrary constants in the general solution of , . Then do the same for , , and solve that second system.
    Answer First system: , four constants. Second: , no constants; the only solution is , .
  9. Show that , has no solution. What is ? What happens if the second right-hand side is changed to ?
    Answer . Doubling the first equation gives , a contradiction. With the equations coincide: can be any differentiable function and .