6.1 Power Series Solutions About an Ordinary Point
Up to now every second-order linear equation we solved had either constant coefficients or the very special Cauchy–Euler form. In both cases the solutions were built from familiar functions: exponentials, sines, cosines, powers and logarithms. Most equations with variable coefficients are not so kind. A simple-looking equation such as
has no solution that can be written with elementary functions at all. Yet equations of this type are everywhere in engineering: the deflection of a column whose stiffness changes along its length, the temperature in a fin with a tapered cross-section, waves in a medium whose properties vary with position. We need a method that does not depend on guessing the right function.
The idea of this section is simple. If we cannot guess the solution, we look for it as an infinite polynomial, a power series , and let the differential equation tell us the coefficients one after another. To do this confidently you need three things: a short review of power series, a reliable technique for shifting the index of a sum, and a theorem that tells you when the method works and for which the series converges.
A short review of power series
A power series about the point (the center) is an infinite sum
For every power series there is a number with , the radius of convergence, such that the series converges (absolutely) for and diverges for . At the two endpoints anything can happen.
The most practical way to find is the ratio test. Look at the ratio of two consecutive nonzero terms. If
then the series converges when , so (with when and when ). If only every second coefficient is nonzero (a series with only even powers, say), apply the same idea to consecutive nonzero terms; we will do exactly this in the examples.
Three familiar series will keep showing up. They all converge for every except the last one, which needs :
Suppose has radius of convergence . Then on :
- Term-by-term differentiation. is differentiable and and these series also have radius .
- Coefficients. ; in other words the series is the Taylor series of .
- Identity principle. If for every in some open interval around , then for every .
- Algebra. Two series with the same center can be added term by term, and a series can be multiplied by a polynomial term by term; the result converges at least where both pieces converge.
Point 3 is the engine of the whole method: after substituting a series into a differential equation we will collect everything into one series equal to zero, and then set every coefficient to zero. Point 2 explains why the lower limits in and start at and : the constant term disappears when differentiated once, and the linear term disappears when differentiated twice.
A function is analytic at if it equals a power series with positive radius of convergence on some open interval around .
Polynomials, , and are analytic at every point. A rational function (with common factors cancelled) is analytic at every point where . Functions such as , and are not analytic at .
Shifting the index of summation, step by step
This is the technical skill on which everything else depends, so we take it slowly. The good news: it is pure bookkeeping, and it always follows the same pattern.
The index is a dummy variable
The letter used for the index does not matter:
Both sums stand for the same list of terms. The index is like the variable of integration in .
Why we need to shift
Suppose . When we substitute into an equation we get sums such as
To add them and use the identity principle we need, in each sum, the same power of in the general term and the same starting value of the index. In the power is ; in it is . Shifting the index fixes this.
The four moves
Let us rewrite so that the general term contains .
- Name the new index. We want the exponent to be the new index, so set
- Solve for the old index. .
- Replace every in the general term (not only in the exponent!):
- Change the limits. The old sum started at , so the new one starts at . When , also .
The result is
Since the index is a dummy, we may now rename back to if we like: .
Do not take this on faith; write out the first terms of both sides and compare:
| Old index | Term | New index | Term |
|---|---|---|---|
Same terms, same order. A shift only relabels the terms; it never changes the sum. A good habit: whenever you shift, check the first term of the old and new sums.
Absorbing a power of x first
Often a sum is multiplied by a power of , as in . First move that power inside the sum, then decide whether a shift is needed:
Here no shift is needed: the power is already . Notice also that the term of would be , so we may let this sum start at without changing it. Adding or removing terms that are zero is a perfectly legal way to line up starting values.
Shifting the other way
If a sum contains , the move is the same with the opposite sign. For : set , so , the general term becomes , and the start becomes :
Memory aid: if the exponent goes down by some amount, the subscript goes up by the same amount, and so does the starting value (and vice versa).
Peeling off terms
After shifting, the sums may start at different values. Write the terms of the sum that starts earlier separately until all sums start at the same index; then combine.
Write as a single power series in :
Solution
- First sum. As shown above, with :
- Second sum. With (so , start ):
- Line up the starting values. The first sum starts at , the second at . Peel off the term of the first sum: it is .
- Combine. Now both remaining sums start at and contain :
- Check. The coefficient of should be (from in the first sum) plus (from in the second). Our formula at gives . Correct.
- Changing the exponent but forgetting the subscript or the factors: must become , not .
- Forgetting to change the lower limit.
- Combining sums that start at different values, which silently drops terms. Always peel off first.
Ordinary points and singular points
We consider the homogeneous linear equation
and its normalized form (divide by , as in Section 4.1)
The point is an ordinary point of the equation if both and are analytic at . Otherwise is a singular point.
In this course the coefficients are almost always polynomials. Then the test is easy: after cancelling any factor common to , the singular points are exactly the zeros of , including complex zeros. Every other point is ordinary.
For example, has singular points ; has no real singular points, but it has the complex singular points , and we will see that they matter.
Let be an ordinary point of , and let be the smaller of the radii of convergence of the Taylor series of and about . Then:
- The equation has two linearly independent solutions of the form , and every solution can be written as ; equivalently, every solution is a power series in which and are arbitrary and all other are determined by them.
- These series converge at least for .
When are polynomials with no common factor, is at least the distance from to the nearest singular point in the complex plane.
A power series in converges inside a disc in the complex plane, not only on an interval. If a singular point sits at distance from anywhere in the plane, the disc of convergence of the solution may not be able to grow past it, and its intersection with the real line is the interval . This is why a function that is perfectly smooth for all real can still have a power series with a finite radius. Example 6.1.4 shows this happening.
Two remarks. First, the theorem gives a lower bound: the actual radius can be larger. Second, if there are no singular points at all (for instance when is a nonzero constant and are polynomials), the series converge for every .
Without solving, find a lower bound for the radius of convergence of power series solutions of
about (a) , (b) , (c) .
Solution
- Singular points. They are the zeros of : There are no real singular points, so every real point is ordinary.
- (a) . The distance from to is ; by symmetry the same holds for . So , and the series converge at least on .
- (b) . Distance from to : . So .
- (c) . Distance from to is , so .
Figure 6.1.1 shows the two discs for (a) and (b). Each disc passes exactly through the singular points; its intersection with the real axis is the guaranteed interval.
The method
Here is the whole procedure. It is long the first time, but every step is mechanical.
- Check that is an ordinary point and find the guaranteed radius (distance to the nearest singular point). If , substitute so that you expand about .
- Write , , and substitute.
- Move every power of from the coefficients inside the sums.
- Shift indices so that every sum has the same power in its general term.
- Peel off terms until all sums start at the same index, then combine into one series.
- Set every coefficient equal to zero (identity principle). This gives a few starting equations and a recurrence relation expressing a later coefficient in terms of earlier ones.
- Use the recurrence to compute coefficients; keep and free (or set them from initial conditions , ). Look for a pattern if you can.
- Write the answer as and state where it converges.
The solver below carries out steps 2 to 7 for with polynomial coefficients and . It shows the recurrence and the first terms of both basic solutions. The first preset is Example 6.1.3 below; the second is the initial-value problem of Example 6.1.4. Change the polynomials and try your own equations, then check your hand computations against it.
Worked examples
Find the general solution of as a power series about . Identify one of the two basic solutions in closed form.
Solution
- Ordinary point. Here and are polynomials, so there are no singular points. Every solution is a power series that converges for all .
- Substitute. With :
- Move the inside. . Its term would be zero, so we may start it at .
- Shift the first sum. With , then renaming as :
- Combine. All three sums now contain and start at :
- Recurrence. Every bracket must vanish. Since , we can cancel the factor :
- Even coefficients. They are tied to : The pattern is . (Indeed, with the recurrence reads .)
- Odd coefficients. They are tied to : so .
- General solution.
- Closed form of . is the exponential series with replaced by , so . A direct check: , , and .
- Convergence. For the ratio of consecutive nonzero terms is , and the same holds for . Both series converge for every , as Theorem 6.1.2 promised.
The second solution is not an elementary function. (It equals , known as Dawson's integral.) The power series is a perfectly good way to define and compute it.
Whenever the recurrence links only to (a two-term recurrence with step 2), the even coefficients depend only on and the odd ones only on . Then contains only even powers and only odd powers. This happens when the equation is unchanged under , as in Example 6.1.3.
Solve by power series about :
Where does the series converge?
Solution
- Guaranteed radius. vanishes at . The distance from to is , so the series converges at least for .
- Substitute and distribute. Splitting :
- Line up. In the first sum the terms with would be zero (because of the factor ), so it may start at ; likewise the third sum may start at . Only the second sum needs a shift ():
- Combine.
- Simplify. . So each bracket is , and the recurrence is
- Initial conditions. and .
- Coefficients. Even: , , , … Odd: , , , … In general
- Sum the series. Put . Differentiating the geometric series gives , and since , With this becomes
- Convergence. Both series in converge exactly when , that is , or . (For their terms do not even tend to zero.) The guaranteed radius of Theorem 6.1.2 is attained.
Here is the surprise: the function is smooth on the whole real line, but its power series about diverges for . The reason is invisible on the real axis: the function blows up at the complex points . Figure 6.1.4 shows the partial sums tearing away from the solution at .
Substituting into gives for every choice of the constants and (a few lines of algebra, or one line of a computer algebra system). So these functions form the general solution, and , matches the initial conditions. Closed forms like this are rare; the series method works whether or not one exists, and here it actually found it for us.
Expanding about a point other than zero
If the initial conditions are given at , the solution should be expanded in powers of ; this is also necessary when is a singular point. The cleanest way is to substitute . Since , derivatives with respect to and are the same, so only the coefficients change.
Find the first six terms of the series solution of
in powers of , and state an interval on which it is guaranteed to converge.
Solution
- Points. vanishes only at , so is the only singular point and is ordinary. The distance from to is : the series converges at least for , i.e. on . (A series in powers of would not work here, because is singular.)
- Shift the variable. Let , so . The problem becomes where primes now mean .
- Substitute :
- Shift each sum to .
- First: gives .
- Second: gives ; its term is zero, so start it at .
- Third: gives .
- Combine. Since :
- Recurrence. This one links three consecutive coefficients:
- Compute. With , :
- Answer. guaranteed to converge for .
With a three-term recurrence there is usually no neat formula for , and that is fine: the recurrence itself is an exact recipe that a computer (or the solver above, applied to ) can run as far as needed. The coefficients do not shrink quickly here, a hint that the radius is only : the singular point is close. In Section 6.2 we will learn how to build solutions right at that singular point.
Theorem 6.1.2 only needs and to be analytic. If, say, , replace it by its Taylor series and multiply the series for and term by term (collect all products that give the same power). The recurrence is then longer, but the computation of the first few coefficients is still straightforward; Exercise 10 is of this type.
Exercises
- Write as a single power series in :
.
Answer
- For , find the singular points and a lower bound for the radius of convergence of power series solutions about and about .
Answer
Singular points ; about , about . - For , find a lower bound for the radius of convergence about and about .
Answer
Singular points . About : . About : . - Find the recurrence relation and two basic power series solutions about of . Show that one of them is a polynomial.
Answer
; (the series stops), ; converge for all . - Solve by power series about (give the terms through ).
Answer
, for ; , valid for all . - Solve about and identify the even solution in closed form.
Answer
; . - Solve about . What is the guaranteed radius of convergence?
Answer
; , . (In fact and .) - Solve the initial-value problem , , (terms through ).
Answer
; - Solve , , , in powers of (terms through ). On which interval is convergence guaranteed?
Answer
; guaranteed on . - Find the terms through of the solution of , , .
Answer