§11 Subsequences
Why this matters
A sequence may wander without converging, yet still contain well-behaved pieces. Subsequences let us pull those pieces out. The payoff is the Bolzano–Weierstrass theorem below, which is the tool behind the existence of maxima and minima of continuous functions in §18.
Suppose is a sequence. A subsequence of it is a sequence where for each there is a positive integer such that
Used in Exercise 11.6
My notes(saved)
So is a selection of some (possibly all) of the ’s, taken in order. Equivalently, (1) picks out an infinite subset of , and every infinite subset of arises this way.
More formally, view as a function on . The function “selects” an infinite subset of in order, and the subsequence is the composite :
So is a subsequence of if and only if for some increasing . We usually suppress and and just say “a subsequence of .”
Common pitfallorder and no repeats
A subsequence keeps terms in their original order and uses each index at most once, because is strict. Rearranging as does not give a subsequence, and neither does repeating a term as in .
Let , so . Its positive terms form the subsequence , with , , and selection function .
Let . Then and its subsequence of nonnegative terms is , with We don’t need a formula, but one is , where is the largest integer .
The next theorem will seem obvious after some reflection, but it is good to have one careful proof that we can apply several times rather than repeat. (The first edition did repeat it.)
Let be a sequence.
In each case the subsequence can be taken to be monotonic.
Used in Theorem 11.7, Theorem 11.9, Exercise 11.7, Exercise 14.12
My notes(saved)
Proof
The forward implications are easy: for example, if and , then all but finitely many lie in . We prove the converses.
(i) If is infinite, there is a subsequence with for all , which is a boring monotone sequence converging to . So assume is finite. Then is infinite for all . These sets are unions that shrink as , so
or
otherwise both sets would be finite for small . Assume (1); case (2) is similar. We construct step by step a subsequence with and
Such a subsequence is increasing, and gives (compare Exercise 8.5(a)).
Select with , possible by (1). Having chosen satisfying (3), apply (1) with : infinitely many have in that range, so we can choose satisfying (3). This “definition by induction” produces the whole subsequence.
(ii) Let . Given , select with . This is possible because is unbounded above, and only finitely many terms come before . The result is monotone with limit . (iii) is similar.
∎Intuitionlimits versus subsequential limits
Compare the two conditions on the interval :
- is the limit when, for every , the interval contains the terms for all but finitely many ;
- is a subsequential limit when, for every , it contains for infinitely many (Theorem 11.2(i)).
So a subsequential limit is a place that the sequence keeps coming back to, though it may leave in between.
The rational numbers can be listed as a sequence . One way: arrange in an array and sweep through it diagonally, allowing repetitions. (Readers who know some set theory will recognize “ is countable.”) This sequence has an amazing property: every real number is the limit of some subsequence of . Indeed every interval contains infinitely many rationals (Exercise 4.11), so Theorem 11.2 applies.
Here is the diagonal sweep, step by step:
Suppose for all and . Then need not converge or even be bounded, but it has a subsequence converging monotonically to . By Theorem 11.2 it suffices that is infinite for each . If it were finite for some , then either it is empty, so , or . Either way we contradict .
The next theorem is almost obvious.
If converges, then every subsequence converges to the same limit.
Used in Theorem 12.1, Theorem 13.5, Theorem 18.1
My notes(saved)
Proof
First, for all : , and implies , so . Let and . Choose with for . Then implies , so .
∎Intuitiona quick test for divergence
Read Theorem 11.3 backward: if two subsequences have different limits, the sequence cannot converge. This is often the fastest proof of divergence. For , the subsequence is constantly and is constantly . The converse direction is where people slip: one convergent subsequence says nothing about the whole sequence. has a constant subsequence and still diverges.
Our immediate goal is the Bolzano–Weierstrass theorem: every bounded sequence has a convergent subsequence. First, monotone subsequences.
Every sequence has a monotonic subsequence.
Used in Theorem 11.5, Exercise 17.11
My notes(saved)
Proof
Call the -th term dominant if it is greater than every term that follows it:
Case 1: there are infinitely many dominant terms. Any subsequence consisting of dominant terms is decreasing by (1).
Case 2: there are only finitely many dominant terms. Select beyond all of them. Then
since is not dominant. Apply (2) with to get with ; then with to get ; and so on. By induction we obtain an increasing subsequence.
∎This elegant proof comes from D. J. Newman’s book A Problem Seminar.
Every bounded sequence has a convergent subsequence.
Used in Theorem 13.5, §18, Theorem 18.1
My notes(saved)
Proof
A bounded sequence has a monotonic subsequence by Theorem 11.4, and that subsequence converges by Theorem 10.2.
∎The Bolzano–Weierstrass theorem is very important and is used at critical points in Chapter 3. Our proof is a bit nonstandard. Convergence, Cauchy sequences and boundedness all make sense for sequences in the plane, but monotonicity does not. Bolzano–Weierstrass still holds there (Theorem 13.5), so in applications we emphasize 11.5 rather than 11.4.
Intuitiona second proof, by halving
Here is another standard proof of Bolzano–Weierstrass. Its pattern of repeated halving returns in the compactness arguments of §13. Suppose every lies in . Cut the interval in half. At least one half contains for infinitely many ; keep that half. Cut it in half again and keep a half that still contains infinitely many terms, and so on. The kept intervals are nested and their lengths shrink to , so by the nested interval property (§4) they close in on a single point . Choose with in the th interval; this is possible because each interval contains infinitely many terms. Then , so . Unlike Theorem 11.4, this proof carries over to : there you cut a box into smaller boxes instead, exactly as in the proof of Proposition 13.13.
Subsequential limits
Section titled “Subsequential limits”Let be a sequence in . A subsequential limit is any real number, or symbol or , that is the limit of some subsequence of .
My notes(saved)
If has a limit , then is the set of subsequential limits. The interesting case is when has no limit.
The sequence is bounded but looks erratic, with no obvious pattern. Does it have a convergent subsequence?
Yes. Every bounded sequence has a convergent subsequence, by the Bolzano–Weierstrass theorem. The theorem promises that one exists without telling you how to pick the indices.
Try it: pick a subsequence
Section titled “Try it: pick a subsequence”Choose a sequence and a selection rule . The highlighted points are . Try with and , or , where no simple rule finds a convergent subsequence even though Bolzano–Weierstrass guarantees one.
Choose your own terms
Section titled “Choose your own terms”Now pick the yourself. Select any increasing list of indices and see whether the chosen terms settle toward one of the subsequential limits. The red and blue lines are and , the largest and smallest subsequential limits (§12).
For , the even terms diverge to and the odd terms to . Every subsequence that has a limit diverges to , so is the set of subsequential limits.
takes each of the values , , infinitely often. The only convergent subsequences are eventually constant, so is the set of subsequential limits. For instance, gives the constant , gives , and gives .
If lists all rationals, every real number is a subsequential limit (Example 3), and so are (Exercise 11.7). So the set of subsequential limits is .
Let , so for even and for odd . The set of subsequential limits is .
Now the connection with and .
Let be any sequence. There is a monotonic subsequence whose limit is , and a monotonic subsequence whose limit is .
Used in Theorem 11.8, Theorem 12.1, Theorem 14.9, Exercise 14.12
My notes(saved)
Proof
If is unbounded above, Theorem 11.2(ii) gives a monotone subsequence with limit . Similarly for unbounded below and .
Otherwise, consider the case that is bounded above (the other is similar), so is finite. Let . There is with for ; in particular for . We claim
Otherwise there is with for . Then for , so , a contradiction. Since (1) holds for every , Theorem 11.2(i) gives a monotone subsequence converging to .
∎Let be any sequence in and let be its set of subsequential limits.
- is nonempty.
- and .
- exists if and only if has exactly one element, namely .
My notes(saved)
Proof
(i) follows from Theorem 11.7.
(ii) Let be the limit of a subsequence . By Theorem 10.7, . Since , for each , so
This holds for all , so . By Theorem 11.7, and belong to , so (ii) holds.
(iii) is a reformulation of Theorem 10.7.
∎So is exactly the largest subsequential limit and the smallest. That makes them easy to compute.
If , then , so and .
If , then , so and .
If lists all rationals, then and .
If , then and .
The set of subsequential limits always contains the limits of its own convergent sequences. Such sets are called closed and are studied further in §13.
Let be the set of subsequential limits of . If is a sequence in and , then .
Used in Exercise 11.9
My notes(saved)
Proof
Suppose is finite and let . Some lies in . Let , so . Since is a subsequential limit, is infinite, hence so is . By Theorem 11.2(i), .
If , then is unbounded above, so by Theorem 11.2(ii). Similarly for .
∎Reading alongside Abbott
Abbott’s Section 2.5 proves Bolzano–Weierstrass by the halving argument above, using the nested interval property. Ross’s proof through dominant terms (Theorem 11.4) gives something stronger on the line, a monotone subsequence, but it does not carry over to , which is why Ross gives a separate argument in Theorem 13.5. Subsequential limits as a set (Theorems 11.7–11.9) get much more attention here than in Abbott, and they lead into §12.
Check your understanding
Section titled “Check your understanding”Take the quiz (3 questions)
Which of these is a subsequence of ?
Definition 11.1 needs strictly increasing indices . The other two repeat or reverse indices.
What is the set of subsequential limits of ?
The even terms tend to and the odd terms to . Any subsequence has infinitely many even or infinitely many odd terms, so these are the only limits.
Which sequence must have a convergent subsequence?
is bounded by , so the Bolzano–Weierstrass Theorem 11.5 applies. Every subsequence of the other two is unbounded.
Exercises
Section titled “Exercises”Let for .
- List the first eight terms of .
- Give a subsequence that is constant (takes a single value). Specify the selection function .
Solution
(a) . (b) gives the constant subsequence ; gives
My attempt(saved)
Consider , , , .
- For each sequence, give an example of a monotone subsequence.
- For each sequence, give its set of subsequential limits.
- For each sequence, give its lim sup and lim inf.
- Which of the sequences converges? diverges to ? diverges to ?
- Which of the sequences is bounded?
Solution
(b) , , , . (c) : ; : ; : ; : . (d) and converge; diverges to ; none diverges to . (e) , , .
Used in Exercise 11.3, Exercise 11.4
My attempt(saved)
Repeat Exercise 11.2 for , , , .
Solution
Subsequential limits: , , , . lim sup / lim inf: , , , . and converge to ; all four are bounded.
My attempt(saved)
Repeat Exercise 11.2 for , , , .
Solution
Subsequential limits: , , , . lim sup / lim inf: , , , . None converges or diverges to ; and are bounded.
My attempt(saved)
Let be an enumeration of all the rationals in the interval .
- Give the set of subsequential limits for .
- Give the values of and .
Solution
(a) . (b) and .
My attempt(saved)
Show every subsequence of a subsequence of a given sequence is itself a subsequence of the given sequence.
Hint
Define subsequences as in (3) of Definition 11.1: , and a composition of increasing maps is increasing.
Solution
A subsequence of is a composite with strictly increasing. A subsequence of that is with strictly increasing. Now is strictly increasing: gives , and then . So is a subsequence of .
My attempt(saved)
Let be an enumeration of the set of all rational numbers. Show there exists a subsequence such that .
Hint
is unbounded above. Apply Theorem 11.2(ii).
Solution
Every real number is exceeded by some rational number, and lists every rational, so for some . Hence is unbounded above, and Theorem 11.2(ii) gives a subsequence with .
My attempt(saved)
Use Definition 10.6 and Exercise 5.4 to prove for every sequence . (This exercise is referred to in several places.)
Solution
For each , apply Exercise 5.4 to the set : , and . So Let . The left side tends to (Definition 10.6). The right side is the negative of a sequence tending to , so it tends to (Theorem 9.2 with , or Exercise 9.10(b) in the infinite cases). Hence .
Used in §12, Exercise 12.5, Exercise 12.6
My attempt(saved)
- Show the closed interval is a closed set.
- Is there a sequence such that is its set of subsequential limits?
Solution
(a) If and , then by Exercise 8.9(c). (b) No: by Theorem 11.9 the set of subsequential limits is closed, but converges to .
My attempt(saved)
Form an infinite array whose every row is , and let list its entries by zig-zagging along the diagonals (the book’s Figure 11.2).
- Find the set of subsequential limits of .
- Determine and .
Solution
(a) Each occurs infinitely often, so . (b) and .
My attempt(saved)
Let be a bounded set. Prove there is an increasing sequence of points in with . Compare Exercise 10.7. (If , it suffices to let for all .)
Solution
Let . If , take for all . Otherwise, choose with . Given , we have , so and there is larger than this maximum. Then is increasing, and for all , so .
Used in Exercise 10.7, Exercise 13.13