Upload
rambori
View
217
Download
0
Embed Size (px)
Citation preview
8/12/2019 mathAnalysis2-13
1/8
ARE211, Fall2013
ANALYSIS2: TUE, SEP 3, 2013 PRINTED: SEPTEMBER 3, 2013 (LEC# 2)
Contents
1. Analysis (cont) 1
1.4. Convergence of Sequences 1
1.4.1. Boundedness of Sequences 3
1.4.2. Boundedness of Sequences (cont) 5
1.5. Least Upper bounds and Greatest Lower Bounds, Suprema and Infima 6
1. Analysis (cont)
1.4. Convergence of Sequences
Last lecture I introduced a number of metrics, the d1, d2 and d metrics. An important property
of these metrics is that they are all the same, in a sense that will be clearer in a minute. In this
lecture, Ill refer to theEuclidean metric. In fact there are lots of Euclidean metrics, but they
are all equivalent to each other.
I emphasized in the previous lecture that the mathematical topic of analysis is all about what it
means for things to be close to each other. For this reason, a core concept of analysis is the
notion ofconvergence.
Definition: We say that a sequence {xn} in X converges to an element x X in the metric d if
>0 N N such that n > N,d(xn, x)< .1
8/12/2019 mathAnalysis2-13
2/8
2 ANALYSIS2: TUE, SEP 3, 2013 PRINTED: SEPTEMBER 3, 2013 (LEC# 2)
Definition:Two metrics d and on Xare said to be equivalent if a sequence {xn} in X converges
to an element x X in the metric d iff{xn} in Xconvergesto an element x X in the metric .
As an exercise you should try to prove that for any r, q N, the two metrics on Rn defined by
dr(x, y) = (n
i=1(xiyi)r)1/r and dq(x, y) = (
ni=1(xi yi)
q)1/q are equivalent.
A sequence that converges to a point is called a convergentsequence. The point that it converges
to is called a limitof the sequence. (Its also the limit of the sequence, i.e., theres only one, but
thats a result not a definition.)
Example:The sequence {xn} in R defined by xn = 1/nconverges to zero in the Euclidean metric,
but not in the discrete metric.
Proof:We need to show that for all , there exists Nsuch that for all n > N,d(xn, 0)< . Now in
the Euclidean metric,d(xn, 0) =
(xn 0)2 =|xn|, i.e., we just need to show that for n sufficiently
large,|xn|< . Pick1 N=1/. Then 1/N < and for n > N, 1/n < 1/N.
On the other hand, consider the discrete metric. To show thatxn doesntconverge to zero, we need
to show that there exists >0 such that for all N, there existsn > Nsuch thatddiscrete(xn, 0)> .
Pick = 1/2. LetNbe arbitrary and observe that ddiscrete(xN+1, 0) = 1> . Done.
Note that what we did here was an example of a general proof technique: to prove that an assertion
involving s and s is false, go through and change the s to and the s to . Then for
all inequalities not linked to a or , flip the inequality. So for example, in the definition of
convergence ( >0 N N such that n > N,d(xn, x)< ), the only inequality that gets flipped
is d(xn, x)< , which gets flipped to d(xn, x) .
1 Given R, is the smallest integer not less than . Similarly, is the largest integer not larger than .
8/12/2019 mathAnalysis2-13
3/8
ARE211, Fall2013 3
Theorem: A sequence {xn} converges to R in the discrete metric if and only if there exists N
such that for all n > N, xn = .
1.4.1. Boundedness of Sequences.
Definition: A sequence {xn} is bounded above by b R if xn b, for all n N. A sequence is
bounded above if it is bounded above by someb R. Defn of bounded below is parallel.
Similarly, a setX is bounded abovebyb R ifx b, for all x X.
Example:The sequence {xn} defined by xn = (1)n is bounded above by 1 and below by -1. (Its
bounded above by lots of other things too, e.g, 2, , etc, and similarly bounded below by lots of
other things. The point is that in order to be bounded above, a sequence just has to be bounded
above bysomething).
The Axiom of Completeness: Every non-decreasing
non-increasing sequence {xn} in R that is bounded above
below
converges to a point x R in the Euclidean metric. (Not a theorem! Cant prove it. Have to
assume it.)
Intuition for these is straightforward: take the latter statement; you have an infinite number of
points that keep declining, or at least doesnt increase; but theres a floor to the decline: the points
have to accumulate, because theres nowhere else for them to go.
The Axiom is a very special property that depends both on the set R and the Euclidean metric.
To see that it is violated for general sets, consider the set of rationals, denoted Q, which consists
of all ratios of integers. If you replaced R by Q in the above statement, it would obviously be
false: consider a non-increasing sequence of rational numbers which, when viewed as real numbers,
converges to the non-rational number . (An example of such a sequence is given below.) Since
its non-increasing, its bounded below by . But if you replaced the symbol R everywhere by Q
8/12/2019 mathAnalysis2-13
4/8
4 ANALYSIS2: TUE, SEP 3, 2013 PRINTED: SEPTEMBER 3, 2013 (LEC# 2)
in the statement of the Axiom above, it would clearly be nonsense. Similarly, the Axiom would be
equally nonsensical if the words Euclidean metric were replaced by discrete metric.
The above highlights a special property of the real numbers, which is that they are complete, i.e.,
have no holes in them. (Again, this is an assumption, it is not a result that can be proved by
invoking other properties of the real line.)
Example:Consider the following sequence{xn}, wherexn= (1)n
2n1, so that{xn}= {1,1
3 ,15 ,
17 ,
19 ,...}.
Now define the new sequence {Xn} by: Xn = 4n
k=1 xn. The subsequence {Yn} obtained
by taking the odd-numbered elements of {Xn}, is strictly decreasing. (I.e., Y1 = X1 = 4;
Y2 = X3 = 4(1 1/3 + 1/5), Y3 = Y2 + 4(1/7 + 1/9). Also, note that the entire sequence
lives in the set ofrationals, denoted by Q, which consists of all ratios of integers. Now viewed as a
sequence living in R, the sequence{Yn}converges (believe it or not) to. But viewed as a sequence
living in Q, it is a non-convergent sequence, since its limitif it had onecan only be , but
/ Q.
The three sequences are illustrated in Fig. 1.
To see that the Axiom of Completeness is in fact a highly non-trivial assumption, consider the set
of continuous functionsC0 ={f : [0, 1] R}. Intuitively, its fairly obvious what a non-decreasing
sequence in C0 would look like. For example, heres one: the sequence of continuous functions
{f1, f2,...fn...}, where fn(x) =
nx if 0 x
8/12/2019 mathAnalysis2-13
5/8
ARE211, Fall2013 5
0 2 4 6 8 10 12 14 16 18 20
0
pi
n
x,X,Y
A nonincreasing NPR sequence of rationals that converges to an irrational
x(n) = 1/(2*n1)*(1)n
X(n) = sum(x(1:n))
Y(n)=X(2*n1)
Figure 1. Math courtesy of NPR
1.4.2. Boundedness of Sequences (cont). The following questions came up in class in past years.
Question: Given a sequence {xn}, suppose that |xn+1 xn| converges to zero. Can we conclude
that the sequence is bounded?
Answer: No. Consider the sequence{xn} defined by xn = nk=11/k. Observe that difference be-
tweenxn+1andxn is 1/(n+ 1). However, the sequence {1/xn}, i.e.,{n
k=11/k}doesnt converge.
(This fact is isnt at all obvious (see Berck and Sydsaeter, 7.10 for verification that it is indeed
true).)
Question:Can a sequence converge to different things in different metrics?
8/12/2019 mathAnalysis2-13
6/8
6 ANALYSIS2: TUE, SEP 3, 2013 PRINTED: SEPTEMBER 3, 2013 (LEC# 2)
Answer:Not if the sequence belongs to a finite dimensional space, i.e., Rn, and if the metrics you are
comparing are both Euclidean but more generally yes. For sequences in Rn, all Euclidean metrics
are equivalent in the sense that if a sequence in Rn converges in two distinct metrics, then it
converges to the same point in both metrics. In infinite dimensional spaces, however, sequences
canconverge to different things in different metrics. (Well learn the precise meaning of infinite
dimensional in Linear algebra.) Consider the example of a sequence ofcontinuous functionsthat
we examined in the last lecture, {f1, f2,...fn...}, wherefn=
1 ifx 1/n
nx if 1/n < x 0
or g=
1 ifx
8/12/2019 mathAnalysis2-13
7/8
ARE211, Fall2013 7
Analogously, we have greatest lower boundof a set, which is almost the minimum, the point that
would be the minimum if the set had a minimum. In the above example, {1 12 ,..., 11/n,...},
the greatest lower bound of the set is 1/2, which is also the minimum of the set. More generally,
the greatest lower bound of the interval (x,x) R is x.
Naturally if a set does indeed have a maximum then the least upper bound of the set is that
maximum, e.g., the greatest lower bound and the least upper bound of the set [ x,x] are xand x.
Definition:Let S R. A number b Ris a lower bound forS ifs b, for all s S. A number b is
a greatest lower bound forS ifb is a lower bound for Sand ifb b, for any lower bound b ofS.
If a set has a least upper bound, it is also called the supremumof the set. Similarly, if a set has
a greatest lower bound, it is also called the infimumof the set. Some nonempty sets, however,
dont have a least upper bound (e.g., R,N). In this case, we say that the supremum of the set is
. Similarly, if a nonempty set doesnt have a greatest lower b ound, we say that its infimum is
. The empty set is special, an exception to many rules: its supremum defined to be and
its infimum is defined to be .
Notation: sup(S) and inf(S) denote, respectively, the supremum and infimum of the set S.
A critical property of the real line R is:
Theorem: Every nonempty set S R that has an upper bound has a least upper bound. Every
nonempty set S R that has an lower bound has a greatest lower bound in R.
Again, the above statement would not be true ifR were replaced by Q. Consider the subsequence
{Yn} defined above on 4. This set belongs to Q. As we saw, it converges to, but / Q. It has
lots of upper bounds, indeed, any rational greater than is an upper bound for this set. But it
8/12/2019 mathAnalysis2-13
8/8
8 ANALYSIS2: TUE, SEP 3, 2013 PRINTED: SEPTEMBER 3, 2013 (LEC# 2)
doesnt have a least upper bound in Q: cant be an upper bound because its not in Q; and for
any rationalqgreater than , theres another one thats between and q.
Note the difference between this theorem and the Axiom of Completeness. The latter was about
sequences, this is about sets. It is, however, another way of saying that the real line doesnt have
any holes in it. It is, clearly, very closely related to the Axiom of Completeness. In fact, we could
have made this the axiom and then turned the Axiom of Completeness into a theorem.