45
General Probability Theory Information and Conditioning Change of Measure MFE6516 Stochastic Calculus for Finance William C. H. Leon Nanyang Business School December 11, 2017 1 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance General Probability Theory Information and Conditioning Change of Measure 1 General Probability Theory Probability Space Random Variables & Distributions Expectations 2 Information and Conditioning Conditional Probability Conditional Expectation Martingales 3 Change of Measure Radon-Nikod´ ym Derivative Expectation 2 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

MFE6516 Stochastic Calculus for Finance - NTU€¦ · GeneralProbabilityTheory InformationandConditioning ChangeofMeasure MFE6516StochasticCalculusforFinance WilliamC.H.Leon NanyangBusinessSchool

  • Upload
    others

  • View
    1

  • Download
    0

Embed Size (px)

Citation preview

General Probability TheoryInformation and Conditioning

Change of Measure

MFE6516 Stochastic Calculus for Finance

William C. H. Leon

Nanyang Business School

December 11, 2017

1 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

1 General Probability TheoryProbability SpaceRandom Variables & DistributionsExpectations

2 Information and ConditioningConditional ProbabilityConditional ExpectationMartingales

3 Change of MeasureRadon-Nikodym DerivativeExpectation

2 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Probability SpaceRandom Variables & DistributionsExpectations

The Triplet

The axiomatic approach to probability theory is based on a probability

space denoted by a triplet

(Ω,F ,P).

Set Collect of Set Measure

3 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Probability SpaceRandom Variables & DistributionsExpectations

Sample Space

A sample space Ω is the set of all possible outcomes of an experiment.

Example. Consider tossing a coin 2 times in a row.

4 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Probability SpaceRandom Variables & DistributionsExpectations

Example

Tossing a coin 2 times in a row produces

Toss Coin ����

����

Head ����

����

Tail����

����

Tail,Tail

Tail,Head

Head,Tail

Head,Head

Sample Space Ω = {TT ,TH,HT ,HH}.

5 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Probability SpaceRandom Variables & DistributionsExpectations

Event

An event A is a set of outcomes, i.e. A ⊂ Ω.

Example. Consider tossing a coin 2 times in a row.

6 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Probability SpaceRandom Variables & DistributionsExpectations

Example

Tossing a coin 2 times in a row.

Sample Space Ω = {TT ,TH,HT ,HH}.

A1 = {TT} is the event that two tail turn up.

A2 = {TH} is the event that a tail turns up before a head turns up.

A3 = {TH,HT} is the event that exactly one head turns up.

A4 = {TT ,HH} is the event that two of a kind turn up.

7 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Probability SpaceRandom Variables & DistributionsExpectations

Sigma Algebra

A collection F of subsets of Ω is called a σ-algebra if it satisfies thefollowing conditions:

1 ∅ ∈ F ;

2 if A ∈ F then Ac ∈ F .

3 if A1,A2, ... ∈ F , then⋃∞

i=1 Ai ∈ F ;

Example. Consider tossing a coin 2 times in a row.

8 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Probability SpaceRandom Variables & DistributionsExpectations

Example

Tossing a coin 2 times in a row.

Sample Space Ω = {TT ,TH,HT ,HH}.

F0 ={∅,Ω

}.

G ={∅, {TT ,HH}, {TH,HT},Ω

}.

F∗ ={∅, {TT}, {TH}, {HT}, {HH}, {TT ,TH}, {TT ,HT},{TT ,HH}, {TH,HT}, {TH,HH}, {HT ,HH}, {TT ,TH,HT},{TT ,TH,HH}, {TT ,HT ,HH}, {TH,HT ,HH},Ω

}.

9 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Probability SpaceRandom Variables & DistributionsExpectations

Sub-Sigma Algebra

A σ-algebra G is a sub-σ-algebra of another σ-algebra F if it is containedin F , i.e. G ⊂ F .

Example. Consider tossing a coin 2 times in a row.

10 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Probability SpaceRandom Variables & DistributionsExpectations

Example

Tossing a coin 2 times in a row.

Sample Space Ω = {TT ,TH,HT ,HH}.

G ={∅, {TT ,HH}, {TH,HT},Ω

}⊂ F∗

where F∗ is the σ-algebra generated by all possible subsets of Ω, i.e. thepower set of Ω.

11 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Probability SpaceRandom Variables & DistributionsExpectations

Probability Measure

A probability measure P on (Ω,F) is a function P : F → [0, 1] such that

1 P (Ω) = 1;

2 if A1,A2, . . . is a collection of disjoint members of F , then

P

(∞⋃i=1

Ai

)=

∞∑i=1

P (Ai ) .

12 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Probability SpaceRandom Variables & DistributionsExpectations

Probability Space

The triplet (Ω,F ,P) is a probability space.

Example. Consider tossing a coin 2 times in a row.

Sample Space Ω = {TT ,TH,HT ,HH}.

σ-Algebra F∗ = σ({

{TT}, {TH}, {HT}, {HH}})

.

13 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Probability SpaceRandom Variables & DistributionsExpectations

Exercise

Consider (Ω,F∗). Let p be such that 0 ≤ p ≤ 1. Define

P (A) =

⎧⎪⎨⎪⎩(1− p)2 if A = {TT},p(1− p) if A = {TH} or {HT},p2 if A = {HH}.

Observe that if P is defined for all blocks of the partition that generatesF∗, we can then extend the definition of P to all members of F∗ usingproperty (2) of the definition of a probability measure.

Verify that P is a probability measure on (Ω,F∗).

14 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Probability SpaceRandom Variables & DistributionsExpectations

Definition of Random Variable

Let (Ω,F ,P) be a probability space.

A random variable (r.v.) is a function X : Ω → R such that

X−1(B) = {X ∈ B} = {ω ∈ Ω : X (ω) ∈ B} ∈ F

for every Borel subset B of R.

Ω

X−1((−∞, x])

X

R

x

15 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Probability SpaceRandom Variables & DistributionsExpectations

Measurable Functions

In measure theory, we say that the function X is F-measurable ifX−1(B) ∈ F for every B ∈ B(R).

Note. In the above definition, only the pre-images of X must be in Fand it is not necessary that X is defined for all members of F .

16 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Probability SpaceRandom Variables & DistributionsExpectations

Distribution Functions

The distribution function of a r.v. is the function FX : R → [0, 1] given by

FX (x) = P (X ≤ x) = P ({ω ∈ Ω : X (ω) ≤ x}) .

A distribution function F has the following properties:

1 limx→−∞ F (x) = 0 and limx→∞ F (x) = 1,

2 if x < y then F (x) ≤ F (y),

3 F is right-continuous.

17 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Probability SpaceRandom Variables & DistributionsExpectations

Example

Consider tossing a coin 2 times in a row.

Sample Space Ω = {TT ,TH,HT ,HH}.

σ-Algebra F∗ = σ({

{TT}, {TH}, {HT}, {HH}})

.

Probability P (A) =

⎧⎪⎨⎪⎩(1− p)2 if A = {TT},p(1− p) if A = {TH} or {HT},p2 if A = {HH},

where 0 ≤ p ≤ 1.

18 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Probability SpaceRandom Variables & DistributionsExpectations

Example

Consider (Ω,F∗,P) and the r.v.

X (A) =

⎧⎪⎨⎪⎩0 if A = {TT},1 if A = {TH} or {HT},2 if A = {HH}.

The distribution function of X is

FX (x) =

⎧⎪⎪⎪⎨⎪⎪⎪⎩0 if x < 0,

(1− p)2 if 0 ≤ x < 1,

1− p2 if 1 ≤ x < 2,

1 if x ≥ 2.

19 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Probability SpaceRandom Variables & DistributionsExpectations

Probability Density Functions

The distribution function of a continuous r.v. X can be expressed as

FX (x) =

∫ x

−∞

fX (u) du

for x ∈ R and for some integrable function fX : R → [0,∞).

The function fX is called the probability density function of X .

From the Fundamental Theorem of Calculus,

fX (x) =dFX (x)

dx.

20 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Probability SpaceRandom Variables & DistributionsExpectations

Normal Distribution

Selecting a real number.

Ω = (−∞,∞);

X ∈ R;

fX (x) =1√2πσ

e− 1

2 (x−μ

σ)2

for x ∈ R.

We denote X ∼ N (μ, σ2).

Note. Affine transformation of X ∼ N (μ, σ2) is also normally distributedand aX + b ∼ N (aμ+ b, a2σ2).

21 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Probability SpaceRandom Variables & DistributionsExpectations

Independent Events

Events A1 and A2 are independent if

P (A1 ∩ A2) = P (A1)P (A2) .

More generally, a family {Ai : i ∈ I} is independent if

P

(⋂i∈J

Ai

)=

∏i∈J

P (Ai )

for any finite J ⊂ I.

22 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Probability SpaceRandom Variables & DistributionsExpectations

Independent Random Variables

Two r.v. X and Y are independent if

P ({X ≤ x} ∩ {Y ≤ y}) = P (X ≤ x)P (Y ≤ y) .

Note. Independence implies pairwise independence; whereas, theconverse relationship is not necessarily true.

23 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Probability SpaceRandom Variables & DistributionsExpectations

Almost Surely Equal

Two r.v. X and Y are almost surely equal, denoted by X = Y a.s., if

P ({ω ∈ Ω : X (ω) �= Y (ω)}) = 0.

Equivalently,P ({ω ∈ Ω : X (ω) = Y (ω)}) = 1.

24 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Probability SpaceRandom Variables & DistributionsExpectations

Example

Consider a probability space (Ω,F ,P) where Ω = [0, 1], F is the Borelsigma-algebra and P the Lebesgue measure.

Define a r.v. X such that X (ω) = ω, and a r.v. Y such that

Y (ω) =

{ω if ω �= 1

2 ,

2 if ω = 12 .

ThenP ({ω ∈ Ω : X (ω) �= Y (ω)}) = P

({12

})= 0.

25 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Probability SpaceRandom Variables & DistributionsExpectations

Expectations

The expectation or expected value of a function g of a r.v. X is

E (g(X )) =

∫Ω

g(X (ω)) dP (ω) =

∫ ∞

−∞

g(x) dFX (x).

For discrete r.v. X ,

E (g(X )) =∑x

g(x)px =∑x

g(x)fX (x).

For continuous r.v. X ,

E (g(X )) =

∫ ∞

−∞

g(x)fX (x) dx .

26 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Probability SpaceRandom Variables & DistributionsExpectations

Results

Let X and Y be r.v., a and b be constants, and f and g be real-valuedfunctions. Then

1 E (aX + b) = aE (X ) + b,

2 E (X + Y ) = E (X ) + E (Y ),

3 E (f (X )g(Y )) = E (f (X )) E (g(Y )) if X and Y are independent.

Jensen’s Inequality. Let X be a r.v. and f be a real-values convexfunction. Then

E (f (X )) ≥ f(E (X )

).

27 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Probability SpaceRandom Variables & DistributionsExpectations

Mean & Variance

The mean μX of a r.v. X is

μX = E (X ) .

The variance σ2X of a r.v. X is

σ2X = Var (X ) = E

((X − μX )

2)= E

(X 2

)− μ2X .

28 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Probability SpaceRandom Variables & DistributionsExpectations

Exercise

Suppose X ∼ N (μ, σ2).

Show thatE (X ) = μ

andVar (X ) = σ2.

29 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Probability SpaceRandom Variables & DistributionsExpectations

Answer

30 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Probability SpaceRandom Variables & DistributionsExpectations

Covariance

The covariance Cov (X ,Y ) of two r.v. X and Y is

Cov (X ,Y ) = E ((X − μX )(Y − μY )) = E (XY )− μXμY .

Result. If two r.v. X and Y are independent, then

Cov (X ,Y ) = 0.

32 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Probability SpaceRandom Variables & DistributionsExpectations

Correlation

The correlation coefficient ρ(X ,Y ) of two r.v. X and Y is

ρ(X ,Y ) =Cov (X ,Y )√

Var (X ) Var (Y ).

Result. If two r.v. X and Y are independent, then

ρ(X ,Y ) = 0.

33 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Probability SpaceRandom Variables & DistributionsExpectations

Multivariate Random Variables

Given a probability space (Ω,F ,P).

A multivariate random variable is a function X : Ω → Rd with theproperty that {ω ∈ Ω : X (ω) ∈ A} ∈ F for each Borel set A ⊂ Rd .

34 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Probability SpaceRandom Variables & DistributionsExpectations

Joint Distribution Function

The joint distribution function of a multivariate r.v.X = (X1,X2, . . . ,Xd )

� is the function F : Rd → [0, 1] given by

FX (x) = FX1,X2,...,Xd(x1, x2, . . . , xd )

= P ({X1 ≤ x1} ∩ {X2 ≤ x2} ∩ · · · ∩ {Xd ≤ xd}) .

35 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Probability SpaceRandom Variables & DistributionsExpectations

Joint Density Function

The distribution function of a continuous multivariate r.v.X = (X1,X2, . . . ,Xd )

� can be expressed as

FX (x) = FX1,X2,...,Xd(x1, x2, . . . , xd )

=

∫ x1

−∞

∫ x2

−∞

· · ·∫ xd

−∞

fX1,X2,...,Xd(u1, u2, . . . , ud ) dud . . . du2 du1.

The joint density function of X is given by

fX1,X2,...,Xd(x1, x2, . . . , xd ) =

∂d

∂x1∂x2 · · · ∂xd FX1,X2,...,Xd(x1, x2, . . . , xd ).

36 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Probability SpaceRandom Variables & DistributionsExpectations

Marginal Density Function

For a continuous multivariate r.v. X = (X1,X2, . . . ,Xd )�, the marginal

density function of its component Xi is

fXi(xi ) =∫ ∞

−∞

· · ·∫ ∞

−∞

fX (u1, . . . , ui−1, xi , ui+1, . . . , ud ) dud . . . dui−1dui+1 . . . du1.

37 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Probability SpaceRandom Variables & DistributionsExpectations

Expectation

The expectation of a function g : Rd → R of a multivariate r.v.X = (X1,X2, . . . ,Xd )

� is

E (g(X )) =

∫ ∞

−∞

· · ·∫ ∞

−∞

g(u1, . . . , ud ) dFX (u1, . . . , ud ).

The expectation of a multivariate function g : Rd → Rk , whereg = (g1, g2, . . . , gk)

�, of a multivariate r.v. X is

E (g(X )) =(E (g1(X )) , E (g2(X )) , . . . , E (gk(X ))

)�.

38 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Probability SpaceRandom Variables & DistributionsExpectations

Mean

The mean μX of a multivariate r.v. X = (X1,X2, . . . ,Xd )� is

μX = E (X ) =

⎛⎜⎜⎜⎝μX1

μX2

...μXd

⎞⎟⎟⎟⎠where μXi

= E (Xi ) for i = 1, 2, . . . , d .

39 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Probability SpaceRandom Variables & DistributionsExpectations

Variance

The variance ΣX of a multivariate r.v. X = (X1,X2, . . . ,Xd )� is

ΣX = Var (X )

= E((X − μX )(X − μX )

�)= E

(XX�

)− μXμ�X

= E(((Xi − μXi

)(Xj − μXj)))

=(Cov (Xi ,Xj)

).

40 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Probability SpaceRandom Variables & DistributionsExpectations

Multivariate Normal Distribution

A multivariate r.v. X = (X1,X2, . . . ,Xn)� is said to be normally

distributed if

fX (x) =1√

(2π)n det(Σ)e− 1

2 (x−μ)�Σ−1(x−μ)

where μ is a n × 1 column vector and Σ is a n × n symmetric positivedefinite square matrix.

We denote X ∼ MVN (μ,Σ).

41 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Probability SpaceRandom Variables & DistributionsExpectations

Suppose X = (X1,X2, . . . ,Xn)� ∼ MVN (μ,Σ). Then

E (X ) = (E (X1) , E (X2) , . . . , E (Xn))� = μ;

Var (X ) =(Cov (Xi ,Xj)

)= Σ.

In addition,

fXi(xi ) =

∫ ∞

−∞

· · ·∫ ∞

−∞

fX (u1, . . . , ui−1, xi , ui+1, . . . , un) dun . . . du1

=1√2πσ2

Xi

e

− 12

(xi−μXi

σ2Xi

)2

.

That is Xi ∼ N (μXi, σ2

Xi).

42 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Probability SpaceRandom Variables & DistributionsExpectations

Moment Generating Function

Let X be a random variable, then the moment generating function

(m.g.f.) of X isMX (u) = E

(euX

)provided the expectation is finite for some values of u in an open intervalcontaining zero.

The distribution of a r.v. X is uniquely associated with its m.g.f. MX if itexists. Therefore, we can identify the distribution of X from its m.g.f..

43 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Probability SpaceRandom Variables & DistributionsExpectations

Exercise

Let X ∼ N (μ, σ2).

Show that

MX (u) = E(euX

)= e

μu+12σ

2u2

.

44 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Probability SpaceRandom Variables & DistributionsExpectations

Answer

45 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Probability SpaceRandom Variables & DistributionsExpectations

Results

Let X and Y be independent r.v. whose m.g.f. exist, a and b beconstants, and n be a positive integer. Then

1 MaX+b(u) = E(e(aX+b)u

)= e

buMX (au).

2 E (X n) = dnMX (u)dun

∣∣∣u=0

.

3 MX+Y (u) = MX (u)MY (u).

46 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Probability SpaceRandom Variables & DistributionsExpectations

Proof of (1):

MaX+b(u) =

∫ezufaX+b(z) dz

=

∫e(ax+b)ufX (x) dx

= E

(e(aX+b)u

)= e

bu E

(e(au)X

)= e

buMX (au).

47 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Probability SpaceRandom Variables & DistributionsExpectations

Proof of (2):

MX (u) =

∫ezufX (z) dz ,

dMX (u)

du=

∫z e

zufX (z) dz ,

dMX (u)

du

∣∣∣∣u=0

=

∫z fX (z) dz = E (X ) ;

...

dnMX (u)

dun=

∫zn e

zufX (z) dz ,

dnMX (u)

dun

∣∣∣∣u=0

=

∫zn fX (z) dz = E (X n) .

48 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Probability SpaceRandom Variables & DistributionsExpectations

Proof of (3):

MX+Y (u) =

∫ezufX+Y (z) dz

=

∫e(z−x+x)u

∫fX (x)fY (z − x) dx dz

=

∫ ∫exufX (x) e

(z−x)ufY (z − x) dx dz

=

∫ ∫exufX (x) e

yufY (y) dx dy

= MX (u)MY (u).

49 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Conditional ProbabilityConditional ExpectationMartingales

Conditional Probability of Discrete Random Variables

Let X and Y be discrete r.v. defined on a probability space (Ω,F ,P).

The conditional probability of X given Y = y is

P (X = x | Y = y) =

⎧⎪⎨⎪⎩P ({X = x} ∩ {Y = y})

P (Y = y)if P (Y = y) > 0,

0 otherwise.

50 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Conditional ProbabilityConditional ExpectationMartingales

Example

Suppose a r.v. (X ,Y ,Z ) is equally likely to take any one of the values(1, 0, 0), (0, 1, 0), (0, 0, 1), (1, 0, 1) or (1, 1, 1).

P (X = 0 | Y = 0) =P ({X = 0} ∩ {Y = 0})

P (Y = 0)=

1/5

3/5=

1

3.

51 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Conditional ProbabilityConditional ExpectationMartingales

Example

Suppose a r.v. (X ,Y ,Z ) is equally likely to take any one of the values(1, 0, 0), (0, 1, 0), (0, 0, 1), (1, 0, 1) or (1, 1, 1).

P (X = 1 | Y = 0) =P ({X = 1} ∩ {Y = 0})

P (Y = 0)=

2/5

3/5=

2

3.

51 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Conditional ProbabilityConditional ExpectationMartingales

Example

Suppose a r.v. (X ,Y ,Z ) is equally likely to take any one of the values(1, 0, 0), (0, 1, 0), (0, 0, 1), (1, 0, 1) or (1, 1, 1).

P (X = 0 | Y = 1) =P ({X = 0} ∩ {Y = 1})

P (Y = 1)=

1/5

2/5=

1

2.

51 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Conditional ProbabilityConditional ExpectationMartingales

Example

Suppose a r.v. (X ,Y ,Z ) is equally likely to take any one of the values(1, 0, 0), (0, 1, 0), (0, 0, 1), (1, 0, 1) or (1, 1, 1).

P (X = 1 | Y = 1) =P ({X = 1} ∩ {Y = 1})

P (Y = 1)=

1/5

2/5=

1

2.

51 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Conditional ProbabilityConditional ExpectationMartingales

Conditional Probability of Continuous Random Variables

Let X and Y be continuous r.v. defined on a probability space (Ω,F ,P)with joint density function fX ,Y (x , y), and marginal density functionsfX (x) and fY (y).

The conditional density of X given Y is

fX |Y (x | y) =

⎧⎪⎨⎪⎩fX ,Y (x , y)

fY (y)if fY (y) > 0,

0 otherwise.

52 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Conditional ProbabilityConditional ExpectationMartingales

Conditional Expectation of Discrete Random Variables

Let X and Y be discrete r.v. defined on a probability space (Ω,F ,P).

The conditional expectation of X given Y = y is

E (X | Y = y) =∑x

x P (X = x | Y = y) .

53 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Conditional ProbabilityConditional ExpectationMartingales

Example

Suppose a r.v. (X ,Y ,Z ) is equally likely to take any one of the values(1, 0, 0), (0, 1, 0), (0, 0, 1), (1, 0, 1) or (1, 1, 1).

P (X = 0 | Y = 0) =1

3,

P (X = 1 | Y = 0) =2

3,

E(X | Y = 0) =

1∑x=0

x P (X = x | Y = 0) =2

3.

54 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Conditional ProbabilityConditional ExpectationMartingales

Example

Suppose a r.v. (X ,Y ,Z ) is equally likely to take any one of the values(1, 0, 0), (0, 1, 0), (0, 0, 1), (1, 0, 1) or (1, 1, 1).

P (X = 0 | Y = 1) =1

2,

P (X = 1 | Y = 1) =1

2,

E(X | Y = 1) =

1∑x=0

x P (X = x | Y = 1) =1

2.

54 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Conditional ProbabilityConditional ExpectationMartingales

Conditional Expectation & Random Variable

Let X and Y be discrete r.v. defined on a probability space (Ω,F ,P).

Define Z : Ω → R by

Z (ω) = E (X | Y = Y (ω)) .

Then Z is a r.v. w.r.t the σ-algebra F .

We shall denote the r.v. Z by E (X | Y ).

55 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Conditional ProbabilityConditional ExpectationMartingales

Conditional Expectation & Sigma-Algebra

The coarsest σ-algebra for which E (X | Y ) is a r.v. is the σ-algebragenerated by the r.v. Y given by

σ(Y ) ={A ⊂ Ω | A = Y−1(B) for some B ∈ B(R)

}.

56 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Conditional ProbabilityConditional ExpectationMartingales

Definition of Conditional Expectation

Let (Ω,F ,P) be a probability space, X a r.v. with E (|X |) < ∞, and Gbe a sub-σ-algebra of F .

Define the conditional expectation of X given G, denoted by E (X | G),to be any r.v. Y such that

1 Y is G-measurable, i.e. Y ∈ G,

2∫GY dP =

∫GX dP for each set G ∈ G.

If a r.v. Y has the above properties, then Y is a version of theconditional expectation of X given G, i.e. Y = E (X | G) a.s..

57 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Conditional ProbabilityConditional ExpectationMartingales

Conditional Expectation of Continuous Random Variables

Let X and Y be continuous r.v. defined on a probability space (Ω,F ,P)with conditional density function fX |Y (x | y).

Let h be a function such that E (|h(X )|) < ∞ and set

g(y) =

∫ ∞

−∞

h(x)fX |Y (x |y) dx .

Then g(Y ) is a version of the conditional expectation of h(X ) givenσ(Y ), i.e.

g(Y ) = E(h(X ) | σ(Y )) a.s..

58 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Conditional ProbabilityConditional ExpectationMartingales

Proof

Let G ∈ σ(Y ). Then Y (G ) = A ⊂ R and

∫G

h(X ) dP =

∫Ω

h(X (ω)

)1G (ω) dP(ω)

=

∫R

∫R

h(x) 1A(y)fX ,Y (x , y) dx dy

=

∫R

∫R

h(x) 1A(y)fX |Y (x |y)fY (y) dx dy

=

∫R

(∫R

h(x)fX |Y (x |y) dx)

1A(y)fY (y) dy

59 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Conditional ProbabilityConditional ExpectationMartingales

Proof

Let G ∈ σ(Y ). Then Y (G ) = A ⊂ R and

∫G

h(X ) dP =

∫R

(∫R

h(x)fX |Y (x |y) dx)

1A(y)fY (y) dy

=

∫R

g(y) 1A(y)fY (y) dy

=

∫Ω

g(Y (ω)

)1G (ω) dP(ω)

=

∫G

g(Y ) dP.

59 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Conditional ProbabilityConditional ExpectationMartingales

Some Mathematical Results

Let (Ω,F ,P) be a probability space, a and b constants, X and Y

integrable r.v., and G and H sub-σ-algebras of F .

1 E (Y ) = E (X ) if Y is a version of E (X | G).

2 E (X | G) = X if X is G-measurable.

3 E (Y X | G) = Y E (X | G) if Y is G-measurable.

4 E (X | σ(G,H)) = E (X | G) if H is independent of σ(σ(X ),G).

5 E (aX + bY | G) = aE (X | G) + bE (Y | G)(Linearity Property).

60 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Conditional ProbabilityConditional ExpectationMartingales

6 E (X | G) ≥ E (Y | G) if X ≥ Y

(Monotonicity).

7 E (E (X | G) | H) = E (X | H) if H ⊂ G(Tower Property).

8 E (ψ(X ) | G) ≥ ψ(E (X | G)) if ψ is a convex function (Jensen’sInequality).

9 lim infn→∞ E (Xn | G) ≥ E (lim infn→∞ Xn | G) if Xn ≥ 0(Fatou’s Lemma).

10 E (Xn | G) ↑ E (X | G) if Xn ≥ 0 and Xn ↑ X

(Monotone Convergence Theorem).

11 E (Xn | G) → E (X | G) if |Xn| ≤ Y for all n and Xn → X

(Dominated Convergence Theorem).

61 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Conditional ProbabilityConditional ExpectationMartingales

(Linearity) E (aX + bY | G) = aE (X | G) + bE (Y | G).

Proof. Since

1 aE (X | G) + bE (Y | G) ∈ G,

we need only to verify the condition

3

∫G

aE (X | G) + bE (Y | G) dP =

∫G

aX + bY dP for G ∈ G.

62 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Conditional ProbabilityConditional ExpectationMartingales

(Linearity) E (aX + bY | G) = aE (X | G) + bE (Y | G).

Proof. Let G ∈ G.∫G

aE (X | G) + bE (Y | G) dP

= a

∫G

E (X | G) dP+ b

∫G

E (Y | G) dP

= a

∫G

X dP+ b

∫G

Y dP

=

∫G

aX + bY dP.

62 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Conditional ProbabilityConditional ExpectationMartingales

(Monotonicity) E (X | G) ≥ E (Y | G) a.s. if X ≥ Y .

Proof. For any G ∈ G,∫G

E (X | G) dP =

∫G

X dP ≥∫G

Y dP =

∫G

E (Y | G) dP,∫G

E (Y | G)− E (X | G) dP ≤ 0.

Let ε > 0. Then

Aε ={E (Y | G)− E (X | G) > ε

}∈ G

andP (Aε) = 0.

63 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Conditional ProbabilityConditional ExpectationMartingales

(Jensen’s Inequality) E (ψ(X ) | G) ≥ ψ(E (X | G)) a.s. if ψ : R → R is aconvex function.

Proof. Let L ={(a, b) ∈ Q2 | ax + b ≤ ψ(x) ∀ x

}. Then

ψ(x) = sup{ax + b | (a, b) ∈ L

}.

If ψ(x) ≥ ax + b,

E (ψ(X ) | G) ≥ aE (X | G) + b.

Taking the supremum over (a, b) ∈ L gives

E (ψ(X ) | G) ≥ ψ (E (X | G)) .

64 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Conditional ProbabilityConditional ExpectationMartingales

If Y is a version of E (X | G), then E (Y ) = E (X ).

Proof. For any A ∈ G,∫Ω

1AY dP =

∫A

Y dP =

∫A

X dP =

∫Ω

1AX dP,

E ( 1AY ) = E ( 1AX ) .

In particular, for A = Ω ∈ G,

E (Y ) = E (X ) .

65 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Conditional ProbabilityConditional ExpectationMartingales

E (X | G) = X a.s. if X is G-measurable

Proof. Since

1 X is G-measurable,

2∫GX dP =

∫GX dP for G ∈ G,

we haveX = E (X | G) .

66 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Conditional ProbabilityConditional ExpectationMartingales

E (Y X | G) = Y E (X | G) a.s. if Y is G-measurable.

Proof. Since

1 Y E (X | G) ∈ G,

we need only to verify the condition

3

∫G

Y E (X | G) dP =

∫G

Y X dP for G ∈ G.

67 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Conditional ProbabilityConditional ExpectationMartingales

E (Y X | G) = Y E (X | G) a.s. if Y is G-measurable.

Proof. Let G ∈ G. Suppose Y = 1B for some B ∈ G.∫G

1B E (X | G) dP =

∫G∩B

E (X | G) dP =

∫G∩B

X dP

=

∫G

1BX dP.

If Y ≥ 0, let {Yn} be a sequence of simple r.v. that converges to Y , anduse the monotone convergence theorem to show that∫

G

Y E (X | G) dP =

∫G

Y X dP.

67 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Conditional ProbabilityConditional ExpectationMartingales

E (Y X | G) = Y E (X | G) a.s. if Y is G-measurable.

Proof. If Y ≥ 0, let {Yn} be a sequence of simple r.v. thatconverges to Y , and use the monotone convergence theorem to concludethat ∫

G

Y E (X | G) dP =

∫G

Y X dP.

To prove the result in general, split Y into positive and negative parts.

67 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Conditional ProbabilityConditional ExpectationMartingales

(Tower Property) E (E (X | G) | H) = E (X | H) a.s. if H ⊂ G.

Proof. For any r.v. Y and any A ∈ H,

E ( 1A E (Y | H)) = E (E ( 1AY | H)) = E ( 1AY ) .

Since A ∈ H ⊂ G,

E

(1A E

(E (X | G)︸ ︷︷ ︸ | H

))= E

(1A E (X | G)︸ ︷︷ ︸

)= E ( 1AX ) .

68 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Conditional ProbabilityConditional ExpectationMartingales

Filtration & Filtered Space

Given a probability space (Ω,F ,P), a filtration is a nested family{Ft | t ∈ N} of sub-σ-algebras of F where

F0 ⊂ F1 ⊂ · · · ⊂ F .

The probability space with the filtration {Ft | t ∈ N} is called a filtered

probability space (Ω,F , {Ft},P

).

69 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Conditional ProbabilityConditional ExpectationMartingales

Adapted Process

A process X = {Xt} is adapted to the filtration {Ft} if Xt isFt-measurable for each t, i.e. Xt ∈ Ft .

Recall that Xt is Ft-measurable means

X−1t (B) =

{ω ∈ Ω | Xt(ω) ∈ B

} ∈ Ft ∀B ∈ B(R).

70 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Conditional ProbabilityConditional ExpectationMartingales

Martingale

A process X = {Xt} is a martingale relative to a filtered space(Ω,F , {Ft},P

)if

1 X is adapted,

2 E (Xt | Fs) = Xs a.s. for t ≥ s.

71 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Conditional ProbabilityConditional ExpectationMartingales

Discrete Time Martingale

For discrete time process X = {Xt}, condition 2 for a martingale can berestated as

2 E (Xt | Ft−1) = Xt−1 a.s. for t ≥ 1.

E (Xt | Ft−1) = Xt−1

E (Xt | Ft−2) = E (E (Xt | Ft−1) | Ft−2)

= E (Xt−1 | Ft−2) = Xt−2

...

E (Xt | Ft−k) = E (E (Xt | Ft−k+1) | Ft−k)

= E (Xt−k+1 | Ft−k) = Xt−k

72 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Conditional ProbabilityConditional ExpectationMartingales

Supermartingale & Submartingale

A process X = {Xt} is a supermartingale relative to a filtered space(Ω,F , {Ft},P

)if

1 X is adapted,

2 E (Xt | Fs) ≤ Xs a.s. for t ≥ s.

And X is a submartingale if condition 2 is replaced with

2 E (Xt | Fs) ≥ Xs a.s. for t ≥ s.

73 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Conditional ProbabilityConditional ExpectationMartingales

Exercise

Suppose it is equally likely to get a head or a tail when a coin is toss. Let

Xi =

{1 if the ith toss results in a head,

−1 if the ith toss results in a tail.

Consider the stochastic process {Mn} defined by M0 = 0 and

Mn =

n∑i=1

Xi , for n ≥ 1.

1 Show that {Mn} is a martingale, i.e. E(Mn | Mn−1) = Mn−1 forn ≥ 1.

74 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Conditional ProbabilityConditional ExpectationMartingales

Answer

75 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Conditional ProbabilityConditional ExpectationMartingales

Exercise

Let ζ be an integrable r.v. define on a probability space (Ω,F ,P), and{Ft} be a filtration.

DefineMt = E (ζ | Ft) for all t.

Show that the stochastic process {Mt} is a martingale.

76 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Radon-Nikodym DerivativeExpectation

Absolute Continuous & Equivalent Measure

A probability measure Q is absolutely continuous w.r.t. measure P,denoted by Q � P, if

P (A) = 0 =⇒ Q (A) = 0 ∀ A ∈ F .

The probability measures P and Q are equivalent measure, denoted byP ∼ Q, if

Q � P and P � Q.

77 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Radon-Nikodym DerivativeExpectation

Changing Probability Measure

Let (Ω,F ,P) be a probability space, and let Z ≥ 0 a.s. with EP(Z ) = 1.For A ∈ F , define

Q (A) =

∫A

Z (ω) dP (ω) .

Then Q is a probability measure. Furthermore,

EQ(X ) = EP(ZX )

for any integrable r.v. X . If Z > 0 a.s., we also have

EP(Y ) = EQ

(Y

Z

)for any integrable r.v. Y .

78 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Radon-Nikodym DerivativeExpectation

Radon-Nikodym Derivative

Suppose Q � P. Then there exists a r.v. Y ∈ F such that

1 Y is positive P-a.s.

2 EP(Y ) = 1.

3 Q (A) =

∫A

Y ({ω}) dP ({ω}) for A ∈ F .

The r.v. Y is the Radon-Nikodym derivative of Q w.r.t. P, denoted bydQ

dP.

Moreover, if P ∼ Q then Y is strictly positive P-a.s. and Q-a.s..

79 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Radon-Nikodym DerivativeExpectation

Change of Measure & Expectation

Let X be an integrable r.v. defined on a probability space (Ω,F ,P), andQ ∼ P.

1 EQ(X ) = EP

(X

dQ

dP

).

2 EQ (X | Ft) =

EP

(X

dQ

dP

∣∣∣∣Ft

)EP

(dQ

dP

∣∣∣∣Ft

) .

80 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Radon-Nikodym DerivativeExpectation

Proof

1 EQ(X ) = EP

(X

dQ

dP

).

EQ(X ) =

∫Ω

X dQ =

∫Ω

XdQ

dPdP

= EP

(X

dQ

dP

).

81 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance

General Probability TheoryInformation and Conditioning

Change of Measure

Radon-Nikodym DerivativeExpectation

Proof

2 EP

(X

dQ

dP

∣∣∣∣Ft

)= EQ (X | Ft) E

P

(dQ

dP

∣∣∣∣Ft

).

Let A ∈ Ft .∫A

XdQ

dPdP =

∫A

X dQ =

∫A

EQ (X | Ft) dQ

=

∫A

EQ (X | Ft)dQ

dPdP

=

∫A

EP

(EQ (X | Ft)

dQ

dP

∣∣∣∣Ft

)dP

=

∫A

EQ (X | Ft) EP

(dQ

dP

∣∣∣∣Ft

)dP.

82 / 82 William C. H. Leon MFE6516 Stochastic Calculus for Finance