Notes and figures are based on or taken from materials in the course textbook: Charles Boncelet,
Probability, Statistics, and Random Signals, Oxford University Press, February 2016.
B.J. Bazuin, Spring 2022 1 of 37 ECE 3800
Charles Boncelet, βProbability, Statistics, and Random Signals," Oxford University Press, 2016. ISBN: 978-0-19-020051-0
Chapter 9: THE GAUSSIAN AND RELATED DISTRIBUTIONS
Sections 9.1 The Gaussian Distribution and Density 9.2 Quantile Function 9.3 Moments of the Gaussian Distribution 9.4 The Central Limit Theorem 9.5 Related Distributions
9.5.1 The Laplace Distribution 9.5.2 The Rayleigh Distribution 9.5.3 The Chi-Squared and F Distributions
9.6 Multiple Gaussian Random Variables 9.6.1 Independent Gaussian Random Variables 9.6.2 Transformation to Polar Coordinates 9.6.3 Two Correlated Gaussian Random Variables
9.7 Example: Digital Communications Using QAM 9.7.1 Background 9.7.2 Discrete Time Model 9.7.3 Monte Carlo Exercise 9.7.4 QAM Recap
Summary Problems
Notes and figures are based on or taken from materials in the course textbook: Charles Boncelet,
Probability, Statistics, and Random Signals, Oxford University Press, February 2016.
B.J. Bazuin, Spring 2022 2 of 37 ECE 3800
Gaussian Distribution and Density
The Gaussian or Normal probability density function is defined as:
π π₯1
β2π β πβ ππ₯π
π₯ π2 β π
, β π₯ β
where ΞΌ is the mean and Ο is the variance
The Gaussian Cumulative Distribution Function (CDF)
πΉ π₯1
β2π β πβ ππ₯π
π£ π2 β π
β ππ£
The CDF can not be represented in a closed form solution!
NormalDistributionβGaussianwithzeromeanandunitvariance.
The Normal probability density function is defined as:
xfor
xxN ,
2exp
2
1 2
The Normal Cumulative Distribution Function (CDF)
dvv
xx
v
N
2exp
2
1 2
Note the relationship between the Gaussian and Gaussian-Normal is
x
xF XX
see the MATLAB: GaussianDemo.m
-8 -6 -4 -2 0 2 4 6 80
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
1Gaussian PDF and pdf
Notes and figures are based on or taken from materials in the course textbook: Charles Boncelet,
Probability, Statistics, and Random Signals, Oxford University Press, February 2016.
B.J. Bazuin, Spring 2022 3 of 37 ECE 3800
Gaussian or Normal Distribution
http://en.wikipedia.org/wiki/Normal_distribution http://en.wikipedia.org/wiki/Normal_distribution#Occurrence
Not yet proven reasons for importance:
1. It provides a good mathematical model for a great many different physically observed random phenomena that can be justified theoretically in many ways.
2. It is one of the few density functions that can be extended to handle an arbitrarily large number of random variables conveniently.
3. Linear combinations of Gaussian random variables lead to new random variables that are also Gaussian. This is not true for most other density functions.
4. The random process from which Gaussian random variables are derived can be completely specified, in a statistical sense, from a knowledge of the first and second moments. This is not true for other processes. All higher level moments are sums, products and/or powers of the mean and variance.
5. In system analysis, the Gaussian process is often the only one for which a complete statistical analysis can be carried through in either the linear or nonlinear situation.
6. The function is infinitely differentiable (all the derivatives exist).
Notes and figures are based on or taken from materials in the course textbook: Charles Boncelet,
Probability, Statistics, and Random Signals, Oxford University Press, February 2016.
B.J. Bazuin, Spring 2022 4 of 37 ECE 3800
Important notes on the Gaussian curve:
The pdf
1. There is only one maximum and it occurs at the mean value.
2. The density function is symmetric about the mean value.
3. The width of the density function is directly proportional to the standard deviation, . The width of 2 occurs at the points where the height is 0.6065 (exp(-0.5)) of the maximum value. These are also the points of the maximum slope. Also note that:
683.0Pr X
955.022Pr X
4. The maximum value of the density function is inversely proportional to the standard deviation, .
2
1Xf
5. Since the density function has an area of unity, it can be used as a representation of the impulse or delta function by letting approach zero. That is
2
2
0 2exp
2
1lim
xx
Notes and figures are based on or taken from materials in the course textbook: Charles Boncelet,
Probability, Statistics, and Random Signals, Oxford University Press, February 2016.
B.J. Bazuin, Spring 2022 5 of 37 ECE 3800
Specific Values for the Standard Normal CDF
π π₯1
β2πβ ππ₯π
π₯2
, β π₯ β
where ΞΌ = 0 is the mean and the variance Ο = 1.
Ξ¦ π₯1
β2πβ ππ₯π
π£2
β ππ£
683.0Pr X
955.022Pr X
Notes and figures are based on or taken from materials in the course textbook: Charles Boncelet,
Probability, Statistics, and Random Signals, Oxford University Press, February 2016.
B.J. Bazuin, Spring 2022 6 of 37 ECE 3800
Gaussian to Normal is a linear scaling
Letting the linear relationship be defined as
ππ ππ
The inverse mapping π π β π π
the Jocobian or derivative becomes ππ₯ππ§
π
Therefore
π π§ π π₯ βππ₯ππ§
Then for the normalized form the R.V.
π π₯1
β2π β πβ ππ₯π
π₯ π2 β π
, β π₯ β
π π§1
β2π β πβ ππ₯π
π§ β π π π2 β π
β π
π π§1
β2πβ ππ₯π
π§ β π2 β π
π π§1
β2πβ ππ₯π
π§2
π π¦
In addition, we would expect
πΉ π₯ Ξ¦ π§
πΉ π₯ Ξ¦π₯ ππ
Notes and figures are based on or taken from materials in the course textbook: Charles Boncelet,
Probability, Statistics, and Random Signals, Oxford University Press, February 2016.
B.J. Bazuin, Spring 2022 7 of 37 ECE 3800
Two-sided Gaussian Probability
Pr ΞΌ Ο x ΞΌ Ο 0.6827
Pr ΞΌ 2Ο x ΞΌ 2Ο 0.9545
Pr ΞΌ 3Ο x ΞΌ 3Ο 0.9973
OneβSidedGaussianProbability
ππ π₯ 0 0.5
ππ π₯ π π 0.8413
ππ π₯ π 2π 0.9772
ππ π₯ π 3π 0.9987
For hypothesis testing and statistical confidence intervals β¦ there will be multiple problems and examples where either a two-sided or one-sided Gaussian probability is required. There are differences in the solutions derived if the wrong one is selected!
Notes and figures are based on or taken from materials in the course textbook: Charles Boncelet,
Probability, Statistics, and Random Signals, Oxford University Press, February 2016.
B.J. Bazuin, Spring 2022 8 of 37 ECE 3800
EquivalentGaussianprobabilityrepresentations
π π₯1
β2π β πβ ππ₯π
π₯ π2 β π
, β π₯ β
π π§1
β2πβ ππ₯π
π§2
Manipulations
Pr a X b πΉ π πΉ π
Pr a X b Pr a π X π b π , π βπππ‘πππ ππππ
Pr a X b Pra ππ
X ππ
b ππ
, ππππππ π ππππππ
ππ ππ
Pr a X b Pra ππ
Zb ππ
, ππππππππ§ππ‘πππ
Using normalized probability
Pr a X b Ξ¦b ππ
Ξ¦a ππ
The normalization of the Gaussian is often implemented using βZβ.
The computations with the standard normalization is referred to as a z-score.
EquivalentProbabilitiesPr Z b Ξ¦ b
Pr Z a 1 Ξ¦ a
Pr a Z b Ξ¦ b Ξ¦ a
Also note Ξ¦ z 1 Ξ¦ z
Notes and figures are based on or taken from materials in the course textbook: Charles Boncelet,
Probability, Statistics, and Random Signals, Oxford University Press, February 2016.
B.J. Bazuin, Spring 2022 9 of 37 ECE 3800
OtherrelationshipswithnormalizedGaussian
Pr a Z a Ξ¦ π Ξ¦ π Ξ¦ π 1 Ξ¦ π
Pr a Z a 2 β Ξ¦ π 1
or in general
Pr a Z b Ξ¦ π Ξ¦ π Ξ¦ π 1 Ξ¦ π
Pr a Z b Ξ¦ π Ξ¦ π 1
PerformingComputations
The error function is typically defined as
πππ π§2
βπβ ππ₯π π¦ β ππ¦
Ξ¦ z12
12β πππ
π§
β2
ππ ππ
πΉ π₯12
12β πππ
π₯ π
β2 β π
For multiple bounds
22
1
2
1
22
1
2
11
aerf
berfFbFbXaP XXX
ππ π π π πΉ π πΉ π12β πππ
π π
β2 β π
12β πππ
π π
β2 β π
This definition is valid for MATLAB and EXCEL and WIKIPEDIA. There are other sources that do not define it this way, so check before use!
Ξ¦ z12
12β πππ
π§
β2
Notes and figures are based on or taken from materials in the course textbook: Charles Boncelet,
Probability, Statistics, and Random Signals, Oxford University Press, February 2016.
B.J. Bazuin, Spring 2022 10 of 37 ECE 3800
The complementary error function is defined as
ππππ π§ 1 πππ π§2
βπβ ππ₯π π¦ β ππ¦
Ξ¦ z 1 Ξ¦ π§ 112
12β πππ
π§
β2
Ξ¦ z 1 Ξ¦ π§12
12β πππ
π§
β2
12β ππππ
π§
β2
There are also inverse functions for erf and erfc!
z Ξ¦ ππ β2 β erfinv 2 β ππ 1
The Q function in communications is βthe tail of the Gaussianβ
Q z 1 Ξ¦ π§12
12β πππ
π§
β2
12β ππππ
π§
β2
See gaussian.m and qfunction.m
function [pdf, cdf]=gaussian(x, mean, sigma) % The Gaussian probability mass function given: % mean is the mean % sigma is the variance % pdf is probability density function % cdf is cumulative distribution function pdf = (1/(sqrt(2*pi)*sigma))*exp((-(x-mean).^2)/(2*sigma^2)); cdf = 0.5+0.5*erf((x-mean)/(sqrt(2)*sigma)); %cdf1 = 0.5*erfc((x-mean)/(sqrt(2)*sigma)); %cdf2 = 1-qfunction((x-mean)/sigma); function y = qfunction(x) % Q Function generation routine % % From G.R. Cooper and C.D. McGillem % Probabilistic Methods of Signal and System Analysis % Oxford Univ. Press, New York, NY, 1999. p. 442. y = 0.5*(ones(size(x))-erf(x/sqrt(2))); % From Matlab %y = 0.5*erfc(x/sqrt(2));
Notes and figures are based on or taken from materials in the course textbook: Charles Boncelet,
Probability, Statistics, and Random Signals, Oxford University Press, February 2016.
B.J. Bazuin, Spring 2022 11 of 37 ECE 3800
Quantile Function
The inverse of the Gaussian CDF.
π ππ π π₯ πΉ π₯
The inverse is then
π₯ πΉ π π π π πΉ π₯
As used in the textbook, the function is particularly useful when given a one-sided or two-sided probability value and you want to determine the appropriate offset from the mean defined (for one-sided) or βrangeβ about the mean value defined (for two-sided).
Wikipedia has a much more extensive definition and discussion. See: https://en.wikipedia.org/wiki/Quantile
This will become highly used with decision making and hypothesis testing in statistics.
Notes and figures are based on or taken from materials in the course textbook: Charles Boncelet,
Probability, Statistics, and Random Signals, Oxford University Press, February 2016.
B.J. Bazuin, Spring 2022 12 of 37 ECE 3800
Moments of the Gaussian Distribution
All moments of a Gaussian can be defined based on the mean and variance. This makes the Gaussian very unique and also convenient β¦ once the two are known, all others are known!
The normal function is even-symmetric. All products of z to an odd power are odd functions Therefore, the product of an odd power of z and the pdf will be odd-symmetric. If an odd-symmetric function is integrated from βinfinity to +infinity, the result will be zero! Therefore, for all odd moments
πΈ π 0
This does no help for the computation of even moments.
Textbookderivations
The text derives the mean and variance for the normal function. p. 228-230.
π π§1
β2πβ ππ₯π
π§2
πΈ π π§ β π π§ β ππ§ π§ β1
β2πβ ππ₯π
π§2
β ππ§
πΈ π1
β2πβ ππ₯π
π§2
πΈ π1
β2πβ ππ₯π
β2
ππ₯πβ
20
And the variance
πΈ π π§ β π π§ β ππ§ π§ β1
β2πβ ππ₯π
π§2
β ππ§
Notes and figures are based on or taken from materials in the course textbook: Charles Boncelet,
Probability, Statistics, and Random Signals, Oxford University Press, February 2016.
B.J. Bazuin, Spring 2022 13 of 37 ECE 3800
πΈ π1
β2πβ π§ β ππ₯π
π§2
β ππ§
Integrating by parts: dvuuvduv
v = z ππ’ π§ β ππ₯ππ§2
dv = 1 π’ ππ₯ππ§2
πΈ π1
β2πβ π§ β ππ₯π
π§2
ππ₯ππ§2
β ππ§
πΈ π 0 01
β2πβ ππ₯π
π§2
β ππ§ 1
πππ π πΈ π πΈ π 1
Structure for higher order even moments
πΈ π1
β2πβ π§ β ππ₯π
π§2
β ππ§
Integrating by parts: dvuuvduv
π§ π§ β ππ₯ππ§2
π 1 β π§ ππ₯ππ§2
πΈ π1
β2πβ π§ β π₯π
π§2
π 1 β π§ β ππ₯ππ§2
β ππ§
πΈ π 0 0 π 1 β1
β2πβ π§ β ππ₯π
π§2
β ππ§
πΈ π π 1 β πΈ π
For n even
πΈ π π 1 β π 3 β β― β 1 β 1
For n odd
πΈ π π 1 β π 3 β β― β 2 β 0 0
Notes and figures are based on or taken from materials in the course textbook: Charles Boncelet,
Probability, Statistics, and Random Signals, Oxford University Press, February 2016.
B.J. Bazuin, Spring 2022 14 of 37 ECE 3800
Expected value of a Gaussian
dxxfxXEX X
xforx
xf X ,2
exp2
12
2
2
dxx
xXEX2
2
2 2exp
2
1
Letting
x
z with dx
dz
dz
zzXEX
2exp
2
1 2
2
dz
zzdz
zXEX
2exp
22exp
2
1 22
dz
zzXEX
2exp
2
2
2
exp2
2zXEX
XEX
Notes and figures are based on or taken from materials in the course textbook: Charles Boncelet,
Probability, Statistics, and Random Signals, Oxford University Press, February 2016.
B.J. Bazuin, Spring 2022 15 of 37 ECE 3800
Variance of Gaussian
dxxfXXE X22
xforx
xf X ,2
exp2
12
2
2
dxx
XXE2
2
2
22
2exp
2
1
dxx
XXE2
2
2
22
2exp
2
1
Letting
x
z with dx
dz
dz
zzXE
2exp
2
1 2
2
222
dz
zzXE
2exp
2
22
22
Integrating by parts: dvuuvduv
z
2exp
2zz
1
2exp
2z
dzzz
zXE2
exp2
12
2exp
2
2222
22
2 12002
XE
Notes and figures are based on or taken from materials in the course textbook: Charles Boncelet,
Probability, Statistics, and Random Signals, Oxford University Press, February 2016.
B.J. Bazuin, Spring 2022 16 of 37 ECE 3800
The MGF of a Gaussian
xforx
xf X ,2
exp2
12
2
2
MGF:
dxxtxftM XX exp
dxxtx
tM X exp2
exp2
12
2
2
When integrating Gaussians β¦ form an integral of a βcorrectly formedβ Gaussian pdf and equate it to 1.0.
dx
xtxxtM X 2
222
2 2
22exp
2
1
dx
xtxtM X 2
222
2 2
2exp
2
1
dxtxtx
ttM X
2
2222
2
2
222
2
2exp
2
1
2exp
dxtxt
tM X 2
22
22
222
2exp
2
1
2exp
The integral is now equal to 1.0. And we have
2
242
2
22422
2
2exp
2
2exp
tttt
tM X
2exp
22 tttM X
Notes and figures are based on or taken from materials in the course textbook: Charles Boncelet,
Probability, Statistics, and Random Signals, Oxford University Press, February 2016.
B.J. Bazuin, Spring 2022 17 of 37 ECE 3800
Now we can generate the moments of a Gaussian function.
The 1st Moment
2exp
2exp
222
22
0
ttt
tt
ttM
t tX
12
00exp0
222
0tX tM
t
The 2nd Moment
2
exp22
2
02
2 ttt
ttM
tt
X
2
exp2
exp22
222
22
02
2 tt
ttttM
tt
X
22222
02
2
110
t
X tMt
The 3rd Moment
2
exp22
222
03
3 ttt
ttM
tt
X
2exp2
2exp
2222
222232
03
3
ttt
tttttM
tt
X
102100 222232
03
3
t
X tMt
23
03
3
3
t
X tMt
Notes and figures are based on or taken from materials in the course textbook: Charles Boncelet,
Probability, Statistics, and Random Signals, Oxford University Press, February 2016.
B.J. Bazuin, Spring 2022 18 of 37 ECE 3800
The 4th Moment
2
exp322
2232
04
4 tttt
ttM
tt
X
2exp033
2exp3
2222222
2222242
04
4
ttt
tttttM
tt
X
10303
1030
22222
22242
0
4
4
t
X tMt
4224
04
4
36
t
X tMt
See: https://en.wikipedia.org/wiki/Normal_distribution
The above derivation matches the table provided β¦.
Notes and figures are based on or taken from materials in the course textbook: Charles Boncelet,
Probability, Statistics, and Random Signals, Oxford University Press, February 2016.
B.J. Bazuin, Spring 2022 19 of 37 ECE 3800
9.4 Central Limit Theorem
https://en.wikipedia.org/wiki/Central_limit_theorem
βIn probability theory, the central limit theorem (CLT) establishes that, in most situations, when independent random variables are added, their properly normalized sum tends toward a normal distribution (informally a "bell curve") even if the original variables themselves are not normally distributed. The theorem is a key concept in probability theory because it implies that probabilistic and statistical methods that work for normal distributions can be applicable to many problems involving other types of distributions.β
The convolution of pdf of summed R.V. begins to look Gaussian after a large number of R.V. are summed.
SumsofIIDR.V.
S π
If n is known, the expected value of the sum should be expected
πΈ S E π πΈ π π n β π
πππ S E π π πππ π π n β π
If we normalize the summed random variance
YS πΈ S
πππ S
Then
πΈ Y ES πΈ S
πππ S0
πππ Y VarS πΈ S
πππ S1.0
Based on the Central Limit Theorem, Y will be a Normal R.V. as n becomes very large.
Notes and figures are based on or taken from materials in the course textbook: Charles Boncelet,
Probability, Statistics, and Random Signals, Oxford University Press, February 2016.
B.J. Bazuin, Spring 2022 20 of 37 ECE 3800
CLT example convolutions.
Convolution with rectangles βGausConv_rect.mβ
Sum of 50 uniform pdf R.V.
Convolution with exponentials (Erlang) βGausConv_exp.mβ
Sum of 5 exponential pdf R.V. The curve shown in the textbook.
y0 5 10 15 20 25 30
0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
1
y0 5 10 15 20 25 30 35 40 45 50
0
0.02
0.04
0.06
0.08
0.1
0.12
0.14
0.16
0.18
0.2
ConvolutionGaussian
y0 1 2 3 4 5 6 7 8 9 10
0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
1
y0 1 2 3 4 5 6 7 8 9 10
0
0.02
0.04
0.06
0.08
0.1
0.12
0.14
0.16
0.18
0.2
ConvolutionGaussian
Notes and figures are based on or taken from materials in the course textbook: Charles Boncelet,
Probability, Statistics, and Random Signals, Oxford University Press, February 2016.
B.J. Bazuin, Spring 2022 21 of 37 ECE 3800
TheCLTanddiscreteprobability.
Notes and figures are based on or taken from materials in the course textbook: Charles Boncelet,
Probability, Statistics, and Random Signals, Oxford University Press, February 2016.
B.J. Bazuin, Spring 2022 22 of 37 ECE 3800
Jointly Gaussian Random Variables
Notes and figures are based on or taken from materials in the course textbook: Probability, Statistics and Random Processes for Engineers, 4th ed., Henry Stark and John W. Woods, Pearson Education, Inc., 2012
If two R.V. are jointly Gaussian
2
2
2
2
2
2
,12
212
1exp
,
YX
Y
Y
YX
YX
X
X
YX
yyxx
yxf
If 0 :
π π₯,π¦
ππ₯ππ₯ π2 β π
π¦ π2 β π
2π β π β π
ππ₯ππ₯ π2 β π
β2π β πβ
ππ₯ππ¦ π2 β π
β2π β π
Visualizing Joint Gaussians β¦
Figure 4.3-4 Contours of constant density for the joint normal (X = Y = 0): (a) ΟX = ΟY, Ο = 0; (b) ΟX >ΟY, Ο=0; (c) ΟX <ΟY, Ο=0; (d) ΟX =ΟY ;Ο>0.
Notes and figures are based on or taken from materials in the course textbook: Charles Boncelet,
Probability, Statistics, and Random Signals, Oxford University Press, February 2016.
B.J. Bazuin, Spring 2022 23 of 37 ECE 3800
Joint Gaussian: Independent X and Y
For X and Y independent:
2
2
2
2
2exp
2
1
2exp
2
1,
X
X
XY
Y
Y
XY
xyyxf
2
2
2
2
22exp
2
1,
X
X
Y
Y
XYXY
xyyxf
If both functions have zero mean and identical variances
2
22
2 2exp
2
1,
xy
yxf XY
Figure 2.6-10 Graph of the joint Gaussian density. Stark & Woods.
This has been referred to as a hat function β¦.
Notes and figures are based on or taken from materials in the course textbook: Charles Boncelet,
Probability, Statistics, and Random Signals, Oxford University Press, February 2016.
B.J. Bazuin, Spring 2022 24 of 37 ECE 3800
Example 2.6-11 independent Gaussians, zero mean unit variance Stark & Woods β¦ example in Chap. 8
Rectangular to circular conversion β¦
22 xyr and
x
yatan
Note that for an infinitesimal area ddrrdydx
Then, for cumulative distribution function
y x
XY ddyxF 2
exp2
1,
22
We could consider a change to circular area as
r
R ddrF0
2
0
2
2exp
2
1,
r
R ddrF0
2
0
2
2
1
2exp,
r
R drF0
2
2exp
12
exp2
exp2
0
2
rrF
r
R
2exp1
2rrFR
And the probability density function is
2exp
2rrrf R
with
20,2
1f
Also, they are independent β¦
randrr
rf R
020,
2exp
2,
2
Notes and figures are based on or taken from materials in the course textbook: Charles Boncelet,
Probability, Statistics, and Random Signals, Oxford University Press, February 2016.
B.J. Bazuin, Spring 2022 25 of 37 ECE 3800
The Rayleigh Distribution
If X and Y IID with Gaussian zero mean and defined variance, s2 under rectangular or magnitude and phase translation.
π πππ β ππ₯π
π2 β π
πΉ π π π β ππππ β ππ₯π
π2 β π
β ππ
πΉ π ππ₯ππ
2 β π ππ₯π
π2 β π
ππ₯π0
2 β π
πΉ π 1 ππ₯ππ
2 β π
The mean β¦.
πΈ π π β π π β ππππ β ππ₯π
π2 β π
β ππ
Integrating by parts: dvuuvduv
r ππ β ππ₯π
π2 β π
1 ππ₯ππ
2 β π
Notes and figures are based on or taken from materials in the course textbook: Charles Boncelet,
Probability, Statistics, and Random Signals, Oxford University Press, February 2016.
B.J. Bazuin, Spring 2022 26 of 37 ECE 3800
πΈ π π β ππ₯ππ
2 β π ππ₯π
π2 β π
β ππ
πΈ π 0 0 β2π β π β1
β2π β π β ππ₯π
π2 β π
β ππ
The integral of one half of the Gaussian!
πΈ π β2π β π β12
π2β π
The variance computation begins with a second moment β¦.
πΈ π π β π π β ππππ β ππ₯π
π2 β π
β ππ
Integrating by parts: dvuuvduv
π ππ β ππ₯π
π2 β π
2 β π ππ₯ππ
2 β π
πΈ π π β ππ₯ππ
2 β π 2 β π β ππ₯π
π2 β π
β ππ
πΈ π 0 0 2 β π βππ β ππ₯π
π2 β π
β ππ
Recognizing the integral of the Rayleigh pdf!
πΈ π 2 β π
The variance is then
πππ π πΈ π πΈ π 2 β π π2β π 2
π2
β π
Notes and figures are based on or taken from materials in the course textbook: Charles Boncelet,
Probability, Statistics, and Random Signals, Oxford University Press, February 2016.
B.J. Bazuin, Spring 2022 27 of 37 ECE 3800
Matlab
A Rayleigh distribution - two dimensional Gaussian x=randn(1,numsamples); y=randn(1,numsamples); xy=Gsigma*(x+1i*y);
Notes and figures are based on or taken from materials in the course textbook: Charles Boncelet,
Probability, Statistics, and Random Signals, Oxford University Press, February 2016.
B.J. Bazuin, Spring 2022 28 of 37 ECE 3800
Example: Archery target shooting with
A Rayleigh distribution - two dimensional Gaussian
Archer capability described by 4
125.0 YX in feet
From the Rayleigh distribution
0,0
0,2
exp2
2
2
rfor
rforrr
rfR
0,0
0,2
exp12
2
rfor
rforr
rFR
The specific values are
0,0
0,8exp16 2
rfor
rforrrrfR
0,0
0,8exp1 2
rfor
rforrrFR
πΈ π β2π β π β12
π2β π
π2β
14
0.3133
πππ π 2π2
β π 0.4292 β14
0.0268
Assume a 1-foot radius target with a 1-inch radius Bulls-eye
The archers expected performance can be described by β¦.
Probability of a Bulls-eye (1 inch radius)
0540.0144
8exp1
12
18exp1
12
1 2
RF
Probability of missing the target (1 foot radius)
42 1035.38exp18exp1111 RF
Notes and figures are based on or taken from materials in the course textbook: Charles Boncelet,
Probability, Statistics, and Random Signals, Oxford University Press, February 2016.
B.J. Bazuin, Spring 2022 29 of 37 ECE 3800
Example 2.4-5 Cell phone received signal power model.
The power can be described as a Rayleigh distribution.
rforrr
rf R
0,2
exp2
2
2
rforr
rFR
0,2
exp12
2
Assume mW1 for the r power radius.
What is the probability that the power W is less than 0.8 mW?
2
2
12
8.0exp18.0RF
or
8.0
02
2
2 12exp
18.0 dr
rrPR
Hint:
2
2
2
2
2 2exp
2exp
2
2
x
dxxx
2
0exp
2
8.0exp
2exp8.0
228.0
0
2rPR
29.032.0exp18.0 RP
Notes and figures are based on or taken from materials in the course textbook: Charles Boncelet,
Probability, Statistics, and Random Signals, Oxford University Press, February 2016.
B.J. Bazuin, Spring 2022 30 of 37 ECE 3800
The Laplace Distribution
π π₯π2β ππ₯π π β |π₯ π|
πΉ π₯
12β ππ₯π π β π₯ π , π₯ π
112β ππ₯π π β π₯ π , π π₯
πΈ π π
πππ π2π
As described in the text, the Laplace Distribution can be used under certain condition to provide the density of the estimation error.
Notes and figures are based on or taken from materials in the course textbook: Charles Boncelet,
Probability, Statistics, and Random Signals, Oxford University Press, February 2016.
B.J. Bazuin, Spring 2022 31 of 37 ECE 3800
The Chi-Squared
The chi-squared distribution is based on the summation of the squares of R.V. that have a Gaussian distribution.
S π π π β― π
S~Ο
This would be defined as the Ο2 distribution with a k degree of freedom
If the underlying R.V. are normal, IID with N(0,1)
π π₯1
2 β β Ξ π 2ββ π₯ β β ππ₯π π₯ 2β , π₯ 0
where the Gamma function. A derivation of the pdf is available at Wikipedia.
The chi-square distribution is a special case of the gamma distribution and is one of the most widely used probability distributions in inferential statistics, e. g., in hypothesis testing or in construction of confidence intervals.
from https://en.wikipedia.org/wiki/Chi-squared_distribution
The gamma function is defined as
Ξ π₯ π‘ β ππ₯π π‘ β ππ‘
Ξ π₯ π₯ 1 β Ξ π₯ 1
For n a positive integer and for n=1/2 Ξ π π 1 !
Ξ 1 2β βπ
Graphically the gamma function appears as
Notes and figures are based on or taken from materials in the course textbook: Charles Boncelet,
Probability, Statistics, and Random Signals, Oxford University Press, February 2016.
B.J. Bazuin, Spring 2022 32 of 37 ECE 3800
Meanandvariance
πΈ π π, πππ πΈ π 1
πππ π 2 β π, πππ πππ π 2
πππ π2π
Additional applications β¦
When determining mean squared error computations, particularly when signals and Gaussian noise are considered, the error is always squared and often defined based on the Gaussian noise. Therefore, it becomes the sum of IID squared Gaussians.
When we discuss confidence intervals, the chi-squared distribution will again be discussed.
FβDistributions
The F distribution arises from the ratio of independent chi-squared random variables (S and T) with defined degrees of freedom (ds and dt). Such that
πππ
~πΉ π ,π
Notes and figures are based on or taken from materials in the course textbook: Charles Boncelet,
Probability, Statistics, and Random Signals, Oxford University Press, February 2016.
B.J. Bazuin, Spring 2022 33 of 37 ECE 3800
Multiple Gaussian Random Variables
For two Gaussians R.V., X and Y, that are independent: π π₯,π¦ π π₯ β π π¦
π π₯,π¦ππ₯π
π₯ π2 β π
β2π β πβ
ππ₯ππ¦ π2 β π
β2π β π
π π₯,π¦
ππ₯ππ₯ π2 β π
π¦ π2 β π
2π β π β π
πΉ π₯, π¦ πΉ π₯ β πΉ π¦ Ξ¦π₯ ππ
β Ξ¦π¦ ππ
If the Gaussians are zero mean and IID
π π₯, π¦ππ₯π
π₯ π¦2 β π
2π β π1
2π β πβ ππ₯π
π₯ π¦2 β π
If there are multiple zero mean IID Gaussians
π , , ,β―, π₯ , π₯ , π₯ ,β― , π₯1
2π β π β β ππ₯ππ₯ π₯ π₯ β― π₯
2 β π
and for π π π π₯π β― π
π , , ,β―, π₯ , π₯ , π₯ ,β― , π₯1
2π β π β β ππ₯ππ
2 β π
As an interpretation, the pdf is dependent on a βvector lengthβ measurement from the origin of an n-dimensional space. Therefore, the probability function is circularly (or spherically) symmetric.
To βnormalizeβ the symmetrical property we can define a new R.V.
πππ
If both functions have zero mean and identical variances. Note:
π π₯ π₯ π₯ β― π₯
Notes and figures are based on or taken from materials in the course textbook: Charles Boncelet,
Probability, Statistics, and Random Signals, Oxford University Press, February 2016.
B.J. Bazuin, Spring 2022 34 of 37 ECE 3800
Two Correlated Gaussian Random Variables
If two R.V. are jointly Gaussian
π and π
ππ
π β π
π π₯,π¦
ππ₯π 12 β 1 π β
π₯ ππ 2 β π β
π₯ π β π¦ ππ β π
π¦ ππ
2π β π β π β 1 π
π π’, π£ππ₯π 1
2 β 1 π β π’ 2 β π β π’ β π£ π£
2π β 1 π
The conditional probability of U given V becomes (again knowing that they are correlated)
π | π’|π£π π’, π£π π£
π | π’|π£
ππ₯π 12 β 1 π β π’ 2 β π β π’ β π£ π£
2π β 1 π1
β2πβ ππ₯π π£
2
π | π’|π£ππ₯π
π’ 2 β π β π’ β π£ π£2 β 1 π β π£
2
2π β 1 π
π | π’|π£ππ₯π
π’ 2 β π β π’ β π£ π£ π£ β 1 π2 β 1 π
2π β 1 π
π | π’|π£ππ₯π
π’ 2 β π β π’ β π£ π β π£2 β 1 π
2π β 1 π
ππ₯ππ’ π β π£
2 β 1 π
2π β 1 π
The result is a Gaussian with a DC bias and variance both based on the correlation coefficient! In addition, the mean is based on v, but the variance is not!
Notes and figures are based on or taken from materials in the course textbook: Charles Boncelet,
Probability, Statistics, and Random Signals, Oxford University Press, February 2016.
B.J. Bazuin, Spring 2022 35 of 37 ECE 3800
The result can be converted back to terms in X and Y.
However, computing the mean and variance is sufficient in describing X given Y. π π β π π and π π β π π
πΈ π|π π¦ πΈ π β π π |ππ¦ ππ
π π β π β π£
πΈ π|π π¦ πΈ π β π π |ππ¦ ππ
πππ
β π β π¦ π
πΈ π|π π¦ πππβπ
π β πβ π¦ π π
ππ
β π¦ π
πππ π|π π¦ πππ π β π π |ππ¦ ππ
π β 1 π
Notes and figures are based on or taken from materials in the course textbook: Charles Boncelet,
Probability, Statistics, and Random Signals, Oxford University Press, February 2016.
B.J. Bazuin, Spring 2022 36 of 37 ECE 3800
9.7 Digital Communications Using QAM
Digital Communications:
Typically, you need to estimate the signal magnitude and phase information for a βsymbol periodβ.
Phase shift Keying Quadrature Amplitude Modulation
Received symbols involve signal plus noise.
Noise is modeled as a two-dimensional Gaussian R.V. that is independent for each symbol estimated.
Detection regions/thresholds around the βconstellation pointsβ are defined that provide the βestimated symbolβ received.
Received estimates for one QAM transmitted symbol may look like
Notes and figures are based on or taken from materials in the course textbook: Charles Boncelet,
Probability, Statistics, and Random Signals, Oxford University Press, February 2016.
B.J. Bazuin, Spring 2022 37 of 37 ECE 3800
MATLAB simulations of PSK and QAM
MPSK_Demo.m
QAMCFE_Example β must change ED/No level