# Economics 583: Econometric Theory I A Primer on · PDF file Economics 583: Econometric Theory I A Primer on Asymptotics Eric Zivot January 14, 2013. The two main concepts in asymptotic

• View
1

0

Embed Size (px)

### Text of Economics 583: Econometric Theory I A Primer on · PDF file Economics 583: Econometric Theory...

• Economics 583: Econometric Theory I

A Primer on Asymptotics

Eric Zivot

January 14, 2013

• The two main concepts in asymptotic theory that we will use are

• Consistency

• Asymptotic Normality

Intuition

• consistency: as we get more and more data, we eventually know the truth

• asymptotic normality: as we get more and more data, averages of random variables behave like normally distributed random variables

• Motivating Example:

Let1     denote an independent and identically distributed (iid ) random sample with [] =  and var() = 2

We don’t know the probability density function (pdf) (θ) but we know the value of 2

Goal: Estimate the mean value  from the random sample of data, compute 95% confidence interval for  and perform 5% test of 0 :  = 0 vs. 1 :  6= 0

• Remarks

1. A natural question is: how large does  have to be in order for the asymp- totic distribution to be accurate?

2. The CLT is a first order asymptotic approximation. Sometimes higher order approximations are possible.

3. We can useMonte Carlo simulation experiments to evaluate the asymptotic approximations for particular cases.

4. We can often use bootstrap techniques to provide numerical estimates for avar(̂) and confidence intervals. These are alternatives to the analytic formulas derived from asymptotic theory.

• 5. If we don’t know 2 we have to estimate avar(̂) This gives the estimated asymptotic variance

davar(̂) = ̂2  

where ̂2 is a consistent estimate of 2

• Probability Theory Tools

The probability theory tools (theorems) for establishing consistency of estima- tors are

• Laws of Large Numbers (LLNs).

The tools (theorems) for establishing asymptotic normality are

• Central Limit Theorems (CLTs).

A comprehensive reference is White (1994), Asymptotic Theory for Econome- tricians, Academic Press.

• Laws of Large Numbers

Let 1     be a iid random variables with pdf (θ) For a given func- tion  define the sequence of random variables based on the sample

1 = (1)

2 = (12) ...

 = (1    )

Example: Let  ∼ ( 2) so that θ = ( 2) and define

 = ̄ = 1

X =1



Hence, sample statistics may be treated as a sequence of random variables.

• Definition 1 Convergence in Probability

Let 1      be a sequence of random variables. We say that  converges in probability to  which may be a constant or a random variable, and write

 → 

or

 lim →∞ = 

if ∀   0,

lim →∞Pr(| − |  ) = 0

• Remarks

1.  →  is the same as  − 

→ 0

2. For a vector process, Y = (1     ) 0 Y

→ c if  →  for

 =      

• Definition 2 Consistent Estimator

If ̂ is an estimator of the scalar parameter  then ̂ is consistent for  if

̂ → 

If θ̂ is an estimator of the × 1 vector θ then θ̂ is consistent for θ if ̂ → 

for  = 1     

Remark:

All consistency proofs are based on a particular LLN. A LLN is a result that states the conditions under which a sample average of random variables con- verges to a population expectation. There are many LLN results. The most straightforward is the LLN due to Chebychev.

• Chebychev’s LLN

Theorem 1 Chebychev’s LLN

Let 1     be iid random variables with [] =  ∞ and var() = 2 ∞ Then

̄ = 1

X =1

 → [] = 

The proof is based on the famous Chebychev’s inequality.

• Lemma 2 Chebychev’s Inequality

Let  by any random variable with [] =  ∞ and var() = 2 ∞ Then for every   0

Pr(| − | ≥ ) ≤ var() 2

= 2

2

Proof of Chebychev’s LLN

Applying Chebychev’s inequality to ̄ = 1 P =1 gives

Pr(|̄ − | ≥ ) ≤ var(̄) 2

= 2

2

so that

lim →∞Pr(|̄ − | ≥ ) ≤ lim→∞

2

2 = 0

• Remark

The proof of Chebychev’s LLN relies on the concept of convergence in mean square. That is,

MSE(̄ ) = [(̄ − )2] =  2

 → 0 as →∞

In general, if MSE(̄ ) → 0 then ̄ →  However, it may be the case that ̄

→  but MSE(̄ ) 9 0 This would occur, for example, if var() does not exist.

• Recall,

MSE(̄ ) = [(̄ − )2] = bias(̄ )2 + var(̄)

So convergence in MSE implies that as →∞

bias(̄ )2 = ³ [̄]− 

´2→ 0 var(̄) = 

³ ̄ −[̄]

´2→ 0

• Kolmogorov’s and Khinchine’s LLN

The LLN with the weakest set of conditions on the random sample1     is due to Kolmogorov and Khinchine.

Theorem 3 Kolmongorov’s LLN

Let 1     be iid random variables with [||]  ∞ and [] =  Then

̄ = 1

X =1

 → [] = 

• Remark

Kolmogorov’s LLN does not require var() to exist. Only the mean needs to exist. That is, this LLN covers random variables with fat-tailed distributions (e.g., Student’s  with 2 degrees of freedom).

• Markov’s LLN

If we relax the iid assumption then we can still get convergence of the sample mean. However, further assumptions are required on the sequence of random variables 1     For example, a LLN for non iid random variables that is particularly useful is due to Markov.

Theorem 4 Markov’s LLN

Let1     be a sample of uncorrelated random variables with finite means [] =  ∞ and uniformly bounded variances var() = 2 ≤ ∞ for  = 1      Then

̄ − ̄ = 1 

X =1

 − 1

X =1

 = 1

X =1

( − ) → 0

• Remarks:

1. The proof follows directly from Chebychev’s inequality.

2. Sometimes the uniformly bounded variance assumption, var() = 2 ≤  ∞ for  = 1      is stated as

sup 

2 ∞

where sup denotes the supremum or least upper bound.

3. Notice that when the iid assumption is relaxed, stronger restrictions need to be placed on the variances of the random variables. This is a general principle with LLNs. If some assumptions are weakened then other as- sumptions must be strengthened. Think of this as an instance of the no free lunch principle applied to probability theory.

• LLNs for Serially Correlated Random Variables

If we go further and relax the uncorrelated assumption, then we can still get a LLN result. However, we must control the dependence among the random variables. In particular, if  =cov() exists for all   and are close to zero for |− | large; e.g., if

 ≤ · |−| 0    1 and  ∞

then it can be shown that

Pr(|̄ − ̄|  ) ≤  2

→ 0

as →∞ Further details on LLNs for serially correlated random variables will be discussed in the section on time series concepts.

• Theorem 5 Slutsky’s Theorem 1

Let {} and {} be a sequences of random variables and let   and  be constants.

1. If  →  then 

→ 

2. If  →  and 

→  then  +  → + 

3. If  →  and 

→  then  →  provided  6= 0;

→ 

4. If  →  and (·) is a continuous function at  then ()

→ ()

• Example 1 Convergence of the sample variance and standard deviation

Let 1     be iid random variables with [1] =  and var(1) = 2 ∞ Then the sample variance, given by

̂2 = 1

X =1

( − ̄)2

is a consistent estimator for 2; i.e. ̂2 → 2

• Remarks:

1. Notice that in order to prove the consistency of the sample variance we used the fact that the sample mean is consistent for the population mean. If ̄ ##### Economics 583: Econometric Theory I A Primer on Asymptotics · PDF file Economics 583: Econometric Theory I A Primer on Asymptotics Eric Zivot January 14, 2013. ... We can use Monte
Documents ##### Master‘s degree program Master in Economics - · PDF fileApplied empirical health economics ... using STATA® for applied econometric work 6 Learning objectives and skills The students
Documents ##### Long term macro- economics assessment of Latin · PDF filePage 2 Economic forecasts Household projections Risk •Oxford Economics’ Global Economic Model •Econometric analysis
Documents ##### Economics paper 15: innovation and research strategy for ... ... BIS ECONOMICS PAPER NO. 15 Innovation and Research Strategy for Growth ... Research and Development in econometric
Documents ##### Nova School Of Business and Economics - run.unl.pt · PDF fileNova School Of Business and Economics Econometric approach for forecasting stock indices price Author: Angelo Migliorino
Documents ##### Economics 583: Econometric Theory I A Primer on Asymptotics: · PDF file Martingales and Martingale Diﬀerence Sequences Let { } be a sequence of random variables and let { } be a
Documents ##### Part 5: Random Effects [ 1/54] Econometric Analysis of Panel Data William Greene Department of Economics Stern School of Business
Documents ##### ïƒ Economic Data ïƒ Calculus and Economics ïƒ Basics of Economic Models ïƒ Advanced Calculus and Economics ïƒ Statistics and Economics ïƒ Econometric Introduction
Documents ##### Gender question: Econometric answer · PDF file 2020. 12. 27. · Stavytskyy A. et al. ISSN 2071-789X INTERDISCIPLINARY APPROACH TO ECONOMICS AND SOCIOLOGY Economics & Sociology, Vol
Documents ##### Large-N statistical (econometric) analyses in ... · PDF file Large-N statistical (econometric) analyses in environmental economics Sheila Olmstead Associate Professor, LBJ School
Documents ##### Econometric Methods - Encyclopedia of Life Support · PDF fileMATHEMATICAL MODELS IN ECONOMICS – Vol. I - Econometric Methods - Roselyne Joyeux ... The aim of this chapter is to
Documents ##### LEGACY OF FOUR DECADES- MIT IS NOW MIT-WPU · PDF file 2019-12-11 · Microeconomics Managerial Economics Econometric Analysis ... SCHOOL OF ECONOMICS Focus Areas Mini Research Projects
Documents ##### A Macro-econometric Model for the Sudan · PDF file · 2013-02-18Review of Economics & Finance Submitted on 05/Aug./2012 ... This study aims at building a macro-econometric model
Documents ##### Part 9: GMM Estimation [ 1/57] Econometric Analysis of Panel Data William Greene Department of Economics Stern School of Business
Documents ##### Structural Econometric Models: Past and Future (with ... · PDF file Structural Econometric Models: Past and Future (With Special Reference to Agricultural Economics Applications)
Documents ##### Asymptotics Primer - University of Washington · PDF file Asymptotics Primer Econ 583 Econometric Theory I Fall 2008 Consistency of Sample Mean from iid N(0,1) Data Sample Size, T
Documents ##### Tourism economics research: A review and asses in Tourism... · PDF fileTOURISM ECONOMICS RESEARCH: A REVIEW AND ASSESSMENT ... demand, supply, impact, econometric ... Tourism economics
Documents ##### Economics 551-B: ECONOMETRIC METHODS II · PDF fileEconomics 551-B: ECONOMETRIC METHODS II: Professor John Rust This course applies the
Documents ##### [Part 3: Common Effects ] 1/57 Econometric Analysis of Panel Data William Greene Department of Economics Stern School of Business
Documents ##### MATHEMATICAL ECONOMICS AND ECONOMETRIC · PDF file 1.1 Mathematical Economics Mathematical Economics is not a distinct branch of economics in the sense that public finance or international
Documents ##### U of T : Economics : Department of Economics - ... TESTS OF INDEPENDENCE IN SEPARABLE ECONOMETRIC MODELS 3 with the product of its marginal m.g.f.’s, and in (2.4) the comparison
Documents ##### Part 2A: Basic Econometrics [ 1/75] Econometric Analysis of Panel Data William Greene Department of Economics Stern School of Business
Documents ##### Part 12: Random Parameters [ 1/46] Econometric Analysis of Panel Data William Greene Department of Economics Stern School of Business
Documents ##### Harvard Environmental Economics Program · PDF file 1 Several recent papers combine data from randomized experiments with structural econometric methods in development economics, the
Documents ##### Econometric Methods for Labour Economics · PDF file 2020. 6. 22. · Econometric Methods for Labour Economics Stephen Bazen. Econometric Methods for Labour Economics Stephen Bazen
Documents Documents