55
The Past, Present, and Future of Null Model Analysis in Biogeography Nicholas J. Gotelli Department of Biology University of Vermont Burlington VT 05405 USA

The Past, Present, and Future of Null Model Analysis in ... · PDF fileMake inferences & draw conclusions. MacArthur's ... Null Models As A Benchmark Simberloff ... and Future of Null

Embed Size (px)

Citation preview

Page 1: The Past, Present, and Future of Null Model Analysis in ... · PDF fileMake inferences & draw conclusions. MacArthur's ... Null Models As A Benchmark Simberloff ... and Future of Null

The Past, Present, and Future of Null Model Analysis in Biogeography

Nicholas J. GotelliDepartment of BiologyUniversity of Vermont

Burlington VT 05405 USA

Page 2: The Past, Present, and Future of Null Model Analysis in ... · PDF fileMake inferences & draw conclusions. MacArthur's ... Null Models As A Benchmark Simberloff ... and Future of Null

“The past is never dead. It's not even past”

William Faulkner 1950 Requiem For A Nun

Page 3: The Past, Present, and Future of Null Model Analysis in ... · PDF fileMake inferences & draw conclusions. MacArthur's ... Null Models As A Benchmark Simberloff ... and Future of Null

“Data! Data! Data!” he cried impatiently. “I can't make bricks without clay”.

Sherlock Holmes, The Adventure Of The Copper Breeches Sir Arthur Conan Doyle 1892

Page 4: The Past, Present, and Future of Null Model Analysis in ... · PDF fileMake inferences & draw conclusions. MacArthur's ... Null Models As A Benchmark Simberloff ... and Future of Null

What Is A Null Model?“A null model is a pattern-generating model thatIs based on randomization of ecological data or

random sampling from a known or imagineddistribution...The randomization is designed to

produce a pattern that would he expected in theabsence of a particular ecological mechanism.”

Gotelli & Graves (1996)

Page 5: The Past, Present, and Future of Null Model Analysis in ... · PDF fileMake inferences & draw conclusions. MacArthur's ... Null Models As A Benchmark Simberloff ... and Future of Null

Steps In Null Model Analysis

Define metric X Measure Xobs for empirical data Randomize data, subject to constraints (H0) Calculate Xsim for simulated data Repeat simulation many times (n = 1000) Estimate p(Xobs | H0) Make inferences & draw conclusions

Page 6: The Past, Present, and Future of Null Model Analysis in ... · PDF fileMake inferences & draw conclusions. MacArthur's ... Null Models As A Benchmark Simberloff ... and Future of Null

MacArthur's (1958) Warblers:

Segregation of foraging microhabitats allows for species coexistence.

Page 7: The Past, Present, and Future of Null Model Analysis in ... · PDF fileMake inferences & draw conclusions. MacArthur's ... Null Models As A Benchmark Simberloff ... and Future of Null
Page 8: The Past, Present, and Future of Null Model Analysis in ... · PDF fileMake inferences & draw conclusions. MacArthur's ... Null Models As A Benchmark Simberloff ... and Future of Null

More overlap than expected by chance!!

Page 9: The Past, Present, and Future of Null Model Analysis in ... · PDF fileMake inferences & draw conclusions. MacArthur's ... Null Models As A Benchmark Simberloff ... and Future of Null

The Origins Of Null Model Analysis

Page 10: The Past, Present, and Future of Null Model Analysis in ... · PDF fileMake inferences & draw conclusions. MacArthur's ... Null Models As A Benchmark Simberloff ... and Future of Null

Diamond (1975)

Community assembly rules (checkerboard distributions, incidence functions, forbidden

species combinations)

Page 11: The Past, Present, and Future of Null Model Analysis in ... · PDF fileMake inferences & draw conclusions. MacArthur's ... Null Models As A Benchmark Simberloff ... and Future of Null

Connor & Simberloff (1979)

What patterns would be expected in the absence of competition? (null model randomizations,

probability tests)

Page 12: The Past, Present, and Future of Null Model Analysis in ... · PDF fileMake inferences & draw conclusions. MacArthur's ... Null Models As A Benchmark Simberloff ... and Future of Null

Species/Genus Ratios

Elton (1946): low S/G ratios on islands reflect reduced resources, increased competition among species within a genus

Williams (1947): low S/G ratios are expected based on random sampling – a property of numbers, not of biology

Hairston (1964): S/G ratios might increase because related species have common habitat requirements & dispersal characteristics

Page 13: The Past, Present, and Future of Null Model Analysis in ... · PDF fileMake inferences & draw conclusions. MacArthur's ... Null Models As A Benchmark Simberloff ... and Future of Null

Deeper Roots...

Maillefier (1929) G/S ratios tested with draws from a deck of marked cards. Ordered vs. randomized

diversity accumulation curves

Page 14: The Past, Present, and Future of Null Model Analysis in ... · PDF fileMake inferences & draw conclusions. MacArthur's ... Null Models As A Benchmark Simberloff ... and Future of Null

Null Models As A Benchmark

Simberloff (1970) S/G ratios on islands were actually larger than expected by chance

Page 15: The Past, Present, and Future of Null Model Analysis in ... · PDF fileMake inferences & draw conclusions. MacArthur's ... Null Models As A Benchmark Simberloff ... and Future of Null

“The past is never dead. It's not even past”

William Faulkner 1950 Requiem For A Nun

Page 16: The Past, Present, and Future of Null Model Analysis in ... · PDF fileMake inferences & draw conclusions. MacArthur's ... Null Models As A Benchmark Simberloff ... and Future of Null

The past is never dead...

Community phylogenetics, habitat filtering, niche differentiation

Page 17: The Past, Present, and Future of Null Model Analysis in ... · PDF fileMake inferences & draw conclusions. MacArthur's ... Null Models As A Benchmark Simberloff ... and Future of Null

Technical Criticisms Of Null Models “Not truly null with respect to processes”

(“Narcissus Effect” and other smuggled processes) “Drowns the baby in a tub too deep”

(= “Dilution Effect”) “Not a mechanistic stochastic model”

(contra neutral model, HW Equilibrium) “Circular to use same data for hypothesis

testing and creating null distributions” (standard to condition on marginal variables, as in

contingency table analysis)

Page 18: The Past, Present, and Future of Null Model Analysis in ... · PDF fileMake inferences & draw conclusions. MacArthur's ... Null Models As A Benchmark Simberloff ... and Future of Null

Philosophical Criticisms Of Null Models

“Ecological / biogeographic theory does not generate simple predictions” (perhaps a problem with the theory!!)

“Results depend on the particular null model” (we certainly hope so!)

“Multiple processes are in operation” (test a suite of null models)

“Difficult to program” (perhaps ultimately a feature not a flaw)

Page 19: The Past, Present, and Future of Null Model Analysis in ... · PDF fileMake inferences & draw conclusions. MacArthur's ... Null Models As A Benchmark Simberloff ... and Future of Null

Features Of Null Models

Clarity of Assumptions Tailored to Available Data (= ease of parameter

estimation) Hypothesis Testing Framework Parsimony

Page 20: The Past, Present, and Future of Null Model Analysis in ... · PDF fileMake inferences & draw conclusions. MacArthur's ... Null Models As A Benchmark Simberloff ... and Future of Null

It is interesting to contemplatea tangled bank,

clothed with many plantsof many kinds...

Page 21: The Past, Present, and Future of Null Model Analysis in ... · PDF fileMake inferences & draw conclusions. MacArthur's ... Null Models As A Benchmark Simberloff ... and Future of Null

TangledBank

Fever!!

Page 22: The Past, Present, and Future of Null Model Analysis in ... · PDF fileMake inferences & draw conclusions. MacArthur's ... Null Models As A Benchmark Simberloff ... and Future of Null

A Bivariate Map of Models

Statistical Mechanistic

Simple

Complex

Page 23: The Past, Present, and Future of Null Model Analysis in ... · PDF fileMake inferences & draw conclusions. MacArthur's ... Null Models As A Benchmark Simberloff ... and Future of Null

A Bivariate Map of Models

Statistical Mechanistic

Simple

Complex

t-test

Page 24: The Past, Present, and Future of Null Model Analysis in ... · PDF fileMake inferences & draw conclusions. MacArthur's ... Null Models As A Benchmark Simberloff ... and Future of Null

A Bivariate Map of Models

Statistical Mechanistic

Simple

Complex

t-test

Hierarchical Model

Page 25: The Past, Present, and Future of Null Model Analysis in ... · PDF fileMake inferences & draw conclusions. MacArthur's ... Null Models As A Benchmark Simberloff ... and Future of Null

A Bivariate Map of Models

Statistical Mechanistic

Simple

Complex

t-testNeutralModel

Hierarchical Model

Page 26: The Past, Present, and Future of Null Model Analysis in ... · PDF fileMake inferences & draw conclusions. MacArthur's ... Null Models As A Benchmark Simberloff ... and Future of Null

A Bivariate Map of Models

Statistical Mechanistic

Simple

Complex

t-testNeutralModel

Hierarchical Model

CommunityMatrix

Page 27: The Past, Present, and Future of Null Model Analysis in ... · PDF fileMake inferences & draw conclusions. MacArthur's ... Null Models As A Benchmark Simberloff ... and Future of Null

A Bivariate Map of Models

Statistical Mechanistic

Simple

Complex

t-testNeutralModel

Hierarchical Model

CommunityMatrix

NULL MODELS

Page 28: The Past, Present, and Future of Null Model Analysis in ... · PDF fileMake inferences & draw conclusions. MacArthur's ... Null Models As A Benchmark Simberloff ... and Future of Null

A Bivariate Map of Models

Statistical Mechanistic

Simple

Complex

t-testNeutralModel

Hierarchical Model

CommunityMatrix

NULL MODELS

RANDOMIZATIONTESTS

Page 29: The Past, Present, and Future of Null Model Analysis in ... · PDF fileMake inferences & draw conclusions. MacArthur's ... Null Models As A Benchmark Simberloff ... and Future of Null

A Bivariate Map of Models

Statistical Mechanistic

Simple

Complex

t-testNeutralModel

Hierarchical Model

CommunityMatrix

NULL MODELS

MID-DOMAIN EFFECT

RANDOMIZATIONTESTS

Page 30: The Past, Present, and Future of Null Model Analysis in ... · PDF fileMake inferences & draw conclusions. MacArthur's ... Null Models As A Benchmark Simberloff ... and Future of Null

A Bivariate Map of Models

Statistical Mechanistic

Simple

Complex

t-testNeutralModel

Hierarchical Model

CommunityMatrix

NULL MODELS

MID-DOMAIN EFFECT

COMMUNITY PHYLOGENETICS &

TRAIT ANALYSES

RANDOMIZATIONTESTS

Page 31: The Past, Present, and Future of Null Model Analysis in ... · PDF fileMake inferences & draw conclusions. MacArthur's ... Null Models As A Benchmark Simberloff ... and Future of Null

A Bivariate Map of Models

Statistical Mechanistic

Simple

Complex

t-testNeutralModel

Hierarchical Model

CommunityMatrix

NULL MODELS

MID-DOMAIN EFFECT

COMMUNITY PHYLOGENETICS &

TRAIT ANALYSES

CO-OCCURENCEANALYSIS

RANDOMIZATIONTESTS

Page 32: The Past, Present, and Future of Null Model Analysis in ... · PDF fileMake inferences & draw conclusions. MacArthur's ... Null Models As A Benchmark Simberloff ... and Future of Null

Prevedello et al., in review

Page 33: The Past, Present, and Future of Null Model Analysis in ... · PDF fileMake inferences & draw conclusions. MacArthur's ... Null Models As A Benchmark Simberloff ... and Future of Null
Page 34: The Past, Present, and Future of Null Model Analysis in ... · PDF fileMake inferences & draw conclusions. MacArthur's ... Null Models As A Benchmark Simberloff ... and Future of Null

Current Challenges in Null Model Analysis

Choosing a null model algorithm

Page 35: The Past, Present, and Future of Null Model Analysis in ... · PDF fileMake inferences & draw conclusions. MacArthur's ... Null Models As A Benchmark Simberloff ... and Future of Null

“Isotropic” Null Model

Page 36: The Past, Present, and Future of Null Model Analysis in ... · PDF fileMake inferences & draw conclusions. MacArthur's ... Null Models As A Benchmark Simberloff ... and Future of Null

“Fixed-Fixed” Null Model

Page 37: The Past, Present, and Future of Null Model Analysis in ... · PDF fileMake inferences & draw conclusions. MacArthur's ... Null Models As A Benchmark Simberloff ... and Future of Null

Current Challenges in Null Model Analysis

Choosing a null model algorithm Matrix-wide versus pairwise metrics

Page 38: The Past, Present, and Future of Null Model Analysis in ... · PDF fileMake inferences & draw conclusions. MacArthur's ... Null Models As A Benchmark Simberloff ... and Future of Null

Null Model Analyses of Segregated and Aggregated Species Pairs

Gotelli & Ulrich (2010)

Page 39: The Past, Present, and Future of Null Model Analysis in ... · PDF fileMake inferences & draw conclusions. MacArthur's ... Null Models As A Benchmark Simberloff ... and Future of Null

Current Challenges in Null Model Analysis

Choosing a null model algorithm Matrix-wide versus pairwise metrics Benchmark testing BEFORE empirical analysis

and publication

Page 40: The Past, Present, and Future of Null Model Analysis in ... · PDF fileMake inferences & draw conclusions. MacArthur's ... Null Models As A Benchmark Simberloff ... and Future of Null

Benchmark Testing

Type I error (incorrectly rejecting a true null hypothesis)

Feed the test a series of “random” matrices Incorporate heterogeneity in row and

column totals (~ beta distribution) Type II error (incorrectly accepting a false null hypothesis)

“Progressive noise test”: adding random noise to a structured matrix

“Embedded structure test”: adding a structured sub-matrix to a random matrix

Page 41: The Past, Present, and Future of Null Model Analysis in ... · PDF fileMake inferences & draw conclusions. MacArthur's ... Null Models As A Benchmark Simberloff ... and Future of Null

Future Challenges In Null Model Analysis

Page 42: The Past, Present, and Future of Null Model Analysis in ... · PDF fileMake inferences & draw conclusions. MacArthur's ... Null Models As A Benchmark Simberloff ... and Future of Null

Future Challenges

Big Data The more data, the smaller the p value AIC, likelihood not a solution

GUIs and the failure of imagination Efficient and convenient The “canalisation” of data analysis

Moving from pattern to mechanism

Page 43: The Past, Present, and Future of Null Model Analysis in ... · PDF fileMake inferences & draw conclusions. MacArthur's ... Null Models As A Benchmark Simberloff ... and Future of Null

“Data! Data! Data!” he cried impatiently. “I can't make bricks without clay”.

Sherlock Holmes, The Adventure Of The Copper Breeches Sir Arthur Conan Doyle 1892

Page 44: The Past, Present, and Future of Null Model Analysis in ... · PDF fileMake inferences & draw conclusions. MacArthur's ... Null Models As A Benchmark Simberloff ... and Future of Null

Causes Of Segregated Patterns

Species Interactions Habitat/Climate Associations Dispersal Barriers

Page 45: The Past, Present, and Future of Null Model Analysis in ... · PDF fileMake inferences & draw conclusions. MacArthur's ... Null Models As A Benchmark Simberloff ... and Future of Null

Spatial Test

Climate Test

Pairwise NullModel Analysis

Blois et al., (2014) Ecography

Page 46: The Past, Present, and Future of Null Model Analysis in ... · PDF fileMake inferences & draw conclusions. MacArthur's ... Null Models As A Benchmark Simberloff ... and Future of Null
Page 47: The Past, Present, and Future of Null Model Analysis in ... · PDF fileMake inferences & draw conclusions. MacArthur's ... Null Models As A Benchmark Simberloff ... and Future of Null

Habitats

Species

Barrier

Dispersal Barrier

Habitat Barrier

Both

Diamond

Checkerboard

Page 48: The Past, Present, and Future of Null Model Analysis in ... · PDF fileMake inferences & draw conclusions. MacArthur's ... Null Models As A Benchmark Simberloff ... and Future of Null

Spatial Test

Climate Test

Pairwise NullModel Analysis

Blois et al., (2014) Ecography

Page 49: The Past, Present, and Future of Null Model Analysis in ... · PDF fileMake inferences & draw conclusions. MacArthur's ... Null Models As A Benchmark Simberloff ... and Future of Null

Co-occurrence of fossil woody plant genera

• 106 fossil pollen genera• 527 pollen cores throughout eastern North

America• 21 1000-year time slices, present to late

Quaternery

Page 50: The Past, Present, and Future of Null Model Analysis in ... · PDF fileMake inferences & draw conclusions. MacArthur's ... Null Models As A Benchmark Simberloff ... and Future of Null

Spatial Test

Climate Test

Pairwise NullModel Analysis

Blois et al., (2014) Ecography

Page 51: The Past, Present, and Future of Null Model Analysis in ... · PDF fileMake inferences & draw conclusions. MacArthur's ... Null Models As A Benchmark Simberloff ... and Future of Null
Page 52: The Past, Present, and Future of Null Model Analysis in ... · PDF fileMake inferences & draw conclusions. MacArthur's ... Null Models As A Benchmark Simberloff ... and Future of Null

Spatial Test

Climate Test

Pairwise NullModel Analysis

Blois et al., (2014) Ecography

Page 53: The Past, Present, and Future of Null Model Analysis in ... · PDF fileMake inferences & draw conclusions. MacArthur's ... Null Models As A Benchmark Simberloff ... and Future of Null
Page 54: The Past, Present, and Future of Null Model Analysis in ... · PDF fileMake inferences & draw conclusions. MacArthur's ... Null Models As A Benchmark Simberloff ... and Future of Null

Most associations do not persist through (paleo) time

Page 55: The Past, Present, and Future of Null Model Analysis in ... · PDF fileMake inferences & draw conclusions. MacArthur's ... Null Models As A Benchmark Simberloff ... and Future of Null

The Past, Present, and Future of Null Model Analysis in Biogeography

The Past Taxonomic ratios in biogeography An antidote for “Tangled Bank Fever”

The Present Benchmark testing of null model procedures Classifying patterns of co-occurrence (fossil plants)

The Future Big Data New methods