35
Rafael S. de Souza, on behalf of COIN Cosmostatistics Initiative Catalyzing Interdisciplinarity Artificial Intelligence in Astronomy, ESO, Garching, Germany, 22–26 July 2019

Cosmostatistics Initiative - ESO

  • Upload
    others

  • View
    2

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Cosmostatistics Initiative - ESO

Rafael S. de Souza, on behalf of COIN

Cosmostatistics InitiativeCatalyzing Interdisciplinarity

Artificial Intelligence in Astronomy,ESO, Garching, Germany, 22–26 July 2019

Page 2: Cosmostatistics Initiative - ESO
Page 3: Cosmostatistics Initiative - ESO

Collaboration as a goal by itself

Rafael S. de Souza Alberto Krone-Martins Emille E. O. Ishida

Why not more people?

Page 4: Cosmostatistics Initiative - ESO

Krone-Martins, Ishida & de Souza, MNRASL 443 (2014)

Derived expression:

Atomic operators: +, - , x , / , pow

1 - Construction of an analytical expression from a dictionary

2 - Optimization via genetic algorithm with a sparsity enforcing principle

Time Before Time - Pre-COINSee also Ivan's slides.

Symbolic Regression

Page 5: Cosmostatistics Initiative - ESO
Page 6: Cosmostatistics Initiative - ESO

Team Science Learning

Page 7: Cosmostatistics Initiative - ESO

A worldwide endeavour aimed to foster interdisciplinary collaborations around

Astronomy.

Page 8: Cosmostatistics Initiative - ESO

The Cosmostatistics InitiativeInterdisciplinary science development

The COIN Residence Program(CRP)

✓ Interdisciplinarity

✓ Unstructured organization

✓ People-centric

✓ Ambidextrous: personal + community needs

Page 9: Cosmostatistics Initiative - ESO

Interdisciplinary cross-fertilization

Page 10: Cosmostatistics Initiative - ESO

The COIN Residence Program (CRP)

Step 1 - Choose the peopleStep 2 - Let the project emergeStep 3 - Make the project converge

Page 11: Cosmostatistics Initiative - ESO

Biostatistics

Astrophysics

Machine learning

Cosmology

Statistics

Over 60 researchers from 15 countries

Management model : concepts of startups and meta-studies of interdisciplinary teams.

See e.g. Am J Prev Med. 2008, 35, S96-115. The ecology of team science understanding contextual influences on transdisciplinary collaboration

A worldwide task force

Page 12: Cosmostatistics Initiative - ESO

In 5 years

+ 1 galaxy catalog+ 1 GMM tutorial+ 2 photo-z catalogs

Innovation for interdisciplinary science development

https://cosmostatistics-initiative.org

Page 13: Cosmostatistics Initiative - ESO

Semi-supervised Learning, PCA, KPCA, GLMs applied to photometric redshifts.

Logistic regression applied to cosmological simulations. Similar to ANN, but more interpretable.

Page 14: Cosmostatistics Initiative - ESO

Bayesian LASSO NB under discrete measurement errors probe overdispersed globular cluster data.

First package for likelihood-free inference in Cosmology.

Page 15: Cosmostatistics Initiative - ESO

Non-exhaustive list of techniques employed by COIN

● Binomial, gamma, negative binomial, Hurdle Models, GPs,● Integrated Nested Laplace Approximation, ● Approximate Bayesian Computation, HMC, ● Convolutional Neural Networks, Transfer Learning, Active Learning● Hierarchical Bayesian Models, Symbolic Regression, ● Random Forests, Support Vector Machines, GAMs● PCA, KPCA, ISOMAPs, Self-Organized Maps, Minimum Spanning

Trees, Autoencoders ● Gaussian Mixture Models, K-means, KD-trees● LASSO regularization, Partial Pooling, Population Monte-Carlo,

Propensity Score Matching.

Page 16: Cosmostatistics Initiative - ESO

From COIN Residence Program #2

Page 17: Cosmostatistics Initiative - ESO

Transfer Learning

Initial dataset with SNe Ia near peak had more features than objects.

Transfer learning from spectrums taken in other epochs (usually not used)

Page 18: Cosmostatistics Initiative - ESO

AutoencodersDimensionality reduction

See also Dalya's slides.

Page 19: Cosmostatistics Initiative - ESO

Deep Autoencoder vs

Principal Component reconstruction

Page 20: Cosmostatistics Initiative - ESO

2D visualization of 4D Deep Learning parameter space

Page 21: Cosmostatistics Initiative - ESO
Page 22: Cosmostatistics Initiative - ESO

Recent highlights

Page 23: Cosmostatistics Initiative - ESO

Deep Learning for Deblending

From COIN Residence Program #5, MNRAS, 2019

Page 24: Cosmostatistics Initiative - ESO
Page 25: Cosmostatistics Initiative - ESO

See also Alberto's slides

A&A, 624, A126, 17, 2019

Now you see me: COIN extends the open cluster census in the solar neighborhood with Gaia DR2

Page 26: Cosmostatistics Initiative - ESO

The Team

Page 27: Cosmostatistics Initiative - ESO

Astro-aware statistical learning

Fast density-aware partitioning of the sky via a k-d tree in the spatial domain of Galactic coordinates.

Only meaningful cases are further scrutinized, i.e. low variance in proper motion.

Recommender system

Page 28: Cosmostatistics Initiative - ESO

Astro-aware statistical learning

Bootstrap for measurement uncertainty

Iterative K-means in the space of proper motions.

Sanity check against a random field via minimum spanning trees

Independent expert validation

Page 29: Cosmostatistics Initiative - ESO

COIN-Gaia 1

Page 30: Cosmostatistics Initiative - ESO

COIN-Gaia Open Clusters

We reported the discovery of 41 new

stellar clusters

Page 31: Cosmostatistics Initiative - ESO
Page 32: Cosmostatistics Initiative - ESO

❏ COIN was constructed under the lemma people come first.

❏ The scientific project emerges from a shared group interest.

❏ They are a product of the interaction between a unique group

of people, whose materialisation is only possible in an

environment which profoundly respects the diversity of their

scientific backgrounds, gender, career stages and nationalities.

Page 33: Cosmostatistics Initiative - ESO

https://cosmostatistics-initiative.org

Page 34: Cosmostatistics Initiative - ESO
Page 35: Cosmostatistics Initiative - ESO