Welcome from the TPC chairs

Goal: Quality and Interesting Program- 42 TPC members

- Chosen for topic coverage, junior/senior mixture

- 197 paper submissions (+13% up from IMC 2018) - Emphasis on finding strengths of each submission - Two async review rounds to winnow papers - In-person meeting with all TPC members to discuss

remaining papers - Chosen based on score (quality),

variance (how provocative), and subject (fit)

Forming the Program

Submissions197 papers

(118 full / 79 short)

Second Round94 papers (48%)

In-person Discussion

65 papers (33%)

Accepted39 papers (19.8%)

>=3 reviews

>= +2 reviews

shepherd

Double-blind- First year with blinded submissions (SC change)

- Difficulties blinding submissions in Internet measurement → employ "best-effort" anonymization - Many questions for clarification (e.g., "what if only organization

X has access to the data in my paper?") - Representing continuum of anonymization - But no real problems

- Feedback from authors and reviewers overwhelmingly positive

Ethical Considerations

- Substantial topic of discussion during review

- Otherwise strong technical papers rejected for ethical concerns

- Authors must carefully consider ethical implications and discuss:

- IRB approval is necessary, but often not sufficient

- Ensure individuals are protected

- Balance harm and benefit

I N T E RNE T

ME A SUREMEN T

C ONF E R ENC E

Who Submitted?Other

Asia

Europe

USA

Mix

Commercial

Academia

Geographical Origin

Author Affiliation

I N T E RNE T

ME A SUREMEN T

C ONF E R ENC E

What Was Submitted?

Authors Self-reportedTopics

Significant emphasis on security, web, and platforms

Lots of ML, but high acceptance

bar

Mobile, video, home, or re-appraisal did

not fare well with reviewers

Mobile, video, home, or re-appraisal did

not fare well with reviewers

Mobile, video, home, or re-appraisal did

not fare well with reviewers

I N T E RNE T

ME A SUREMEN T

C ONF E R ENC E

Average versus Variance (Merit)Rejected

Round 2

Accepted

I N T E RNE T

ME A SUREMEN T

C ONF E R ENC E

Score versus Number of Authors

Outliers RemovedGaussian Noise Added

Program CommitteeJohanna Amann Theo Benson Karyn Benson

Zach Bischof Jeremy Blackburn Rocky Chang

Taejoong (Tijay) Chung David Choffnes kc Claffy

Alberto Dainotti Ramakrishna Padmanabhan Ram Durairajan

Zakir Durumeric Roya Ensafi Anja Feldmann

Tobias Fiebig Romain Fontugne Hamed Haddadi

Alex Halderman Oliver Hohlfeld Mobin Javed

Dave Levin Matthew Luckie Olaf Maennel

Priya Mahadevan Jelena Mirkovic Maria Papadopouli

Cristel Pelsser Philipp Richter Michael Schapira

Aaron Schulmann Georgios Smaragdakis Joel Sommers

Gianluca Stringhini Srikanth Sundaresan Narseo Vallina-Rodriguez

Bimal Viswanath Gang Wang Walter Willinger

Christo Wilson Eric Wustrow Bhen Zhao

Most "good review" reviews

Most on-time +Most "good review"

reviews

Award Selection Process- Nominations from the programme committee

- No separate short vs. long award, i.e., no distinctions

- Two awards: - Best paper - best overall paper - Community contribution - best provided dataset or tool

- A small group volunteered to help select: thanks for their service! - Taejoong (Tijay) Chung (Northeastern University) - Dave Levin (University of Maryland) - Georgios Smaragdakis (TU Berlin) - Narseo Vallina-Rodriguez (IMDEA)

Best Paper Award (Nominees)Roll, Roll, Roll Your Root: A Comprehensive Analysis of the First Ever DNSSEC Root KSK Rollover M. Mueller (SIDN and U. Twente), M. Thomas (Verisign), D. Wessels (Verisign), W. Hardaker (USC/ISI), T. Chung (RIT), W. Toorop (NLnet Labs), R. van Rijswijk-Deij (U. Twente and NLnet Labs).

An End-to-End, Large-Scale Measurement of DNS-over-Encryption: How Far Have We Come?C. Lu (Tsinghua U), B. Liu (Tsinghua U), Z Li (UC Irvine), S. Hao (UT Dallas), H. Duan (Tsinghua U), M. Zhang (Tsinghua U), C. Leng (Tsinghua U), Y. Liu (Tsinghua U), Z. Zhang (360 Netlab), J. Wu (Tsinghua U).

Profiling BGP Serial Hijackers: Capturing Persistent Misbehavior in the Global Routing TableC. Testart (MIT), P. Richter (MIT), A. King (CAIDA), A. Dainotti (CAIDA), D. Clark (MIT).

Session 1 (today)

Session 1 (today)

Session 2 (Wednesday)

Best Paper AwardsRoll, Roll, Roll Your Root: A Comprehensive Analysis of the First Ever DNSSEC Root KSK RolloverM. Mueller (SIDN and U. Twente), M. Thomas (Verisign), D. Wessels (Verisign), W. Hardaker (USC/ISI), T. Chung (RIT), W. Toorop (NLnet Labs), R. van Rijswijk-Deij (U. Twente and NLnet Labs).

Profiling BGP Serial Hijackers: Capturing Persistent Misbehavior in the Global Routing Table C. Testart (MIT), P. Richter (MIT), A. King (CAIDA), A. Dainotti (CAIDA), D. Clark (MIT).

a particularly fine example of a well-executed, well-timed paper

wonderful insight that shed surprising new light onto a long-studied, difficult problem

Community Contribution (Nominees)Information Exposure from Consumer IoT Devices: A Multidimensional, Network Informed Measurement Approach J. Ren, D. Dubois, D. Choffnes (Northeastern University), A. Mandalari, R. Kolcun, and H. Haddadi (Imperial College London)

An End-to-End, Large-Scale Measurement of DNS-over-Encryption: How Far Have We Come?C. Lu (Tsinghua U), B. Liu (Tsinghua U), Z Li (UC Irvine), S. Hao (UT Dallas), H. Duan (Tsinghua U), M. Zhang (Tsinghua U), C. Leng (Tsinghua U), Y. Liu (Tsinghua U), Z. Zhang (360 Netlab), J. Wu (Tsinghua U).

Session 2 (Tuesday)

Session 1 (today)

Community Contribution Award

Information Exposure from Consumer IoT Devices: A Multidimensional, Network Informed Measurement Approach J. Ren, D. Dubois, D. Choffnes (Northeastern University), A. Mandalari, R. Kolcun, and H. Haddadi (Imperial College London)

the dataset was timely, has high potential for impact, and was challenging to obtain