Office of the Chief Information Officer University of Southern California Researchers and the Petabyte Go Global: Preparing the Next Generation of Innovators

Office of the Chief Information OfficerUniversity of Southern California

Researchers and the Petabyte Go Global: Preparing the Next Generation of Innovators

Peter M. Siegel

CIO and Vice Provost

University of Southern California

January 2014Copyright University of Southern California, with some items copyright their respective owners and used with permission.


Outline

• Key Technologies Are Maturing

• Research Computing Going Mainstream: CASE STUDIES

• Paying Attention to What Matters


• What does it take to make large-scale computing successful—beyond and including IT infrastructure?

• What does it take to enable global research?• How do we help faculty engage students in the

exercise?

Big questions as we (re)think institutional support and investment and identify what really matters…


HPC Performance Keeps Pace

Source: Wikipedia Commons

Gig

aflo

ps!

China takes the lead on peak performance!


Networks Keep PaceRegionally, Nationally, and

Beyond 100 Gigabit Assumed for Research

What is next? Support global “instruments” through effective management based on roles…


The Emergence of Big Data

A New Ecosystem Advanced by

Volume,

Velocity, and

Vision

Some slides and shared ideas, thanks to Patrice Koehl, UC Davis, co-chair Big Data Initiative


Big Data: Volume

Patrice Koehl, UC Davis


Big Data: Velocity



Big Data: Volume, Velocity, and Vision



Big data can be (almost) anywhere…

• Much big data is on government sites.• Consortia share big data on cloud systems.


Big data can be (almost) anywhere….The key is access.

• Much big data is on government sites.• Consortia share big data on cloud systems. • Access to key data requires infrastructure and

security.• Effective access requires advanced software:

• Manipulate, “slice and dice,” analyze.• Don’t simply download.


• Entry Costs Drop for HPC / Big Data Users• Scale and Power Expand Quickly• A Hierarchical, Scalable Model Makes Sense for

Academia

The Conditions Are Ripe for Disruptive Change— Cloud Computing as Part of a Global Infrastructure

CampusCommunity

Vendor

New Hierarchical, Integrated Ecosystem:Departmental Institutional Community Cloud Vendor Cloud


NASA Study (June 2012) concludes:• Cloud computing currently is not a viable solution for

NASA HPC applications, but… • It is catching up fast!

2014? It likely has!

HPC Cloud Options Maturing…


• 156,314 processors at Amazon (AWS)

• Among the top 500 super-computer for 18-hours!

• $33,000

• USC Chemistry Professor Mark Thompson

http://news.cnet.com/8301-1001_3-57611919-92/supercomputing-simulation-employs-156000-amazon-processor-cores/. Credit: Cycle Computing.

http://news.cnet.com/8301-1001_3-57611919-92/supercomputing-simulation-employs-156000-amazon-processor-cores/

http://news.cnet.com/8301-1001_3-57611919-92/supercomputing-simulation-employs-156000-amazon-processor-cores/


Novel Computers May Play a Role…

http://www.dailytech.com/CIA+and+Amazon+Founder+Greedily+Eye+DWaves+Quantum+Computer/article27866.htm

Wikipedia Commons: Dwave Systems


Quantum Computers

USC Center for Quantum Information Science & Technology

Quantum computers are predicted to solve classically intractable tasks such as breaking cryptographic codes, efficiently searching large databases, and efficiently simulating quantum dynamics.

Quantum cryptography offers unconditional security.

Quantum information theory has revolutionized our understanding of the capacity of communication channels.


Technology Summary

• While certainly not ubiquitous, global networks and cloud services provide low-cost ways to create global (or local) consortia.

• Even non-traditional areas have new access to powerful databases.

• Faculty expectations in all disciplines are high.

✓ We must build global instruments now!


CASE STUDIES

The Revolution Is Already Here• Faculty in all fields (building global instruments)• New generation of tools• Research technology makes it possible to manage

& manipulate enormous data sets and share them• Undergraduate access K12 access• Integrated environment within a complex

ecosystem


CASE STUDYUSC Shoah Foundation Institute

Dedicated to making audio-visual interviews with survivors and witnesses of the Holocaust and other genocides a compelling voice for education and action

• 51,696 testimonies in the archive• 33 languages represented from 57 countries• 105,000 hours of testimony• 235,005 master video tapes •9 petabytes and growingSee more at: http://sfi.usc.edu

http://sfi.usc.edu/


Case Study: USC Shoah Foundation InstituteWhy it matters

The video clip from Grace and Vanessa is not available. See http://sfi.usc.edu/news/2013/05/iwitness-adds-eyewitnesses for more information about the USC Shoah Foundation Institute Visual History Archive.

http://sfi.usc.edu/news/2013/05/iwitness-adds-eyewitnesses

http://sfi.usc.edu/news/2013/05/iwitness-adds-eyewitnesses


Building Blocks: The Video Correction Process

Clip from the video available on YouTube: http://www.youtube.com/watch?v=fMcK8fkXnD0&feature=youtu.be

http://www.youtube.com/watch?v=fMcK8fkXnD0&feature=youtu.be


Building Blocks: Preservation




Building Blocks: HPCC




Building Blocks: Research Networking




Case Study: Cinema and Marine Biology

• New generation of high-resolution tools• Radical interdisciplinarity


The Cinema of the Microscopic: A Case Study in Transdisciplinary Vision

Digital Cinema Microscopy

Application of entertainment technology to communicate the micro-arts and sciences to professionals and non-

professionals

• 4k or larger moving image capture, streaming, movie making, and projection of microscopic subjects

• Wide range of applications spanning the micro-world


Streaming Microorganisms

Courtesy of Richard Weinberg, research associate professor, USC School of Cinematic Arts

Video clip not available.


,33,360 x 10,349 pixels

Courtesy of Richard Weinberg, Research Associate ProfessorUSC School of Cinematic Arts


Medicine and Why It Matters:

PEOPLE!


• U.S. healthcare costs: 17.6% of GDP ($2.6 Trillion)• Market “value” of one academic hospital’s EMR data: $1B

[Michael Minear, UCDavis, personal estimate]

• Estimated savings of EMR for U.S.: 12-17% ($300-$450B) • With full system-wide use of EMR tools for intervention, data management,

insight, and prediction[McKinsey and Company:

http://www.mckinsey.com/insights/health_systems_and_services/the_big-data_revolution_in_us_health_care]

• Total digital data stored in health systems worldwide in 2011: • Images: 78 Exabytes (78 * 1018) • Everything: 150 exabytes

• Increasing at 1.2 - 2.4 Exabytes/year[Graham Hughes, MD-- blogs.sas.com]

Medicine: Why It MattersCOSTS

http://www.mckinsey.com/insights/health_systems_and_services/the_big-data_revolution_in_us_health_care


Brain Imaging and Genomics in 26,000 People: The ENIGMA Project

Paul ThompsonProfessor of Neurology, Psychiatry, Radiology, Engineering, & OphthalmologyInstitute for Neuroimaging & Informatics, USC

PI & Co-FounderENIGMA Consortium


Brain Imaging and Genomics in 26,000 People: The ENIGMA Project

• Largest-ever studies of Alzheimer’s Disease, depression, bipolar illness, HIV, childhood brain disease and their treatments

• $140M NIH project• Banking brain images and genomic data of 1000s of people

http://adni.loni.usc.edu

http://adni.loni.usc.edu/


ENIGMA: Finding things that matter








ENIGMA: Global Partnership


Case Study: Undergraduate Education

Clip from the video available at: http://scec.usc.edu/internships/useit/

http://scec.usc.edu/internships/useit/scec-vdo/video2276




Case Study: Undergraduate Education

• Integrate into traditional courses, and• Offer certificates / minors relating to data analytics,

HPC, and visualization• Provide access to same advanced systems

researchers use (not toys)• Meld research experience (REUs) and classroom


CASE STUDY: Real-World ApplicationsWhy They Matter: Saving Lives

• Large-scale computing• Advanced Visualization• Real-world importance of HPC


Collaboratory for Advanced Computing and Simulations (CACS), Professor Priya Vashishta

Nano Bubble Collapse under Shock

Original video not available – other videos from CACS research group available at

http://cacs.usc.edu/videos.php




Nano Bubble Collapse under Shock (Gas)





Concluding Examples: Focusing on What Matters

(No audio)

Non

-opt

imal

so

lutio

n





What Matters: Good Science Saves Lives

Pre

ferr

ed s

olut

ion





Summary – The Revolution Is Already Here!Guide to Investors• Recognize impact on “non-traditional” disciplines• Interdisciplinary collaborations yield results• Focus on building blocks and tools• Data or systems need not be local• Support real access for undergraduates• Build globally, support locally

In short:• Pay attention to what matters


The Revolution Is Already Here!

Conversation and Questions?

Documents

Office of the Chief Information Officer University of Southern California Researchers and the Petabyte Go Global: Preparing the Next Generation of Innovators