44
Alligators and Parallel Computing: An Undergraduate Research Experience By Jesse Goncalves

Alligators and Parallel Computing: An Undergraduate ...stellar.cct.lsu.edu/pubs/goncalves_reu_presentation_01.19.18.pdf · What is an REU? Research Experiences for Undergraduates

  • Upload
    others

  • View
    4

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Alligators and Parallel Computing: An Undergraduate ...stellar.cct.lsu.edu/pubs/goncalves_reu_presentation_01.19.18.pdf · What is an REU? Research Experiences for Undergraduates

Alligators and Parallel Computing: An Undergraduate Research ExperienceBy Jesse Goncalves

Page 2: Alligators and Parallel Computing: An Undergraduate ...stellar.cct.lsu.edu/pubs/goncalves_reu_presentation_01.19.18.pdf · What is an REU? Research Experiences for Undergraduates

Overview

◎Applying for REUs

◎My research

◎My experience

Page 3: Alligators and Parallel Computing: An Undergraduate ...stellar.cct.lsu.edu/pubs/goncalves_reu_presentation_01.19.18.pdf · What is an REU? Research Experiences for Undergraduates

Applying for REUs

Page 4: Alligators and Parallel Computing: An Undergraduate ...stellar.cct.lsu.edu/pubs/goncalves_reu_presentation_01.19.18.pdf · What is an REU? Research Experiences for Undergraduates

What is an REU?◎ Research Experiences for Undergraduates

◎ Funded by the National Science Foundation (NSF)

◎ Hosted by universities and other institutions

◎ Undergraduates work with professors and other researchers

◎ Students are granted stipends and (often) assisted with travel and housing

Page 5: Alligators and Parallel Computing: An Undergraduate ...stellar.cct.lsu.edu/pubs/goncalves_reu_presentation_01.19.18.pdf · What is an REU? Research Experiences for Undergraduates

Finding REU Programs

◎NSF website

◎MathPrograms.Org

◎University websites

Page 6: Alligators and Parallel Computing: An Undergraduate ...stellar.cct.lsu.edu/pubs/goncalves_reu_presentation_01.19.18.pdf · What is an REU? Research Experiences for Undergraduates
Page 7: Alligators and Parallel Computing: An Undergraduate ...stellar.cct.lsu.edu/pubs/goncalves_reu_presentation_01.19.18.pdf · What is an REU? Research Experiences for Undergraduates
Page 8: Alligators and Parallel Computing: An Undergraduate ...stellar.cct.lsu.edu/pubs/goncalves_reu_presentation_01.19.18.pdf · What is an REU? Research Experiences for Undergraduates
Page 9: Alligators and Parallel Computing: An Undergraduate ...stellar.cct.lsu.edu/pubs/goncalves_reu_presentation_01.19.18.pdf · What is an REU? Research Experiences for Undergraduates
Page 10: Alligators and Parallel Computing: An Undergraduate ...stellar.cct.lsu.edu/pubs/goncalves_reu_presentation_01.19.18.pdf · What is an REU? Research Experiences for Undergraduates

General Application Requirements

◎ CV/resume

◎ Official or unofficial transcripts

◎ 1-2 letters of recommendation

◎ Statement of interest/relevant experience

Page 11: Alligators and Parallel Computing: An Undergraduate ...stellar.cct.lsu.edu/pubs/goncalves_reu_presentation_01.19.18.pdf · What is an REU? Research Experiences for Undergraduates

General Application Tips

◎ Find a specific project, or multiple projects, you are interested in at a particular site; read descriptions of projects on the university’s website and look at the posters of previous participants

◎ On your application, indicate a special interest in that project and give reasons for your interest, such as connections to past experience

◎ Make a connection with a faculty member involved in the REU program, perhaps by asking them a question

Page 12: Alligators and Parallel Computing: An Undergraduate ...stellar.cct.lsu.edu/pubs/goncalves_reu_presentation_01.19.18.pdf · What is an REU? Research Experiences for Undergraduates

Research

Page 13: Alligators and Parallel Computing: An Undergraduate ...stellar.cct.lsu.edu/pubs/goncalves_reu_presentation_01.19.18.pdf · What is an REU? Research Experiences for Undergraduates

Leveraging HPX on a Raspberry Pi ClusterMentor: Dr. Hartmut Kaiser

Page 14: Alligators and Parallel Computing: An Undergraduate ...stellar.cct.lsu.edu/pubs/goncalves_reu_presentation_01.19.18.pdf · What is an REU? Research Experiences for Undergraduates

What is HPX?◎High Performance ParalleX

○ A C++ library and runtime system for

parallel computing

○ Developed by the STE||AR Group, an

international team of researchers of

which my mentor, Dr. Kaiser, is a

member

Page 15: Alligators and Parallel Computing: An Undergraduate ...stellar.cct.lsu.edu/pubs/goncalves_reu_presentation_01.19.18.pdf · What is an REU? Research Experiences for Undergraduates

What is parallel computing?◎Parallel computing = multiple processes

occur simultaneously

Problem Instructions

CPU

CPU

CPU

CPU

Page 16: Alligators and Parallel Computing: An Undergraduate ...stellar.cct.lsu.edu/pubs/goncalves_reu_presentation_01.19.18.pdf · What is an REU? Research Experiences for Undergraduates

Why HPX?◎HPX addresses limitations of industry

standard parallel computing APIs

through:

○ Fine-grained parallelism

○ Dependency tracking

○ Latency hiding

Page 17: Alligators and Parallel Computing: An Undergraduate ...stellar.cct.lsu.edu/pubs/goncalves_reu_presentation_01.19.18.pdf · What is an REU? Research Experiences for Undergraduates

What is a Raspberry Pi?

A tiny computer designed for beginners to experiment with programming

Page 18: Alligators and Parallel Computing: An Undergraduate ...stellar.cct.lsu.edu/pubs/goncalves_reu_presentation_01.19.18.pdf · What is an REU? Research Experiences for Undergraduates

My Project◎ Compile HPX and its dependencies for

Raspberry Pi

◎Write parallel and distributed HPX applications that estimate the value of pi with monte carlo simulations

◎ Assemble a Raspberry Pi cluster

◎Measure the scalability of HPX applications on the cluster by varying the number of cores and nodes being used

Page 19: Alligators and Parallel Computing: An Undergraduate ...stellar.cct.lsu.edu/pubs/goncalves_reu_presentation_01.19.18.pdf · What is an REU? Research Experiences for Undergraduates

Why?◎To show that HPX ports to the Pi, one

of the simplest computer architectures

◎To show that HPX can expose the benefits of parallel and distributed hardware structures on these computers

Page 20: Alligators and Parallel Computing: An Undergraduate ...stellar.cct.lsu.edu/pubs/goncalves_reu_presentation_01.19.18.pdf · What is an REU? Research Experiences for Undergraduates

Math Sidenote: Estimating Pi with Monte Carlo Simulations◎ Generate uniformly distributed random numbers between 0 and

1 and group them into coordinate pairs

◎ Classify each coordinate pair based on whether it lies within the

quarter of the unit circle that lies in the first quadrant

◎ The number of points inside

the circle divided by the total

number of points ≅ the area

of the quarter circle (A)

◎ Since A = 𝝿 / 4, then 𝝿 ≅ the

estimate of A times 4

Page 21: Alligators and Parallel Computing: An Undergraduate ...stellar.cct.lsu.edu/pubs/goncalves_reu_presentation_01.19.18.pdf · What is an REU? Research Experiences for Undergraduates

Challenges

◎Compiling HPX and its dependencies for

the Raspberry Pi

◎Parallel random number generation

◎Assembling the Pi cluster

Page 22: Alligators and Parallel Computing: An Undergraduate ...stellar.cct.lsu.edu/pubs/goncalves_reu_presentation_01.19.18.pdf · What is an REU? Research Experiences for Undergraduates

Results

The Pi Cluster*

Page 23: Alligators and Parallel Computing: An Undergraduate ...stellar.cct.lsu.edu/pubs/goncalves_reu_presentation_01.19.18.pdf · What is an REU? Research Experiences for Undergraduates

ResultsHPX Parallel Scaling

Number of Cores

MillionsOfTrialsPerSecond

Page 24: Alligators and Parallel Computing: An Undergraduate ...stellar.cct.lsu.edu/pubs/goncalves_reu_presentation_01.19.18.pdf · What is an REU? Research Experiences for Undergraduates

ResultsHPX Distributed Scaling

Number of Nodes

MillionsOfTrialsPerSecond

Page 25: Alligators and Parallel Computing: An Undergraduate ...stellar.cct.lsu.edu/pubs/goncalves_reu_presentation_01.19.18.pdf · What is an REU? Research Experiences for Undergraduates
Page 26: Alligators and Parallel Computing: An Undergraduate ...stellar.cct.lsu.edu/pubs/goncalves_reu_presentation_01.19.18.pdf · What is an REU? Research Experiences for Undergraduates

Discussion◎ HPX ports to even the simplest computer

architectures

◎ The HPX monte carlo applications scale very

efficiently on the Pi cluster, comparable to their

scaling on the Rostam supercomputer

◎ Given more time, further demonstrations of the

scalability of HPX applications on the Raspberry Pi

platform would be in order

Page 27: Alligators and Parallel Computing: An Undergraduate ...stellar.cct.lsu.edu/pubs/goncalves_reu_presentation_01.19.18.pdf · What is an REU? Research Experiences for Undergraduates

Experience

Page 28: Alligators and Parallel Computing: An Undergraduate ...stellar.cct.lsu.edu/pubs/goncalves_reu_presentation_01.19.18.pdf · What is an REU? Research Experiences for Undergraduates
Page 29: Alligators and Parallel Computing: An Undergraduate ...stellar.cct.lsu.edu/pubs/goncalves_reu_presentation_01.19.18.pdf · What is an REU? Research Experiences for Undergraduates
Page 30: Alligators and Parallel Computing: An Undergraduate ...stellar.cct.lsu.edu/pubs/goncalves_reu_presentation_01.19.18.pdf · What is an REU? Research Experiences for Undergraduates
Page 31: Alligators and Parallel Computing: An Undergraduate ...stellar.cct.lsu.edu/pubs/goncalves_reu_presentation_01.19.18.pdf · What is an REU? Research Experiences for Undergraduates
Page 32: Alligators and Parallel Computing: An Undergraduate ...stellar.cct.lsu.edu/pubs/goncalves_reu_presentation_01.19.18.pdf · What is an REU? Research Experiences for Undergraduates
Page 33: Alligators and Parallel Computing: An Undergraduate ...stellar.cct.lsu.edu/pubs/goncalves_reu_presentation_01.19.18.pdf · What is an REU? Research Experiences for Undergraduates
Page 34: Alligators and Parallel Computing: An Undergraduate ...stellar.cct.lsu.edu/pubs/goncalves_reu_presentation_01.19.18.pdf · What is an REU? Research Experiences for Undergraduates
Page 35: Alligators and Parallel Computing: An Undergraduate ...stellar.cct.lsu.edu/pubs/goncalves_reu_presentation_01.19.18.pdf · What is an REU? Research Experiences for Undergraduates
Page 36: Alligators and Parallel Computing: An Undergraduate ...stellar.cct.lsu.edu/pubs/goncalves_reu_presentation_01.19.18.pdf · What is an REU? Research Experiences for Undergraduates
Page 37: Alligators and Parallel Computing: An Undergraduate ...stellar.cct.lsu.edu/pubs/goncalves_reu_presentation_01.19.18.pdf · What is an REU? Research Experiences for Undergraduates
Page 38: Alligators and Parallel Computing: An Undergraduate ...stellar.cct.lsu.edu/pubs/goncalves_reu_presentation_01.19.18.pdf · What is an REU? Research Experiences for Undergraduates
Page 39: Alligators and Parallel Computing: An Undergraduate ...stellar.cct.lsu.edu/pubs/goncalves_reu_presentation_01.19.18.pdf · What is an REU? Research Experiences for Undergraduates
Page 40: Alligators and Parallel Computing: An Undergraduate ...stellar.cct.lsu.edu/pubs/goncalves_reu_presentation_01.19.18.pdf · What is an REU? Research Experiences for Undergraduates
Page 41: Alligators and Parallel Computing: An Undergraduate ...stellar.cct.lsu.edu/pubs/goncalves_reu_presentation_01.19.18.pdf · What is an REU? Research Experiences for Undergraduates
Page 42: Alligators and Parallel Computing: An Undergraduate ...stellar.cct.lsu.edu/pubs/goncalves_reu_presentation_01.19.18.pdf · What is an REU? Research Experiences for Undergraduates
Page 43: Alligators and Parallel Computing: An Undergraduate ...stellar.cct.lsu.edu/pubs/goncalves_reu_presentation_01.19.18.pdf · What is an REU? Research Experiences for Undergraduates
Page 44: Alligators and Parallel Computing: An Undergraduate ...stellar.cct.lsu.edu/pubs/goncalves_reu_presentation_01.19.18.pdf · What is an REU? Research Experiences for Undergraduates

Thanks!

Any questions?Contact info:[email protected]