25
1 © Copyright 2014 EMC Corporation. All rights reserved. © Copyright 2014 EMC Corporation. All rights reserved. Massively Parallel Processing with Procedural Python Shikhar Pandey, Data Science Engineer, EMC IT

Massively Parallel Processing with Procedural Python - Pivotal HAWQ

Embed Size (px)

DESCRIPTION

Massively Parallel Processing with Procedural Python - Pivotal HAWQ

Citation preview

  • 1. 1 Copyright 2014 EMC Corporation. All rights reserved.Massively Parallel Processing with Procedural PythonShikhar Pandey, Data Science Engineer, EMC IT

2. 2 Copyright 2014 EMC Corporation. All rights reserved.SERVICE PROVIDERENTERPRISE DATA CENTERA Unique Federation Of CompaniesDelivering The Software-Defined Enterprise. Solutions & Choice.BIG DATA SOLUTIONSPLATFORM AS A SERVICEAGILE APPLICATION DEVELOPMENTENTERPRISE MOBILITYSOFTWARE-DEFINED DATA CENTERINFORMATION INFRASTRUCTURECONVERGED INFRASTRUCTUREADVANCED SECURITYPartnersvCloud Hybrid ServicevCloud Hybrid Service 3. 3 Copyright 2014 EMC Corporation. All rights reserved.How the EMC Federation Helps Our Third Platform JourneySecureIDAxMAdaptive AuthDLPvSphere, vCloudVMWare ViewWorkspaceAirwatchApp, Data and Cloud Fabric: Spring TC, Batch, Integration, Web Services, Greenplum DB, Pivotal HD, Gem XDVMAX, VNX, XIOAtmos, IsilonViPR, SyncplicityDocumentum XCP 4. 4 Copyright 2014 EMC Corporation. All rights reserved.About Pivotal: 5. 5 Copyright 2014 EMC Corporation. All rights reserved.Open Source in Pivotal 6. 6 Copyright 2014 EMC Corporation. All rights reserved.Pivotals Open Source Contributions 7. 7 Copyright 2014 EMC Corporation. All rights reserved.Typical Engagement Tech Setup 8. 8 Copyright 2014 EMC Corporation. All rights reserved.MPP Architectural Overview 9. 9 Copyright 2014 EMC Corporation. All rights reserved.Pivotal HAWQ Architecture 10. 10 Copyright 2014 EMC Corporation. All rights reserved. 11. 11 Copyright 2014 EMC Corporation. All rights reserved.Intro to PL/Python 12. 12 Copyright 2014 EMC Corporation. All rights reserved.Returning Results 13. 13 Copyright 2014 EMC Corporation. All rights reserved.Returning more Results 14. 14 Copyright 2014 EMC Corporation. All rights reserved.Accessing Packages 15. 15 Copyright 2014 EMC Corporation. All rights reserved.Benefits of PL/Python 16. 16 Copyright 2014 EMC Corporation. All rights reserved. 17. 17 Copyright 2014 EMC Corporation. All rights reserved.Going Beyond Data Parallelism 18. 18 Copyright 2014 EMC Corporation. All rights reserved.MADlib In-Database Functions 19. 19 Copyright 2014 EMC Corporation. All rights reserved. 20. 20 Copyright 2014 EMC Corporation. All rights reserved.In-Database Image Processing 21. 21 Copyright 2014 EMC Corporation. All rights reserved.Image Smoothing 22. 22 Copyright 2014 EMC Corporation. All rights reserved.Pivotal GNIP Decahose Pipeline 23. 23 Copyright 2014 EMC Corporation. All rights reserved.Transport Disruption Prediction Pipeline 24. 24 Copyright 2014 EMC Corporation. All rights reserved.Get in Touchhttp://in.linkedin.com/in/shikharpandey/@shikharpandeyjihttps://github.com/shikharateverest