72
Demystifying AI, ML, Data Science Date : 7th June 2020 | Speaker : Ayon Roy Visit - AYONROY.ML

D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

  • Upload
    others

  • View
    2

  • Download
    0

Embed Size (px)

Citation preview

Page 1: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

DemystifyingAI, ML, Data Science

Date : 7th June 2020 | Speaker : Ayon Roy

Visit - AYONROY.ML

Page 2: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

Hello Buddy! I am Ayon Roy

B.Tech CSE ( 2017-2021 )

Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Leading Financial Services Company )

Brought Kaggle Days Meetup Community in India for the 1st time

Visit - AYONROY.ML

Page 3: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

● Brief discussion on Career options ● How to start Machine Learning ?● A brief Intro to Data Pre-Processing, Exploratory Data Analysis, Data

Visualization● How to do projects in ML ?● Why should you start Kaggle ?● How to crack Internships ?

Agenda ( 7-6-2020 )

Visit - AYONROY.ML

All the Resource links for the discussion will be shared with you at the end of this webinar by me.

Page 4: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial
Page 5: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

Visit - AYONROY.ML

Page 6: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

Visit - AYONROY.ML

What’s the Current Scenario ?

Page 7: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

Visit - AYONROY.ML

Data is increasing exponentially

Page 8: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

Visit - AYONROY.ML

Page 9: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

Visit - AYONROY.ML

Focus on Optimal Applications, User Experience is also

increasing exponentially

Page 10: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

Visit - AYONROY.ML

Page 11: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

Visit - AYONROY.ML

Page 12: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

Visit - AYONROY.ML

Page 13: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

Visit - AYONROY.ML

What to do now ?

Page 14: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

Visit - AYONROY.ML

In the end, it all just boils down to your personal preference and interest

If you like creating things and building algorithms that have a set outcome where you know what to expect, then competitive programming is right for you.

But if you like the unpredictable, are in love with statistics and trends, and have innate business acumen, then Machine Learning is right for you.

Page 15: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

Visit - AYONROY.ML

How to start Machine Learning

Page 16: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

Visit - AYONROY.ML

Start with Maths for Machine Learning

Page 17: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

Visit - AYONROY.ML

Page 18: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

Visit - AYONROY.ML

But why should I do Maths first for Machine Learning ?

Page 19: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

Visit - AYONROY.ML

Page 20: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

Visit - AYONROY.ML

Page 21: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

Visit - AYONROY.ML

Start with Python &

try to implement those Mathematical Concepts

Page 22: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

Visit - AYONROY.ML

Page 23: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

Visit - AYONROY.ML

Start exploring Libraries& then start Machine

Learning Courses

Page 24: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

Visit - AYONROY.ML

Page 25: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

Visit - AYONROY.ML

Page 26: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

Visit - AYONROY.ML

Don’t rush behind completing Courses & add

them to Resume

Page 27: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

Visit - AYONROY.ML

Understand the concepts well before starting

Projects

Page 28: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

Visit - AYONROY.ML

Page 29: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

Visit - AYONROY.ML

Page 30: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

It is a technique that transforms raw data into an understandable format.

Visit - AYONROY.ML

What is Data Pre-Processing ?

Page 31: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

Why do we need it ?Raw data ( Real world data ) is always messy and that data cannot be sent through a model. That would cause certain errors.

So we need to preprocess data before sending through further analysis.

Visit - AYONROY.ML

Page 32: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

Visit - AYONROY.ML

Page 33: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

Visit - AYONROY.ML

Steps to be followed

Page 34: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

Visit - AYONROY.ML

Get the data & Import the Libraries

Page 35: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

Visit - AYONROY.ML

Read the data

Page 36: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

Visit - AYONROY.ML

Checking the Missing Values

Page 37: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

Visit - AYONROY.ML

Replacing the Missing Values

Page 38: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

Visit - AYONROY.ML

Standardizing the data

Page 39: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

Visit - AYONROY.ML

Data Splitting

Page 40: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

Visit - AYONROY.ML

Exploratory Data Analysis

Page 41: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

Visit - AYONROY.ML

A critical process of performing initial investigations on data so as to discover patterns,to spot anomalies,to test hypothesis

and to check assumptions with the help of summary statistics and graphical representations.

What is Exploratory Data Analysis ?

Page 42: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

Why do we need it ?1. Detection of mistakes & missing data2. Checking of assumptions 3. Preliminary selection of appropriate models 4. Determining relationships among the explanatory variables

With EDA, we can make sense of the data we have and then figure out what questions we want to ask and how to frame them

Visit - AYONROY.ML

Page 43: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

Visit - AYONROY.ML

Major Steps to be followed

Page 44: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

Visit - AYONROY.ML

Import the Libraries

Page 45: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

Visit - AYONROY.ML

Check the type of Data

Page 46: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

Visit - AYONROY.ML

Dropping Irrelevant Columns

Page 47: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

Visit - AYONROY.ML

Renaming the Columns

Page 48: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

Visit - AYONROY.ML

Removing the Duplicates

Page 49: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

Visit - AYONROY.ML

Detecting the Outliers

Page 50: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

Plotting different features

Visit - AYONROY.ML

Page 51: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

Correlation Matrix etc.

Visit - AYONROY.ML

Page 52: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

Visit - AYONROY.ML

What’s Data Visualization ?Data visualization is the graphical representation of information and data.

By using visual elements like charts, graphs, and maps, data visualization tools provide an accessible way to see and understand trends, outliers, and patterns in data.

Page 53: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

Difft. Types of Data Visualization methods

Visit - AYONROY.ML

Charts ->

Plots ->

Page 54: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

Difft. Types of Data Visualization methods

Visit - AYONROY.ML

Maps ->

Trees & Matrix ->

Page 55: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

Visit - AYONROY.ML

ButWhat projects to start with

?

Page 56: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

Visit - AYONROY.ML

Page 57: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

Visit - AYONROY.ML

Page 58: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

Visit - AYONROY.ML

Page 59: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

Visit - AYONROY.ML

Page 60: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

Visit - AYONROY.ML

Page 61: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

Visit - AYONROY.ML

What is Kaggle & why to start it ?

Page 62: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

Visit - AYONROY.ML

Kaggle is an ecosystem for doing and sharing Data Science stuffs.

Kernels is a cloud computational environment that enables reproducible and collaborative analysis.

Datasets is what you need. Whether it is CSVs/tabular data, or you are looking for an image data, or you are interested in NLP and speech and looking for those datasets, everything is here.

Discussions is a great place to ask questions, answer questions and interact with the community.

Competitions involve a very friendly community that is there to work on a problem statement by using start of the art concepts.

Page 63: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

1. Steep learning curve: Participating on Kaggle provides much more wider range of learning than you will find anywhere else online. People come up with great ideas and share the ideas in a public kernel.

2. Variety in problem sets: You will easily find data related to almost every field in data science and machine learning on Kaggle. One single place to get your hands dirty in every area.

3. An awesome community: The true power of Kaggle comes from its community. The people there are really helpful and they try to help you in every aspect without judging you for a second.

Why you should start Kaggling?

Page 64: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

Where to get guided for starting with Kaggle?

This tab contains free, practical, hands-on courses that cover the minimum prerequisites needed to quickly get started in the field. The best thing about

them? — everything is done using Kaggle’s kernels (described above). This means that you can interact and learn

Page 65: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

Visit - AYONROY.ML

How to Crack Internships ?

Page 66: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

Visit - AYONROY.ML

Page 67: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

Visit - AYONROY.ML

ButNo CONTENT found !!

As it will be a DISCUSSION

Page 68: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

Visit - AYONROY.ML

Page 69: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

Visit - AYONROY.ML

Get the resources at

1. https://github.com/ayonroy2000/100DaysOfMLCode2. http://bit.do/aroy 3. https://www.linkedin.com/in/ayonroy2000/

Page 70: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

Visit - AYONROY.ML

Page 71: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

Let me answer your Questions now.

Finally, it’s your time to speak.

Visit - AYONROY.ML

Page 72: D emystifying AI, ML, Data Science · Hello Buddy! I am Ayon Roy B.Tech CSE ( 2017-2021 ) Data Science Intern @ Lulu International Exchange, Abu Dhabi ( World’s Le ading Financial

Danke ScheonQuestions ? Any Feedbacks ? Did you like the talk?

Tell me about it.

If you think I can help you, connect with me via

Email : [email protected] LinkedIn / Github / Telegram Username : @ayonroy2000Website : https://ayonroy.ml/