DWH-Ahsan AbdullahDWH-Ahsan Abdullah

11

Data Warehousing Data Warehousing Lecture-38Lecture-38

Case Study: Agri-Data WarehouseCase Study: Agri-Data Warehouse

Virtual University of PakistanVirtual University of Pakistan

Ahsan AbdullahAssoc. Prof. & Head

Center for Agro-Informatics Researchwww.nu.edu.pk/cairindex.asp

FAST National University of Computers & Emerging Sciences, IslamabadFAST National University of Computers & Emerging Sciences, Islamabad

DWH-Ahsan Abdullah

2

Step-5: Surprise case Step-5: Surprise case

-0.2

-0.15

-0.1

-0.05

0

0.05

0.1

0.15

0.2

0.25

0.3Ja

ssid

Wh

iteF

ly_N

ymp

h

Wh

iteF

ly_A

du

lt

Th

rip

Mit

e

SB

W

AB

W_W

hit

e_E

gg

s

AB

W_B

row

n_E

gg

s

AB

W_L

arva

e_S

mal

l

AB

W_L

arva

e_L

arg

e

PB

W_R

F

PB

W_B

olls

Cor

rela

tion

Ball Worm ComplexSucking pests

SBW: Spotted Ball WormABW: Army Ball WormPBW: Pink Ball Worm

If pest population is low, predator population will also be low, because there will be less “food” for predators to live on i.e. pests.

GraphicsGraphics

DWH-Ahsan Abdullah

3

Step-6: Data Acquisition & Cleansing Step-6: Data Acquisition & Cleansing

Hand filled pest scouting sheet

Typed pest scouting sheet

GraphicsGraphics

DWH-Ahsan Abdullah

4

Step-6: Issues Step-6: Issues

DWH-Ahsan Abdullah

5

Step-6: Why the issues?Step-6: Why the issues?

DWH-Ahsan Abdullah

6

Step-7: Transform, Transport & PopulateStep-7: Transform, Transport & Populate

DWH-Ahsan Abdullah

7

Motivation For TransformationMotivation For Transformation

GraphicsGraphics

DWH-Ahsan Abdullah

8

Step-7: Resolving the issueStep-7: Resolving the issue

GraphicsGraphics

DWH-Ahsan Abdullah

9

Step-8: Middleware ConnectivityStep-8: Middleware Connectivity

DWH-Ahsan Abdullah

10

Step-9-11: Prototyping, Querying & ReportingStep-9-11: Prototyping, Querying & Reporting SELECT Date_of_Visit, AVG(Predators), SELECT Date_of_Visit, AVG(Predators),

…………………………AVG(Dose1+Dose2+Dose3+Dose4)AVG(Dose1+Dose2+Dose3+Dose4)

FROM Scouting_DataFROM Scouting_DataWHERE Date_of_Visit < #12/31/2001# WHERE Date_of_Visit < #12/31/2001#

and predators > 0and predators > 0GROUP BY Date_of_Visit;GROUP BY Date_of_Visit;

GraphicsGraphics

DWH-Ahsan Abdullah

11

Step-12: Deployment & SystStep-12: Deployment & System Managementem Management

DWH-Ahsan Abdullah

12

Agri-DSS usage: Data ValidationAgri-DSS usage: Data Validation

DWH-Ahsan Abdullah

13

Agri-DSS usage: Data Validation GraphAgri-DSS usage: Data Validation Graph

0

2

4

6

8

1007

/06/

01

07/0

9/01

07/1

2/01

07/1

5/01

07/1

8/01

07/2

1/01

07/2

4/01

07/2

7/01

07/3

0/01

08/0

2/01

08/0

5/01

08/0

8/01

08/1

1/01

08/1

4/01

08/1

7/01

08/2

0/01

08/2

3/01

08/2

6/01

08/2

9/01

09/0

1/01

09/0

4/01

09/0

7/01

Predator Spray

ALL goes to graphicsALL goes to graphics

DWH-Ahsan Abdullah

14

Agri-DSS usage: FAO reportAgri-DSS usage: FAO report

DWH-Ahsan Abdullah

15

GraphGraph

Using pesticides to increase yield.

Why negative correlation between yield and pesticides?

GraphicsGraphics

DWH-Ahsan Abdullah

16

Agri-DSS usage: Spray DatesAgri-DSS usage: Spray Dates

DWH-Ahsan Abdullah

17

Agri-DSS usage: Spray Dates Graph Agri-DSS usage: Spray Dates Graph

-0.50

-0.30

-0.10

0.10

0.30

0.50

0.70

0.90

7_23

7_28 8_2

8_7

8_12

8_17

8_22

8_27 9_1

9_6

9_11

9_16

9_21

9_26

10_1

Spray dates (mm_dd) for 2001 & 2002

Re

lati

ve

va

lue

sMoving Avg

Correlation

DWH-Ahsan Abdullah

18

Agri-DSS usage: Explaining FindingsAgri-DSS usage: Explaining Findings

DWH-Ahsan Abdullah

19

Agri-DSS usage: Sowing DatesAgri-DSS usage: Sowing Dates

2001: Sowing week_day

303

405

179 174

431 429398

0

100

200

300

400

500

Mon

Tue

Wed Thu Fri

Sat

Sun

2002: Sowing week_day

367

278

409

124

223

387 357

0

100

200

300

400

500

Mon

Tue

Wed Thu Fri

Sat

Sun

GraphicsGraphics

DWH-Ahsan Abdullah

20

Conclusions & LessonsConclusions & Lessons ETL is a big issue.ETL is a big issue.

Each farmer is repeatedly visitedEach farmer is repeatedly visited

There is a skewness in the scouting data.There is a skewness in the scouting data.

Decision-making goes all the way “down” to Decision-making goes all the way “down” to the extension levelthe extension level. .

All goes to graphicsAll goes to graphics