View
10
Download
0
Category
Preview:
Citation preview
30M CROPLAND ACCURACY
ASSESSMENT
Kamini Yadav
Dr. Russell G. Congalton
August 15-17, 2017
Accuracy Assessment Status30m Resolution Cropland Maps
Continent TM RD SS IEM REV FEM
United States C C C C C C
Australia C C C C C C
South America C C C C C C
China C C C C C C
Africa C C C C C C
Europe C C C C C C
Canada C C C C C C
Mexico C C C C C C
New Zealand C C C C C C
SE Asia C C C C C C
Mongolia C C C C C C
Central America C C C C C C
Alaska, Iceland, Hawaii C C C C C C
South Asia C C C C C C
TM-Thematic Map
RD- Reference Data
SS- Sampling Scheme
IEM- Initial Error Matrix
REV- Review
FEM- Final Error Matrix
NA-Not Applicable
C- Complete
IP- In Progress
YS- Yet to be scheduled 2
Accuracy Assessment – A Quick Review
• Reference Data Collection• Sampling• Producing the Error Matrix
– Overall, producer’s and user’s accuracies– % of cropland area in AEZ– % of cropland area in the continent– Weighted vs. unweighted continental analysis
• Other Measures of Similarity– Difference image– Similarity Matrix– Comparison of summary statistics, e.g., area
3
Reference Data
• Existing data sets– e.g., CDL in US, AAFC in Canada
• Ground collected data– Global Croplands app
– Team member efforts – Murali, Pardha, Adam, & others
• Croplands.org– Samples interpreted worldwide from VHRI
• Some used for training/testing by mapping teams and the rest put aside for use in independent validation
• UNH Team – Random samples interpreted as needed from VHRI
4
Sampling
• Understanding:
– probability
– stratification
– the population
– sampling distribution/density
– the sample size
– the sample unit
5
Sample vs. Total Enumeration
• Why sample?– Can not afford to collect ground data everywhere.
– Do not have the time to collect ground data everywhere.
• Good to compare to a total enumeration, but remember that these total enumerations are subject to error themselves.
• So, sample must be large enough to be valid and statistically sound without bias.
6
Stratification
• Use AEZs to divide continents into reasonable mapping areas.
• We sample in proportion to the size of each strata (crop vs. no crop) within each AEZ– Where do we get these proportions?
– Any estimate we choose is subject to some error.
– Some AEZs have near equal areas of crop and NC. Others are less equally distributed.
– If sample in proportion to strata size, some AEZ will have very few crop samples. If small crop area, map will tend to have more error mapping crop.
7
Africa: Zone 7
Canada: Zone 1
Europe: Zone 7
Europe: Zone 5
Canada: Zone 3 South America: Zone 1
Examples of Low Cropland Zones
8
Actual vs. Expected Samples from
Cropland Area ProportionsAfrica
# Expected
crop samples
# crop samples
in the EM
Zone 1 9 47
Zone 2 20 29
Zone 3 71 39
Zone 4 8 9
Zone 5 39 49
Zone 6 24 26
Zone 7 14 8
ChinaChina East 169 144
West A 7 13
West B 2 8
South AsiaZone 1 56 59
Zone 2 9 12
Zone 3 108 151
Zone 4 144 164
Zone 5 157 140
Zone 6 10 31
SEAsiaZone 1 79 96
Zone 2 78 56
Zone 3 77 67
Zone 4 62 71
Zone 5 108 102
Zone 6 14 12
Zone 7 36 57
South America# Expected crop
samples
# crop samples
in the EM
Zone 1 5 6
Zone 2 34 30
Zone 3 56 49
Zone 4 41 44
Zone 5 23 26
MongoliaZone 1 0 0
Zone 2 0 1
Zone 3 10 15
CanadaZone 1 2 1
Zone 2 54 62
Zone 3 9 6
USZone 4 31 21
Zone 5 24 26
Zone 6 66 63
Zone 7 13 13
Zone 8 107 98
Zone 9 37 26
Zone 10 18 45
Zone 11 68 58
Zone 12 15 24
MexicoZone 13 9 12
Zone 14 25 67
Zone 15 18 20
Zone 16 62 58
Zone 17 52 25
Zone 18 70 50
Central America# Expected
crop samples
# crop samples
in the EM
Zone 19 80 69
Zone 20 50 52
Cuba, Car Is, DR, Hawaii, and
AlaskaZone 21 37 77
Zone 22 48 74
Zone 23 7 43
Zone 24 41 40
Zone 25 0 4
Europe
Zone 1 166 169
Zone 2 151 157
Zone 3 143 164
Zone 4 150 166
Zone 5 14 37
Zone 6 93 97
Zone 7 5 9
Zone 8 24 41
Zone 9 49 40
9
Population
Population (area mapped)
Area of sampling
Population (area mapped)
Area of sampling=
Do not sample beyond population May buffer to constrain population
Optimal situation 10
Sample Size
GOAL: As few as possible, but as many as necessary!
Accuracy
Sample Size
10 25 50 100 300
11
Assessment Zones vs. Continent AreaContinent Area (Mha) Zones
North America including US, Canada, Mexico, and Central
America, Cuba, Car Is, DR Haiti
2,190.7 25
❖ United States 13.35 9
❖ Canada 10.86 3
❖ Mexico 2.36 6
❖ Central America 0.68 2
❖ Cuba, Car Islands, DR Haiti, Alaska, and Hawaii 64.67 5
❖ Iceland 0.17 1
South America 20.60 5
SE Asia 6.21 7
Africa 33.31 7
Mongolia 2.28 3
New Zealand 26.3 2
China 14.86 3
Europe, Russia, Mid East, UK/Ireland 3,076 9
South Asia 861.64 6
Australia 768.7 2
Total 7,000.60 69 12
Africa: 7 ZonesValidation Samples, n =1750 in 7
Zones (250 per zone)
Landsat 30-m Cropland Areas of Africa
for nominal year 2015
13
Summary of Results
• 250 samples generated for original AEZs could not be used for new
mapping zones because of insufficient sample size in some of the new
zones
• Therefore, only cropland.org samples were used with a sample size of
250 for each region
• Zone 1 had unexpected result and was further analyzed - still had same
result with another set of samples
• Zone 7 had 190 samples only. Therefore, supplemented by 60 more
samples
• Zone 7 had fewer crop samples than expected. Was further analyzed
with repeated samples. In all cases, producer’s and user’s accuracies
were low.
14
Africa: Error MatricesReference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 43 5 48 89.6%
No-Crop 4 198 202 98.0%
Total 47 203 250
Producer Accuracy 91.5% 97.5% 96.4%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 21 8 29 72.4%
No-Crop 8 213 221 96.4%
Total 29 221 250
Producer Accuracy 72.4% 96.4% 93.6%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 37 21 58 63.8
No-Crop 2 190 192 99.0%
Total 39 211 250
Producer Accuracy 94.9% 90.1% 90.8%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 8 7 15 NA (53.3%)
No-Crop 1 234 235 99.6%
Total 9 241 250
Producer Accuracy NA (88.9%) 97.1% 96.8%
Total land area of Zone 1 (TLAZ1): 738.09 Mha
Cropland as % of TLAZ1: 3.46%
Total net cropland area of Africa (TCAA) = 313 Mha
Cropland as % of TCAA: 9.10%
Zone 1
Total land area of Zone 2 (TLAZ2): 920.91 Mha
Cropland as % of TLAZ2: 8.04%
Total net cropland area of Africa (TCAA) = 313 Mha
Cropland as % of TCAA: 26.4%
Total land area of Zone 3 (TLAZ3): 214.14 Mha
Cropland as % of TLAZ3: 28.46%
Total net cropland area of Africa (TCAA) = 313 Mha
Cropland as % of TCAA: 21.7%
Total land area of Zone 4 (TLAZ4): 539.13 Mha
Cropland as % of TLAZ4: 3.29%
Total net cropland area of Africa (TCAA) = 313 Mha
Cropland as % of TCAA: 6.2%
Zone 2
Zone 3
Zone 4
15
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 44 17 61 72.1%
No-Crop 5 188 193 97.4%
Total 49 205 254
Producer Accuracy 89.8% 91.7% 91.3%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 22 9 31 80.0%
No-Crop 4 215 219 98.2%
Total 26 224 250
Producer Accuracy 84.6% 96.0% 94.8%
Unweighted Overall Accuracy Matrix
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 3 14 17 NA (17.7%)
No-Crop 5 228 233 97.9%
Total 8 242 250
Producer Accuracy NA (37.5%) 94.2% 92.4%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 176 81 257 68.5%
No-Crop 29 1,464 1,493 98.1%
Total 205 1,545 1,750
Producer Accuracy 85.9% 94.8% 93.7%
Africa Area: 33.31 Mha
Africa Cropland: 313 Mha
Cropland% as total Africa:
100%
Zone 5
Total land area of Zone 5 (TLAZ5): 299.77 Mha
Cropland as % of TLAZ5: 15.53%
Total net cropland area of Africa (TCAA) = 313 Mha
Cropland as % of TCAA: 16.6%
Total land area of Zone 6 (TLAZ6): 552.15 Mha
Cropland as % of TLAZ6: 9.46%
Total net cropland area of Africa (TCAA) = 313 Mha
Cropland as % of TCAA: 19.9%
Total land area of Zone 7 (TLAZ7): 67.02 Mha
Cropland as % of TLAZ7: 5.65%
Total net cropland area of Africa (TCAA) = 313 Mha
Cropland as % of TCAA: 0.1%
Zone 6
Zone 7
Area Weighted overall accuracy is 94.5 %
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 175 67 242 72.3%
No-Crop 24 1,234 1,258 98.1%
Total 199 1,301 1,500
Producer Accuracy 87.9% 94.9% 93.9%
Unweighted overall accuracy without Zone 7
Africa Contd.
16
Africa
# Expected
crop samples
# crop samples
in the EM
Repetitive Sampling
of 250 samples
Crop %
in Zone
Crop % of
Total Crop
Overall
Accuracy
Producer’s
Accuracy
User’s
Accuracy
Zone 1 9 47 18 16 12 18 13 3.46 9.1 96.4 91.5 89.6
Zone 2 20 29 8.04 26.4 93.6 72.4 72.4
Zone 3 71 39 28.4 21.7 90.8 94.9 63.8
Zone 4 8 9 3.29 6.2 96.8 88.9 53.3
Zone 5 39 49 15.5 16.6 91.34 89.8 72.1
Zone 6 24 26 9.4 19.9 94.8 84.6 80
Zone 7 14 8 21 29 5.6 0.1 92.4 37.5 17.7
Expected vs. Actual crop samples
Zone 1:
Cropland.org samples resulted in a larger than the expected
number of crop samples when compared with the calculated crop
area proportion from the classified map
Zone 7:
Independent random sampling indicates that there will be enough
crop samples proportional to crop area17
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 43 5 48 89.6%
No-Crop 4 198 202 98.0%
Total 47 203 250
Producer Accuracy 91.5% 97.5% 96.4%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 7 0 7 NA (100.0%)
No-Crop 11 230 241 95.4%
Total 18 230 248
Producer Accuracy NA (38.9%) 100.0% 95.6%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 15 2 17 88.2%
No-Crop 1 231 232 99.6%
Total 16 233 249
Producer Accuracy 93.8% 99.1% 98.8%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 8 3 11 NA (72.7%)
No-Crop 4 235 239 98.3%
Total 12 238 250
Producer Accuracy NA (66.7%) 98.7% 97.2%
Reference Data
Crop No-Crop Total User AccuracyM
ap
Data Crop 15 1 16 93.8%
No-Crop 3 231 234 98.7%
Total 18 232 250
Producer Accuracy 83.3% 99.6% 98.4%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 7 3 10 NA (70.0%)
No-Crop 6 234 240 97.5%
Total 13 237 250
Producer Accuracy NA (53.9%) 98.7% 96.4%
Zone 1Cropland.org Samples
Total land area of Zone 1 (TLAZ1): 738.09 Mha
Cropland as % of TLAZ1: 3.46%
Total net cropland area of Africa (TCAA) = 313 Mha
Cropland as % of TCAA: 9.10%
Africa
# Expected
crop samples
# Actual Error
Matrix crop samples
Repetitive Sampling of 250
samples
Zone 1 9 47 18 16 12 18 13
5 Repetitive 250 random samples generated independently
18
Zone 7Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 3 14 17 NA (17.7%)
No-Crop 5 228 233 97.9%
Total 8 242 250
Producer Accuracy NA (37.5%) 94.2% 92.40%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 5 7 12 NA (41.7%)
No-Crop 16 220 236 93.2%
Total 21 227 248
Producer Accuracy NA (23.8%) 96.9% 90.73%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 15 8 23 65.2%
No-Crop 14 213 227 93.8%
Total 29 221 250
Producer Accuracy 51.72% 96.38% 91.20%
Total land area of Zone 7 (TLAZ7): 67.02 Mha
Cropland as % of TLAZ7: 5.65%
Total net cropland area of Africa (TCAA) = 313 Mha
Cropland as % of TCAA: 0.1%
Cropland.org Samples
2 Repetitive 250 random samples generated independently
❖ Producer’s and User’s accuracy is low in Zone 7 assessed with random 250 samples
❖ Indicative of some issue with mapping of crops in Zone 7. Could be further analyzed to determine why such poor results.
19
North America: 25 Zones
20
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 1 1 2 NA (50.0%)
No-Crop 0 248 248 100.0%
Total 1 249 250
Producer Accuracy NA (100.0%) 99.6% 99.6%
Canada: 3 Zones
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 6 3 9 NA (66.7%)
No-Crop 0 241 241 100.0%
Total 6 244 250
Producer Accuracy NA (100.0%) 98.7% 98.8%
Weighted overall accuracy is 96.9%Total Canada Area: 408.36 Mha
Cropland in Canada: 43.62 Mha
Total land area of Zone 1 (TLAZ1): 94.27 MhaCropland as % of TLAZ1: 0.99%Total net cropland area of Canada (TCAC) = 43.62 MhaCropland as % of TCAC= 2.15%Total net cropland area of NA (TCANA) = 275.97 MhaCropland as % of TCANA= 0.34%
Zone 1
Zone 2
Zone 3
Total land area of Zone 2 (TLAZ2): 130.46 MhaCropland as % of TLAZ2: 25.95%Total net cropland area of Canada (TCAC) = 43.62 MhaCropland as % of TCAC= 77.62%Total net cropland area of NA (TCANA) = 275.97 MhaCropland as % of TCANA= 12.26%
Total land area of Zone 3 (TLAZ3): 184.39MhaCropland as % of TLAZ3: 4.80%Total net cropland area of Canada (TCAC) = 43.62 MhaCropland as % of TCAC= 20.22%Total net cropland area of NA (TCANA) = 275.97 MhaCropland as % of TCANA= 3.19%
Unweighted Overall matrix accuracy matrix
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 46 1 47 97.8%
No-Crop 16 187 203 92.1%
Total 62 188 250
Producer Accuracy 74.2% 99.5% 93.2%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 53 5 58 91.4%
No-Crop 16 676 692 97.7%
Total 69 681 750
Producer Accuracy 76.8% 99.3% 97.2%
Old Map
21
Canada-Updated
Zone 3
Zone 2
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 1 4 5 NA (20.0%)
No-Crop 0 245 245 100.0%
Total 1 249 250
Producer Accuracy NA (100.0%) 98.4% 98.4%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 52 8 60 86.7%
No-Crop 10 180 190 94.7%
Total 62 188 250
Producer Accuracy 83.8% 95.7% 92.8%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 6 5 11 NA (54.6%)
No-Crop 0 239 239 (100.0%)
Total 6 244 250
Producer Accuracy NA (100.0%) (98.0%) 98.0%
Zone 1
Zone 3
Zone 2
Zone 1
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 1 4 5 NA (20.0%)
No-Crop 0 245 245 100.0%
Total 1 249 250
Producer Accuracy NA (100.0%) 98.4% 98.4%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 57 3 60 95.0%
No-Crop 16 174 190 91.6%
Total 73 177 250
Producer Accuracy 78.1% 98.3% 92.4%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 10 1 11 NA (90.9%)
No-Crop 0 239 239 100.0%
Total 10 240 250
Producer Accuracy NA (100.0%) 99.7% 99.6%
22
New Map, Old Ref New Map, New Ref
Total land area of Zone 1 (TLAZ1): 94.27 MhaCropland as % of TLAZ1: 0.99%Total net cropland area of Canada (TCAC) = 43.62 MhaCropland as % of TCAC= 2.15%Total net cropland area of NA (TCANA) = 275.97 MhaCropland as % of TCANA= 0.34%
Total land area of Zone 2 (TLAZ2): 130.46 MhaCropland as % of TLAZ2: 25.95%total net cropland area of Canada (TCAC) = 43.62 MhaCropland as % of TCAC= 77.62%Total net cropland area of NA (TCANA) = 275.97 MhaCropland as % of TCANA= 12.26%
Total land area of Zone 3 (TLAZ3): 184.39MhaCropland as % of TLAZ3: 4.80%Total net cropland area of Canada (TCAC) = 43.62 MhaCropland as % of TCAC= 20.22%Total net cropland area of NA (TCANA) = 275.97 MhaCropland as % of TCANA= 3.19%
Overall Unweighted Accuracy
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 59 17 76 77.6%
No-Crop 10 664 674 98.5%
Total 69 681 750
Producer Accuracy 85.5% 97.5% 96.4%
Canada-New Map Old RefReference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 68 8 76 89.5%
No-Crop 16 657 673 97.6%
Total 84 665 749
Producer Accuracy 81.0% 98.8% 96.8%
Canada-New Map New Ref
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 53 5 58 91.4%
No-Crop 16 676 692 97.7%
Total 69 681 750
Producer Accuracy 76.8% 99.3% 97.2%
Canada-Old
23
Canada: Final Matrices
Zone 3
Zone 2
Zone 1Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 1 4 5 NA (20.0%)
No-Crop 0 245 245 100.0%
Total 1 249 250
Producer Accuracy NA (100.0%) 98.4% 98.4%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 57 3 60 95.0%
No-Crop 16 174 190 91.6%
Total 73 177 250
Producer Accuracy 78.1% 98.3% 92.40%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 10 1 11 NA (90.9%)
No-Crop 0 239 239 100.0%
Total 10 240 250
Producer Accuracy NA (100.0%) 99.6% 99.6%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 68 8 76 89.5%
No-Crop 16 657 673 97.6%
Total 84 665 749
Producer Accuracy 81.0% 98.8% 96.8%
Unweighted Overall accuracy matrix
Weighted overall accuracy is 97.0%Total Canada Area: 408.36 Mha
Cropland in Canada: 43.62 Mha
New Map and New Reference
Total land area of Zone 1 (TLAZ1): 94.27 MhaCropland as % of TLAZ1: 0.99%Total net cropland area of Canada (TCAC) = 43.62 MhaCropland as % of TCAC= 2.15%Total net cropland area of NA (TCANA) = 275.97 MhaCropland as % of TCANA= 0.34%
Total land area of Zone 2 (TLAZ2): 130.46 MhaCropland as % of TLAZ2: 25.95%Total net cropland area of Canada (TCAC) = 43.62 MhaCropland as % of TCAC= 77.62%total net cropland area of NA (TCANA) = 275.97 MhaCropland as % of TCANA= 12.26%
Total land area of Zone 3 (TLAZ3): 184.39MhaCropland as % of TLAZ3: 4.80%Total net cropland area of Canada (TCAC) = 43.62 MhaCropland as % of TCAC= 20.22%Total net cropland area of NA (TCANA) = 275.97 MhaCropland as % of TCANA= 3.19%
24
United States: 9 ZonesZone 4
Zone 5
Zone 6
Zone 7
Total land area of Zone 4 (TLAZ4): 22.03 MhaCropland as % of TLAZ4: 14.85% Total net cropland area of US (TCAUS) = 169.10 MhaCropland as % of TCAUS= 1.93%Total net cropland area of NA (TCANA) = 275.97MhaCropland as % of TCANA= 1.18%
Total land area of Zone 5 (TLAZ5): 46.57MhaCropland as % of TLAZ5: 11.25%Total net cropland area of US (TCAUS) = 169.10 MhaCropland as % of TCAUS= 3.08%Total net cropland area of NA (TCANA) = 275.97MhaCropland as % of TCANA= 1.89%
Total land area of Zone 6 (TLAZ6): 193.06MhaCropland as % of TLAZ6: 6.07%Total net cropland area of US (TCAUS) = 169.10 MhaCropland as % of TCAUS= 6.90%Total net cropland area of NA (TCANA) = 275.97MhaCropland as % of TCANA= 4.22%
Total land area of Zone 7 (TLAZ7): 194.92MhaCropland as % of TLAZ7: 32.01%Total net cropland area of US (TCAUS) = 169.10 MhaCropland as % of TCAUS= 36.21%Total net cropland area of NA(TCANA) = 275.97 MhaCropland as % of TCANA= 22.19%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 19 5 24 79.2%
No-Crop 2 224 226 99.1%
Total 21 229 250
Producer Accuracy 90.5% 97.8% 97.2%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 9 3 12 NA (75.0%)
No-Crop 4 234 238 98.3%
Total 13 237 250
Producer Accuracy NA (69.2%) 98.7% 97.2%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 19 1 20 95.0%
No-Crop 7 223 230 97.0%
Total 26 224 250
Producer Accuracy 73.1% 99.6% 96.8%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 53 7 60 88.3%
No-Crop 10 180 190 94.7%
Total 63 187 250
Producer Accuracy 84.1% 96.3 93.2%
Old Map
25
Total land area of Zone 8 (TLAZ8): 105.66MhaCropland as % of TLAZ8: 47.31%Total net cropland area of US (TCAUS) = 169.10 MhaCropland as % of TCAUS= 28.88%Total net cropland area of NA (TCANA) = 275.97MhaCropland as % of TCANA= 17.69%
Total land area of Zone 9 (TLAZ9): 85.58MhaCropland as % of TLAZ9: 11.51%Total net cropland area of US (TCAUS) = 169.10 MhaCropland as % of TCAUS= 5.95%Total net cropland area of NA (TCANA) = 275.97MhaCropland as % of TCANA= 3.65%
Total land area of Zone 10 (TLAZ10): 89.22MhaCropland as % of TLAZ10: 20.16%Total net cropland area of US (TCAUS) = 169.10 MhaCropland as % of TCAUS= 10.35%Total net cropland area of NA (TCANA) = 275.97 MhaCropland as % of TCANA= 6.34%
Total land area of Zone 11 (TLAZ11): 27.30MhaCropland as % of TLAZ11: 31.39%Total net cropland area of US (TCAUS) = 169.10 MhaCropland as % of TCAUS= 4.96%Total net cropland area of NA(TCANA) = 275.97MhaCropland as % of TCANA= 3.04%
Zone 8
Zone 9
Zone 10
Zone 11
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 89 9 98 90.8%
No-Crop 9 143 152 94.1%
Total 98 152 250
Producer Accuracy 90.8% 94.1% 92.8%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 16 1 17 94.1%
No-Crop 10 223 233 95.7%
Total 26 224 250
Producer Accuracy 61.5% 99.6% 95.6%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 28 5 33 84.85%
No-Crop 17 200 217 92.17%
Total 45 205 250
Producer Accuracy 62.2% 97.6% 91.2%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 52 6 58 89.7%
No-Crop 6 186 192 96.9%
Total 58 192 250
Producer Accuracy 89.7% 96.9% 95.2%
Old Map
26
United States Contd.
Weighted overall accuracy 94.4%
Unweighted Overall Accuracy Matrix
Total land area of Zone 12 (TLAZ12): 20.41MhaCropland as % of TLAZ12: 14.3%Total net cropland area of US (TCAUS) = 169.10 MhaCropland as % of TCAUS= 1.69%Total net cropland area of NA (TCANA) = 275.97 MhaCropland as % of TCANA= 1.03%
Zone 12
Reference Data
Crop No-Crop Total User AccuracyM
ap
Data Crop 10 3 13 NA (76.9%)
No-Crop 14 223 237 94.1%
Total 24 226 250
Producer Accuracy NA (41.7%) 98.7% 93.2%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 295 40 335 88.1%
No-Crop 79 1,836 1,915 95.9%
Total 374 1,876 2,250
Producer Accuracy 78.9% 97.9% 94.7%
Old Map
Old Map
27
US-Updated
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 9 7 16 NA (56.3%)
No-Crop 3 231 234 98.7%
Total 12 238 250
Producer Accuracy NA (75.0%) 97.1% 96.0%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 24 2 26 92.3%
No-Crop 5 219 224 97.8%
Total 29 221 250
Producer Accuracy 82.8% 99.1% 97.2%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 25 10 35 71.4%
No-Crop 2 213 215 99.1%
Total 27 223 250
Producer Accuracy 92.6% 95.5% 95.2%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 20 15 35 57.1%
No-Crop 1 214 215 99.5%
Total 21 229 250
Producer Accuracy 95.2% 93.5% 93.6%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 10 6 16 62.5%
No-Crop 3 231 234 98.7%
Total 13 237 250
Producer Accuracy NA (76.9%) 97.5% 96.4%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 22 4 26 84.6%
No-Crop 4 220 224 98.2%
Total 26 224 250
Producer Accuracy 84.6% 98.2% 96.80%
Zone 4
Zone 6
Zone 5
Zone 4
Zone 6
Zone 5
28
New Map, Old Ref New Map, New Ref
Total land area of Zone 4 (TLAZ4): 22.03 MhaCropland as % of TLAZ4: 14.85% Total net cropland area of US (TCAUS) = 169.10 MhaCropland as % of TCAUS= 1.93%Total net cropland area of NA (TCANA) = 275.97MhaCropland as % of TCANA= 1.18%
Total land area of Zone 5 (TLAZ5): 46.57MhaCropland as % of TLAZ5: 11.25%Total net cropland area of US (TCAUS) = 169.10 MhaCropland as % of TCAUS= 3.08%Total net cropland area of NA (TCANA) = 275.97MhaCropland as % of TCANA= 1.89%
Total land area of Zone 6 (TLAZ6): 193.06MhaCropland as % of TLAZ6: 6.07%Total net cropland area of US (TCAUS) = 169.10 MhaCropland as % of TCAUS= 6.90%Total net cropland area of NA (TCANA) = 275.97MhaCropland as % of TCANA= 4.22%
US-Updated
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 20 9 29 69.0%
No-Crop 11 210 221 95.02%
Total 31 219 250
Producer Accuracy 64.5% 95.9% 92.0%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 98 23 121 81.0%
No-Crop 5 124 129 96.1%
Total 103 147 250
Producer Accuracy 95.2% 84.4% 88.8%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 63 10 73 86.3%
No-Crop 14 163 177 92.1%
Total 77 173 250
Producer Accuracy 81.8% 94.2% 90.4%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 57 16 73 78.1%
No-Crop 6 171 177 96.6%
Total 63 187 250
Producer Accuracy 90.5% 91.4% 91.2%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 92 29 121 76.0%
No-Crop 6 123 129 95.4%
Total 98 152 250
Producer Accuracy 93.9% 80.9% 86.0%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 19 10 29 65.5%
No-Crop 7 214 221 96.8%
Total 26 224 250
Producer Accuracy 73.1% 95.5% 93.2%
Zone 7
Zone 8
Zone 9
Zone 7
Zone 8
Zone 9
29
New Map, Old Ref New Map, New Ref
Total land area of Zone 7 (TLAZ7): 194.92MhaCropland as % of TLAZ7: 32.01%Total net cropland area of US (TCAUS) = 169.10 MhaCropland as % of TCAUS= 36.21%Total net cropland area of NA(TCANA) = 275.97 MhaCropland as % of TCANA= 22.19%
Total land area of Zone 8 (TLAZ8): 105.66MhaCropland as % of TLAZ8: 47.31%Total net cropland area of US (TCAUS) = 169.10 MhaCropland as % of TCAUS= 28.88%Total net cropland area of NA (TCANA) = 275.97MhaCropland as % of TCANA= 17.69%
Total land area of Zone 9 (TLAZ9): 85.58MhaCropland as % of TLAZ9: 11.51%Total net cropland area of US (TCAUS) = 169.10 MhaCropland as % of TCAUS= 5.95%Total net cropland area of NA (TCANA) = 275.97MhaCropland as % of TCANA= 3.65%
US-Updated
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 22 15 37 59.5%
No-Crop 9 204 213 95.8%
Total 31 219 250
Producer Accuracy 71.0% 93.2% 90.4%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 61 17 78 78.2%
No-Crop 5 167 172 97.1%
Total 66 184 250
Producer Accuracy 92.4% 90.8% 91.2%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 42 16 58 72.4%
No-Crop 10 182 192 94.8%
Total 52 198 250
Producer Accuracy 80.8% 91.9% 89.6%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 39 19 58 67.2%
No-Crop 6 186 192 96.9%
Total 45 205 250
Producer Accuracy 86.7% 90.7% 90.00%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 55 23 78 70.5%
No-Crop 3 169 172 98.32%
Total 58 192 250
Producer Accuracy 94.8% 88.0% 89.6%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 19 18 37 51.4%
No-Crop 5 208 213 97.7%
Total 24 226 250
Producer Accuracy 79.2% 92.0% 90.8%
Zone 10
Zone 11
Zone 12
Zone 10
Zone 11
Zone 12
30
New Map, Old Ref New Map, New Ref
Total land area of Zone 10 (TLAZ10): 89.22MhaCropland as % of TLAZ10: 20.16%Total net cropland area of US (TCAUS) = 169.10 MhaCropland as % of TCAUS= 10.35%Total net cropland area of NA (TCANA) = 275.97 MhaCropland as % of TCANA= 6.34%
Total land area of Zone 11 (TLAZ11): 27.30MhaCropland as % of TLAZ11: 31.39%Total net cropland area of US (TCAUS) = 169.10 MhaCropland as % of TCAUS= 4.96%Total net cropland area of NA(TCANA) = 275.97MhaCropland as % of TCANA= 3.04%
Total land area of Zone 12 (TLAZ12): 20.41MhaCropland as % of TLAZ12: 14.3%Total net cropland area of US (TCAUS) = 169.10 MhaCropland as % of TCAUS= 1.69%Total net cropland area of NA (TCANA) = 275.97 MhaCropland as % of TCANA= 1.03%
Unweighted overall accuracy matrices
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 333 140 473 70.4%
No-Crop 41 1,736 1,777 97.7%
Total 374 1,876 2,250
Producer Accuracy 89.0% 92.5% 92.0%
US-Old
US-New Map Old Ref
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 364 109 473 77.0%
No-Crop 64 1,713 1,777 96.4%
Total 428 1,822 2,250
Producer Accuracy 85.1% 94.0% 92.3%
US-New Map New Ref
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 295 40 335 88.1%
No-Crop 79 1,836 1,915 95.9%
Total 374 1,876 2,250
Producer Accuracy 78.9% 97.9% 94.7%
31
US: Final Error Matrices
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 9 7 16 NA (56.3%)
No-Crop 3 231 234 98.7%
Total 12 238 250
Producer Accuracy NA (75.0%) 97.06% 96.0%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 24 2 26 92.3%
No-Crop 5 219 224 97.8%
Total 29 221 250
Producer Accuracy 82.8% 99.1% 97.2%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 25 10 35 71.4%
No-Crop 2 213 215 99.1%
Total 27 223 250
Producer Accuracy 92.6% 95.5% 95.2%
Zone 4
Zone 6
Zone 5
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 63 10 73 86.3%
No-Crop 14 163 177 92.1%
Total 77 173 250
Producer Accuracy 81.8% 94.2% 90.4%
Zone 7
New Map and New Reference
Total land area of Zone 4 (TLAZ4): 22.03 MhaCropland as % of TLAZ4: 14.85% Total net cropland area of US (TCAUS) = 169.10 MhaCropland as % of TCAUS= 1.93%Total net cropland area of NA (TCANA) = 275.97MhaCropland as % of TCANA= 1.18%
Total land area of Zone 5 (TLAZ5): 46.57MhaCropland as % of TLAZ5: 11.25%Total net cropland area of US (TCAUS) = 169.10 MhaCropland as % of TCAUS= 3.08%Total net cropland area of NA (TCANA) = 275.97MhaCropland as % of TCANA= 1.89%
Total land area of Zone 6 (TLAZ6): 193.06MhaCropland as % of TLAZ6: 6.07%Total net cropland area of US (TCAUS) = 169.10 MhaCropland as % of TCAUS= 6.90%Total net cropland area of NA (TCANA) = 275.97MhaCropland as % of TCANA= 4.22%
Total land area of Zone 7 (TLAZ7): 194.92MhaCropland as % of TLAZ7: 32.01%Total net cropland area of US (TCAUS) = 169.10 MhaCropland as % of TCAUS= 36.21%Total net cropland area of NA(TCANA) = 275.97 MhaCropland as % of TCANA= 22.19% 32
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 20 9 29 69.0%
No-Crop 11 210 221 95.0%
Total 31 219 250
Producer Accuracy 64.5% 95.9% 92.0%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 98 23 121 81.0%
No-Crop 5 124 129 96.1%
Total 103 147 250
Producer Accuracy 95.2% 84.4% 88.8%
Zone 8
Zone 9Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 22 15 37 59.5%
No-Crop 9 204 213 95.8%
Total 31 219 250
Producer Accuracy 71.0% 93.2% 90.4%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 61 17 78 78.2%
No-Crop 5 167 172 97.1%
Total 66 184 250
Producer Accuracy 92.4% 90.8% 91.2%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 42 16 58 72.4%
No-Crop 10 182 192 94.8%
Total 52 198 250
Producer Accuracy 80.8% 91.9% 89.6%
Zone 10
Zone 11
Zone 12
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 364 109 473 77.0%
No-Crop 64 1,713 1,777 96.4%
Total 428 1,822 2,250
Producer Accuracy 85.1% 94.0% 92.3%
Non-weighted Overall accuracy matrix
Weighted overall accuracy is 92.2%
Total land area of Zone 8 (TLAZ8): 105.66MhaCropland as % of TLAZ8: 47.31%Total net cropland area of US (TCAUS) = 169.10 MhaCropland as % of TCAUS= 28.88%Total net cropland area of NA (TCANA) = 275.97MhaCropland as % of TCANA= 17.69%
Total land area of Zone 9 (TLAZ9): 85.58MhaCropland as % of TLAZ9: 11.51%Total net cropland area of US (TCAUS) = 169.10 MhaCropland as % of TCAUS= 5.95%total net cropland area of NA (TCANA) = 275.97MhaCropland as % of TCANA= 3.65%
Total land area of Zone 10 (TLAZ10): 89.22MhaCropland as % of TLAZ10: 20.16%Total net cropland area of US (TCAUS) = 169.10 MhaCropland as % of TCAUS= 10.35%Total net cropland area of NA (TCANA) = 275.97 MhaCropland as % of TCANA= 6.34%
Total land area of Zone 11 (TLAZ11): 27.30MhaCropland as % of TLAZ11: 31.39%Total net cropland area of US (TCAUS) = 169.10 MhaCropland as % of TCAUS= 4.96%Total net cropland area of NA(TCANA) = 275.97MhaCropland as % of TCANA= 3.04%
Total land area of Zone 12 (TLAZ12): 20.41MhaCropland as % of TLAZ12: 14.3%Total net cropland area of US (TCAUS) = 169.10 MhaCropland as % of TCAUS= 1.69%Total net cropland area of NA (TCANA) = 275.97 MhaCropland as % of TCANA= 1.03%
Total US Area: 776.15 MhaCropland in US: 169.10 Mha
33
Mexico: 6 ZonesMexico: 2.36 Mha
Samples
34
Mexico: 6 Zones
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 14 10 24 58.3%
No-Crop 6 217 223 97.3%
Total 20 227 247
Producer Accuracy 70.0% 95.6% 93.5%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 10 1 11 NA (90.9%)
No-Crop 2 236 238 99.2%
Total 12 237 249
Producer Accuracy NA (83.3%) 99.6% 98.8%
Zone 13
Total land area of Zone 13 (TLAZ13): 28.00MhaCropland as % of TLAZ13: 4.19%Total net cropland area of MX (TCAMX) = 35.95MhaCropland as % of TCAMX= 3.26%Total net cropland area of NA (TCANA) = 275.97 MhaCropland as % of TCANA= 0.37%
Total land area of Zone 14 (TLAZ14): 31.20 MhaCropland as % of TLAZ14: 21.41%Total net cropland area of MX (TCAMX) = 35.95 MhaCropland as % of TCAMX= 18.58%Total net cropland area of NA (TCANA) = 275.97 MhaCropland as % of TCANA= 2.14%
Total land area of Zone 15 (TLAZ15): 37.71MhaCropland as % of TLAZ15: 9.88 %Total net cropland area of MX (TCAMX) = 35.95 MhaCropland as % of TCAMX= 10.36%Total net cropland area of NA (TCANA) = 275.97 MhaCropland as % of TCANA= 1.19%
Zone 14
Zone 15
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 53 8 61 86.9%
No-Crop 14 173 187 92.5%
Total 67 181 248
Producer Accuracy 79.1% 95.6% 91.1%
35
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 22 4 26 84.6%
No-Crop 3 220 223 98.7%
Total 25 224 249
Producer Accuracy 88.0% 98.2% 97.2%
Total land area of Zone 16 (TLAZ16): 43.38MhaCropland as % of TLAZ17: 26.62%Total net cropland area of MX (TCAMX) = 35.95MhaCropland as % of TCAMX= 32.12%Total net cropland area of MX (TCAMX) = 275.97 MhaCropland as % of TCANA= 3.70%
Total land area of Zone 17 (TLAZ17):18.07MhaCropland as % of TLAZ17: 13.19%Total net cropland area of MX (TCAMX) = 35.95MhaCropland as % of TCAMX= 6.63%Total net cropland area of MX (TCAMX) = 275.97 MhaCropland as % of TCANA= 0.76%
Total land area of Zone 18 (TLAZ18): 32.63MhaCropland as % of TLAZ18: 31.97%Total net cropland area of MX (TCAMX) = 35.95 MhaCropland as % of TCAMX= 29.02%Total net cropland area of MX (TCAMX) = 275.97 MhaCropland as % of TCANA= 3.34%
Zone 16
Zone 17
Zone 18
Weighted overall accuracy 93.6%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 52 16 68 76.5%
No-Crop 6 167 173 96.5%
Total 58 183 241
Producer Accuracy 89.7% 91.3% 90.9%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 47 13 60 78.3%
No-Crop 3 166 169 98.2%
Total 50 179 229
Producer Accuracy 94.0% 92.7% 93.0%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 198 52 250 79.2%
No-Crop 34 1,179 1,213 97.2%
Total 232 1,231 1,463
Producer Accuracy 85.3% 95.8% 94.1%
Unweighted overall accuracy
36
Central America: 2 ZonesCuba, DR Haiti, Car Is: 3 Zones Samples
Cuba, DR Haiti, Caribbean Islands
37
Central Am., Cuba, Caribbean Islands
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 70 18 88 79.6%
No-Crop 7 151 158 95.6%
Total 77 169 246
Producer Accuracy 90.9% 89.4% 89.8%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 52 23 75 69.3%
No-Crop 0 171 171 100.0%
Total 52 194 246
Producer Accuracy 100.0% 88.1% 90.7%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 34 21 55 61.8%
No-Crop 9 182 191 95.3%
Total 43 203 246
Producer Accuracy 79.1% 89.7% 87.8%
Zone 19
Zone 20
Zone 21 Cuba
Zone 22 DR Haiti
Zone 23 Car Is
Total land area of Zone 19 (TLAZ19): 46.11MhaCropland as % of TLAZ19: 33.33%Total net cropland area of CAm (TCACAm) = 18.67MhaCropland as % of TCACAm= 82.32%Total net cropland area of NA (TCANA) = 275.97 MhaCropland as % of TCANA= 5.21%
Total land area of Zone 20 (TLAZ20): 15.74MhaCropland as % of TLAZ20: 20.96%Total net cropland area of CAm (TCACAm) = 18.67 MhaCropland as % of TCACAm= 17.67%Total net cropland area of NA (TCANA) = 275.97 MhaCropland as % of TCANA= 1.12%
Total land area of Zone 21 (TLAZ21): 28.97MhaCropland as % of TLAZ21: 15.59%total net cropland area of Cu (TCACu) = 4.51Mhatotal net cropland area of NA (TCABNA) = 275.97 MhaCropland as % of TCANA= 1.53%
Total land area of Zone 22 (TLAZ22): 17.98MhaCropland as % of TLAZ22: 20.39%Total net cropland area of DH (TCADH) = 3.66MhaTotal net cropland area of NA (TCANA) = 275.97 MhaCropland as % of TCANA= 1.32%
Total land area of Zone 23 (TLAZ23): 3.76MhaCropland as % of TLAZ23: 3.65%Total net cropland area of CarIs (TCACIs) = 0.14MhaTotal net cropland area of MX (TCACIs) = 275.97 MhaCropland as % of TCANA= 0.04%
Weighted overall accuracy 86.0%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 71 32 103 68.9%
No-Crop 3 142 145 97.9%
Total 74 174 248
Producer Accuracy 96.0% 81.6% 85.9%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 65 35 100 65.0%
No-Crop 4 146 150 97.3%
Total 69 181 250
Producer Accuracy 94.2% 80.7% 84.4% Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 117 58 175 66.86%
No-Crop 4 317 321 98.75%
Total 121 375 496
Producer Accuracy 96.69% 84.53% 87.5%
Unweighted overall accuracy matrix
38
Alaska, Hawaii, Iceland
Iceland mapIceland CLC Cropland
Hawaii map
Hawaii Ag Baseline 2015
Zone 24
Zone 25
2 Counties in Alaska
Iceland
Hawaii
39
Hawaii
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 36 8 44 81.8%
No-Crop 4 202 206 98.1%
Total 40 210 250
Producer Accuracy 90.0% 96.2% 95.2%
Zone 24
Total land area of Zone 24 (TLAZ24): 1.67 MhaCropland as % of TLAZ24: 16.75%Total net cropland area of Hw (TCAHw) = 0.28MhaTotal net cropland area of NA (TCANA) = 2753.97 MhaCropland as % of TCANA= 0.10%
40
Alaska
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 4 1 5 NA (80.0%)
No-Crop 0 245 245 100.0%
Total 4 246 250
Producer Accuracy NA (100.0%) 99.6% 99.6%
Zone 25
Total land area of Zone 25 (TLAZ25): 12.27MhaCropland as % of TLAZ25: 0.09%Total land area of buffer Zone 25 (TLAZ25): 1.05 MhaCropland as % of buffer TLAZ24: 0.98%Total net cropland area of Al (TCAAl) = 0.01MhaTotal net cropland area of NA (TCANA) = 275.97 MhaCropland as % of TCANA= 0.00%
41
Iceland
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 13 0 13 NA (100.0%)
No-Crop 6 231 237 97.47%
Total 19 231 250
Producer Accuracy NA (68.4%) 100.0% 97.6%
Total land area of Ic buffer (TLAZIc): 13.98 MhaTotal net cropland area of Ic (TCAIc) = 0.59MhaCropland as % of buffer TLAZIc: 4.24%
42
Mongolia(Used a Buffer Approach*)
* Separate paper on Mongolia required more detailed accuracy assessment 43
Sampling in 10km and 25km buffer
zones
Sampling area is 1.71 Mha
44
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 0 0 0 NA
No-Crop 0 50 50 100.0%
Total 0 50 50
Producer Accuracy NA 100.0% 100.0%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 1 0 1 NA (100.0%)
No-Crop 0 49 49 100.0%
Total 1 49 50
Producer Accuracy NA (100.0%) 100.0% 100.0%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 11 1 12 NA (91.7%)
No-Crop 4 184 188 97.9%
Total 15 185 200
Producer Accuracy NA (73.3%) 99.5% 97.5%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 6 2 8 NA (75.0%)
No-Crop 5 187 192 97.4%
Total 11 189 200
Producer Accuracy NA (54.6%) 98.9% 96.5% Overall Weighted accuracy is 99.6%
Mongolia Error MatricesZone 1
Zone 2
Zone 3 & 4 buffer10
Zone 3 & 4 buffer25
Total land area of Zone 3_4 buffer10 : 25.66MhaCropland as % of Zone 3_4 buffer10 : 5.22%
Total land area of Zone 3_4 buffer25 : 38.65 MhaCropland as % of Zone 3_4 buffer25 : 3.46%
Total land area of Zone 2: 81.76 MhaCropland as % of Zone 2: 0.048 %
Total land area of Zone 1 : 19.67 MhaCropland as % of Zone 1 : 0.00%
Reference Data
Crop No-Crop Total User AccuracyM
ap
Data Crop 12 1 13 NA (92.3%)
No-Crop 4 293 297 98.7%
Total 16 294 310
Producer Accuracy NA (75.0%) 99.7% 98.4%
Unweighted overall error matrix
45
New Zealand: 2 Zones
46
Cropland
Zone 2
Zone 1
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 36 5 41 87.8%
No-Crop 3 206 209 98.6%
Total 39 211 250
Producer Accuracy 92.3% 97.6% 96.8%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 74 18 92 80.4%
No-Crop 7 151 158 95.6%
Total 81 169 250
Producer Accuracy 91.4% 89.4% 90.0%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 110 23 133 82.7%
No-Crop 10 357 367 97.3%
Total 120 380 500
Producer Accuracy 91.7% 94.0% 93.4%
Area Weighted Overall accuracy is 93.8%
Unweighted Overall Accuracy Matrix
Zone 2
Zone 1
Total land area of Zone 1 : 11.2 MhaCropland as % of Zone 1 : 13.7%Total cropland area of NZ: 8.1 MhaCropland area % : 18.8%
Total land area of Zone 2 : 15.2MhaCropland as % of Zone 1 : 43.3%Total cropland area of NZ: 8.1 MhaCropland area % : 81.2%
Zone 1
Zone 2
47
China
(Random Sampling in 3 Zones)
48
Cropland.org Samples
1000 Cropland.org Samples selected with a minimum distance to minimize spatial autocorrelation and verified on VHRI 49
Combined Samples with a MD 10km
All random samples selected with at least a minimum distance of 10km apart
50
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 115 21 136 84.6%
No-Crop 29 429 458 93.7%
Total 144 450 594
Producer Accuracy 79.9% 95.3% 91.6%
Final Error Matrices
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 5 3 8 NA (62.5%)
No-Crop 2 208 210 99.1%
Total 7 211 218
Producer Accuracy NA (71.4%) 98.6% 97.7%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 2 0 2 NA (100.0%)
No-Crop 4 170 174 97.7%
Total 6 170 176
Producer Accuracy NA (33.3%) 100.0% 97.7%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 8 0 8 NA (100.0%)
No-Crop 5 215 220 97.7%
Total 13 215 228
Producer Accuracy NA (61.6%) 100.0% 97.8%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 2 0 2 NA (100.0%)
No-Crop 6 170 176 96.6%
Total 8 170 178
Producer Accuracy NA (25.0%) 100.0% 96.6%
Random Cropland.org
Area weighted accuracy: 90.0% 92.4%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 142 27 169 84.0%
No-Crop 22 415 437 95.0%
Total 164 442 606
Producer Accuracy 86.6% 93.9% 91.9%
Zone E
Zone Wa
Zone Wb
Zone E
Zone Wa
Zone Wb
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 125 21 146 85.6%
No-Crop 56 798 854 93.4%
Total 181 819 1,000
Producer Accuracy 69.1% 97.4% 92.3%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 105 74 179 58.7%
No-Crop 28 793 821 96.6%
Total 133 867 1,000
Producer Accuracy 79.0% 91.5% 89.8%
Unweighted overall
accuracy matrix
51
Total land area of Zone E (TLAZE): 552.88MhaCropland as % of TLAZE: 28.5%total net cropland area of China (TCAC) = 165.75MhaCropland as % of TCAC: 95.10%
Total land area of Zone Wa(TLAZWa): 200.29MhaCropland as % of TLAZWa: 3.2%total net cropland area of China (TCAC) = 165.75MhaCropland as % of TCAC: 3.90%
Total land area of Zone Wb(TLAZWb): 185.11MhaCropland as % of TLAZWb: 0.9%total net cropland area of China (TCAC) = 165.75MhaCropland as % of TCAC: 1.0%
China: Combined Final
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 272 51 323 84.2%
No-Crop 68 1,581 1,649 95.9%
Total 340 1,632 1,972
Producer Accuracy 80.0 % 96.9 % 94.0%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 255 48 303 84.2%
No-Crop 51 830 881 94.2%
Total 306 878 1,184
Producer Accuracy 83.3% 94.5% 91.6%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 13 3 16 81.3%
No-Crop 7 416 423 98.4%
Total 20 419 439
Producer Accuracy 65.0% 99.3% 97.7%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 4 0 4 NA (100.0%)
No-Crop 10 335 345 97.1%
Total 14 335 349
Producer Accuracy NA (28.6%) 100.0% 97.1%
Zone E
Zone Wa
Zone Wb
Total land area of Zone E (TLAZE): 552.88MhaCropland as % of TLAZE: 28.5%total net cropland area of China (TCAC) = 165.75MhaCropland as % of TCAC: 95.10%
Total land area of Zone Wa (TLAZWa): 200.29MhaCropland as % of TLAZWa: 3.2%total net cropland area of China (TCAC) = 165.75MhaCropland as % of TCAC: 3.90%
Total land area of Zone Wb (TLAZWb): 185.11MhaCropland as % of TLAZWb: 0.9%total net cropland area of China (TCAC) = 165.75MhaCropland as % of TCAC: 1.0%
Unweighted Overall Error Matrix
Area weighted accuracy: 94.0% 52
South America: 5 Zones
53
South America: Error Matrices
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 3 5 8 NA (37.5%)
No-Crop 3 239 242 98.8%
Total 6 244 250
Producer Accuracy NA (50.0%) 98.0% 96.8%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 25 8 33 75.8%
No-Crop 5 212 217 97.7%
Total 30 220 250
Producer Accuracy 83.3% 96.4% 94.8%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 39 9 48 81.3%
No-Crop 10 191 202 95.1%
Total 49 200 250
Producer Accuracy 79.6% 95.5% 92.4%
Total land area of Zone 1 (TLAZ1): 275.01MhaCropland as % of TLAZ1: 1.85%total net cropland area of SA (TCASA) = 282.60 MhaCropland as % of TCASA: 1.80 %
Zone 1
Zone 2
Zone 3
Total land area of Zone 2 (TLAZ2): 381.59 MhaCropland as % of TLAZ2: 13.05 %total net cropland area of SA (TCASA) = 282.60 MhaCropland as % of TCASA: 17.62%
Total land area of Zone 3 (TLAZ3): 375.64MhaCropland as % of TLAZ3: 22.32%total net cropland area of SA (TCASA) = 282.60MhaCropland as % of TCASA: 29.67 %
54
South America Contd.
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 40 11 51 78.4%
No-Crop 4 195 199 98.0%
Total 44 206 250
Producer Accuracy 90.9% 94.7% 94.0%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 21 6 27 77.8%
No-Crop 5 218 223 97.8%
Total 26 224 250
Producer Accuracy 80.8% 97.3% 95.6%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 128 39 167 76.7%
No-Crop 27 1,056 1,083 97.5%
Total 155 1,095 1,250
Producer Accuracy 82.6% 96.4% 94.7%
Zone 4
Zone 5
Unweighted Overall Error Matrix
Total land area of Zone 4 (TLAZ4): 704.74MhaCropland as % of TLAZ4: 16.28%total net cropland area of SA (TCASA) = 282.60MhaCropland as % of TCASA: 40.60%
Total land area of Zone 5 (TLAZ5): 320.82MhaCropland as % of TLAZ5: 9.06%total net cropland area of SA (TCASA) = 282.60MhaCropland as % of TCASA:10.28 %
Area weighted accuracy: 93.2%
55
South East Asia-7 Zones
56
Reference Samples
Cropland.org samples
• Only one or two regions have ground data• Few regions have very less samples from cropland.org (either combine the regions or
supplement more samples)• All the vector polygons cannot be used as reference in Japan. Select pure reference samples
within polygons • Low sample density in Japan and South and North Korea is due to additional random samples
that were generated for Southeast Asia but not Japan and South and North Korea. 57
Sampling in 7 Zones
Name Area (km) Crop %
1 Myan/Viet 1923151 32
2 Philippines 296074 31
3 Japan/Korea 600236 14
4 Borneo 739532 25
5 Java & Bali 137649 43
6
Sumatra & Malaysia 606304 31
7 Sualawsi-Polynesia 1165441 5
58
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 80 20 100 80.0%
No-Crop 16 134 150 89.3%
Total 96 154 250
Producer Accuracy 83.3% 87.0% 85.6%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 41 7 48 85.4%
No-Crop 15 187 202 92.6%
Total 56 194 250
Producer Accuracy 73.2% 96.4% 91.2%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 45 20 65 69.2%
No-Crop 22 163 185 88.1%
Total 67 183 250
Producer Accuracy 67.2% 89.1% 83.2%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 69 26 95 72.6%
No-Crop 2 153 155 98.7%
Total 71 179 250
Producer Accuracy 97.2% 85.5% 88.8%
Total land area of Zone 4 (TLAZ4): 73.9 MhaCropland as % of TLAZ4: 24.9%total net cropland area of SE Asia (TCASEA) = 128 MhaCropland as % of TCASEA : 14.4%
Total land area of Zone 1 (TLAZ1): 192.3 MhaCropland as % of TLAZ1: 31.7%total net cropland area of SE Asia (TCASEA) = 128 MhaCropland as % of TCASEA: 47.6%
Total land area of Zone 2 (TLAZ2): 29.6 MhaCropland as % of TLAZ2: 31.1%total net cropland area of SE Asia (TCASEA) = 128 MhaCropland as % of TCASEA : 7.2%
Total land area of Zone 3 (TLAZ3): 60.6 MhaCropland as % of TLAZ3: 30.7%total net cropland area of SE Asia (TCASEA) = 128 MhaCropland as % of TCASEA : 14.5%
Error Matrices for Southeast Asia, Japan, and
N&S KoreaZone 1
Zone 2
Zone 3
Zone 4
59
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 89 27 116 76.7%
No-Crop 13 121 134 90.3%
Total 102 148 250
Producer Accuracy 87.3% 81.8% 84.0%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 10 7 17 NA (58.8%)
No-Crop 2 231 233 99.1%
Total 12 238 250
Producer Accuracy NA (83.3%) 97.1% 96.4%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 42 7 49 85.7%
No-Crop 15 186 201 92.5%
Total 57 193 250
Producer Accuracy 73.7% 96.4% 91.2%
Weighted overall accuracy is 88.4%
Total land area of Zone 7 (TLAZ7): 60.0 MhaCropland as % of TLAZ7: 14.3%total net cropland area of SE Asia (TCASEA) = 128 MhaCropland as % of TCASEA : 6.7%
Total land area of Zone 5 (TLAZ5): 13.8 MhaCropland as % of TLAZ5: 43.2%total net cropland area of SE Asia (TCASEA) = 128 MhaCropland as % of TCASEA : 4.7%
Total land area of Zone 6 (TLAZ6): 116.5 MhaCropland as % of TLAZ6: 5.4%total net cropland area of SE Asia (TCASEA) = 128 MhaCropland as % of TCASEA: 4.9%
Total land area of all zones (TLAall): 546.83 MhaCropland as % of TLAall: 23.4%total net cropland area of SE Asia (TCASEA) = 128 MhaCropland as % of TCASEA: 100%
Zone 5
Zone 6
Zone 7
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 376 114 490 76.7%
No-Crop 85 1175 1260 93.3%
Total 461 1289 1750
Producer Accuracy 81.6% 91.2% 88.6%
Unweighted Overall Accuracy Matrix
South East Asia Contd.
60
South Asia: 6 zones
Combined AEZ’s and country boundaries
61
Sampling in 6 Zones
62
Error MatricesReference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 42 32 74 56.8%
No-Crop 17 159 176 90.3%
Total 59 191 250
Producer Accuracy 71.2% 83.3% 80.4%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 4 3 7 NA (57.1%)
No-Crop 8 235 243 96.7%
Total 12 238 250
Producer Accuracy NA (33.3%) 98.7% 95.6%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 111 19 130 85.4%
No-Crop 40 80 120 66.7%
Total 151 99 250
Producer Accuracy 73.5% 80.8% 76.4%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 140 18 158 88.6%
No-Crop 24 67 91 73.6%
Total 164 85 249
Producer Accuracy 85.4% 78.8% 83.1%
Zone 1
Zone 2
Zone 3
Zone 4
Total land area of Zone 1 (TLAZ1): 159.6 MhaCropland as % of TLAZ1: 22.26 %Total net cropland area of SAsia (TCASA) = 262.47 MhaCropland as % of TCASA : 13.54 %
Total land area of Zone 2 (TLAZ2): 191.86 MhaCropland as % of TLAZ2: 3.41 %Total net cropland area of SAsia (TCASA) = 262.47 MhaCropland as % of TCASA : 2.49 %
Total land area of Zone 3 (TLAZ3): 122.43 MhaCropland as % of TLAZ3: 43.35 %Total net cropland area of SAsia (TCASA) = 262.47 MhaCropland as % of TCASA : 20.22 %
Total land area of Zone 1 (TLAZ1): 174.87 MhaCropland as % of TLAZ1: 57.49 %Total net cropland area of SAsia (TCASA) = 262.47 MhaCropland as % of TCASA : 38.30 %
63
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 104 17 121 86.0%
No-Crop 36 92 128 71.9%
Total 140 109 249
Producer Accuracy 74.3% 84.4% 78.7%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 15 3 18 83.3%
No-Crop 16 216 232 93.1%
Total 31 219 250
Producer Accuracy 48.4% 98.6% 92.4%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 418 92 510 82.0%
No-Crop 141 849 990 85.8%
Total 559 941 1,500
Producer Accuracy 74.8% 90.2% 84.5%
Zone 5
Zone 6
Unweighted Overall Error Matrix
Total land area of Zone 5 (TLAZ5): 144.32 MhaCropland as % of TLAZ5: 62.636 %Total net cropland area of SAsia (TCASA) = 262.47 MhaCropland as % of TCASA : 23.86 %
Total land area of Zone 6 (TLAZ6): 68.55 MhaCropland as % of TLAZ1: 4.16 %Total net cropland area of SAsia (TCASA) = 262.47 MhaCropland as % of TCASA : 1.59 %
Weighted overall accuracy is 84.4%64
Europe: 9 Zones
65
Sampling in 9 Zones
66
Europe: Error MatricesReference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 156 15 171 91.2%
No-Crop 13 66 79 83.5%
Total 169 81 250
Producer Accuracy 92.3% 81.5% 88.8%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 129 24 153 84.3%
No-Crop 28 69 97 71.1%
Total 157 93 250
Producer Accuracy 82.2% 74.2% 79.2%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 144 12 156 92.3%
No-Crop 20 74 94 78.8%
Total 164 86 250
Producer Accuracy 87.8% 86.1% 87.2%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 145 11 156 93.0%
No-Crop 21 73 94 77.7%
Total 166 84 250
Producer Accuracy 87.4% 87.0% 87.2%
Zone 1
Zone 2
Zone 3
Zone 4
Total land area of Zone 2 (TLAZ2): 120.6 MhaCropland as % of TLAZ2: 60.4%total net cropland area of Europe (TCAE) = 581.9 MhaCropland as % of TCASEA: 12.5%
Total land area of Zone 1 (TLAZ1): 31.1MhaCropland as % of TLAZ1: 66.3%total net cropland area of Europe (TCAE) = 581.9 MhaCropland as % of TCASEA: 3.5%
Total land area of Zone 3 (TLAZ3): 145.7 MhaCropland as % of TLAZ3: 57.3%total net cropland area of Europe (TCAE) = 581.9 MhaCropland as % of TCASEA: 14.4%
Total land area of Zone 4 (TLAZ4): 160.3 MhaCropland as % of TLAZ4: 59.8%total net cropland area of Europe (TCAE) = 581.9 MhaCropland as % of TCASEA: 16.5%
67
Reference Data
Crop No-Crop Total User AccuracyM
ap
Data Crop 15 1 16 93.8%
No-Crop 22 212 234 90.6%
Total 37 213 250
Producer Accuracy 40.5% 99.5% 90.8%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 87 22 109 79.8%
No-Crop 10 131 141 92.9%
Total 97 153 250
Producer Accuracy 89.7% 85.6% 87.2%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 8 0 8 NA (100.0%)
No-Crop 1 241 242 99.6%
Total 9 241 250
Producer Accuracy NA (88.9%) 100.0% 99.6%
Zone 5
Zone 6
Zone 7
Total land area of Zone 5 (TLAZ5): 107.6 MhaCropland as % of TLAZ5: 5.8%total net cropland area of Europe (TCAE) = 581.9 MhaCropland as % of TCASEA: 1.15%
Total land area of Zone 6 (TLAZ6): 172.2MhaCropland as % of TLAZ6: 37.3%total net cropland area of Europe (TCAE) = 581.9 MhaCropland as % of TCASEA: 11.0%
Total land area of Zone 7 (TLAZ7): 308.31 MhaCropland as % of TLAZ7: 1.90%total net cropland area of Europe (TCAE) = 581.9 MhaCropland as % of TCASEA: 1.0%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 18 1 19 94.7%
No-Crop 23 208 231 90.0%
Total 41 209 250
Producer Accuracy 43.9% 99.5% 90.4%
Total land area of Zone 8 (TLAZ8): 1637.69 MhaCropland as % of TLAZ8: 9.51 %total net cropland area of Europe (TCAE) = 581.9 MhaCropland as % of TCASEA: 28.8 %
Zone 8
Europe Contd.
68
Europe: Error Matrices Contd.
Total land area of all zones (TLAEAll: 3,301Mhatotal net cropland area of Europe (TCAE) = 581.9 MhaCropland as % of TCAE: 16.46%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 738 97 835 88.4%
No-Crop 142 1,273 1,415 80.0
Total 880 1,370 2,250
Producer Accuracy 83.9% 92.9% 89.4%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 36 11 47 76.6%
No-Crop 4 199 203 98.0%
Total 40 210 250
Producer Accuracy 90.0% 94.8% 94.0%
Zone 9
Total land area of Zone 9 (TLAZ9): 392.56 MhaCropland as % of TLAZ9: 19.6 %total net cropland area of Europe (TCAE) = 581.97 MhaCropland as % of TCASEA: 13.2 %
Unweighted Overall Error Matrix
69
Weighted overall accuracy is 90.8%
Zone 2
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 129 24 153 84.3%
No-Crop 28 69 97 71.1%
Total 157 93 250
Producer Accuracy 82.2% 74.2% 79.2%
Europe
# Expected crop
samples
# crop samples
in the EM
Repetitive
sampling Overall Accuracy Producer’s Accuracy User’s Accuracy
Zone 1 166 (140*) 169 88.8 92.31 91.2
Zone 2 151 (66*) 157 126 127 132 79.2 82.17 84.3
Zone 3 143 (85*) 164 130 116 118 87.2 87.8 92.3
Zone 4 150 (104*) 166 87.2 87.35 92.9
Zone 5 14 37 90.8 40.54 93.7
Zone 6 93 (94) 97 87.2 89.7 79.8
Zone 7 5 9 99.6 88.9 100
Zone 8 24 41 90.4 43.9 94.7
Zone 9 49 40 94.0 90.0 76.6
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 116 35 151 76.8%
No-Crop 10 88 98 89.8%
Total 126 123 249
Producer Accuracy 92.1% 71.5% 81.9%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 120 31 151 79.5%
No-Crop 7 91 98 92.9%
Total 127 122 249
Producer Accuracy 94.5% 74.6% 84.7%
Reference Data
Crop No-Crop Total User AccuracyM
ap
Data Crop 125 35 160 78.13%
No-Crop 7 80 87 91.95%
Total 132 115 247
Producer Accuracy 94.70% 69.57% 83.00%
70*Crop area proportions were not matching with the actual crop samples in the matrix. The
sampling was repeated 3 times in two of the zones.
Zone 3
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 144 12 156 92.3%
No-Crop 20 74 94 78.7%
Total 164 86 250
Producer Accuracy 87.8% 86.1% 87.2%
Europe
# Expected crop
samples
# crop samples
in the EM Repetitive sampling
Overall
Accuracy
Producer’s
Accuracy
User’s
Accuracy
Zone 1 166 (140*) 169 88.8 92.31 91.2
Zone 2 151 (66*) 157 126 127 132 79.2 82.17 84.3
Zone 3 143 (85*) 164 130 116 118 87.2 87.8 92.3
Zone 4 150 (104*) 166 87.2 87.35 92.9
Zone 5 14 37 90.8 40.54 93.7
Zone 6 93 (94) 97 87.2 89.7 79.8
Zone 7 5 9 99.6 88.9 100
Zone 8 24 41 90.4 43.9 94.7
Zone 9 49 40 94.0 90.0 76.6
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 127 23 150 84.7%
No-Crop 3 97 100 97.0%
Total 130 120 250
Producer Accuracy 97.7% 80.8% 89.6%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 113 19 132 85.6%
No-Crop 3 115 118 97.5%
Total 116 134 250
Producer Accuracy 97.4% 85.8% 91.2%
Reference Data
Crop No-Crop Total User Accuracy
Map
Data Crop 112 15 127 88.2%
No-Crop 6 117 123 95.1%
Total 118 132 250
Producer Accuracy 94.9% 88.6% 91.6%
71*Crop area proportions were not matching with the actual crop samples in the matrix. The
sampling was repeated 3 times in two of the zones.
Australia (Used 2 Buffer Zones)
91% Non Croplands9% Croplands
72
No-Crop Buffer
Australia
30m buffer zones
Crop Buffer
73
900 Proportional, Balanced samples in No-Crop Buffer
Australia
Sample distribution
80 Crop Samples820 No Crop Samples
700 Proportional, Balanced Samples in Crop Buffer 1
74
• Crop samples selected from ground collected data (2015) using crop proportion area %
• Random No-Crop samples generated in No-Crop Buffer (50km), leaving out center region
• Generated crop buffer zones based on Euclidean distance
• Buffer 1: 12km• Buffer 2: 24 km• Samples generated in Crop Buffer 1 & 2• Visual interpretation using high
resolution imagery• Generated Error Matrices
800 Proportional, Balanced Samples in Crop Buffer 2
Australia
30m buffer zones
75
Reference Data
Cropland No-Crop Total User Accuracy
Map
Data Cropland 79 21 100 79.0%
No-Crop 1 799 800 99.9%
Total 80 820 900
Producer Accuracy 98.8% 97.4% 97.6%
Reference Data
Cropland No-Crop Total User Accuracy
Map
Data Cropland 50 28 78 64.1%
No-Crop 20 602 622 96.8%
Total 70 630 700
Producer Accuracy 71.4% 95.6% 93.1%
Australia: Error Matrices
Reference Data
Cropland No-Crop Total User Accuracy
Map
Data Cropland 54 24 78 69.2%
No-Crop 28 694 722 96.1%
Total 82 718 800
Producer Accuracy 65.9% 96.7% 93.5%
Balanced Error Matrix in Crop/No-Crop
Balanced Error Matrix in Crop Buffer 1
Balanced Error Matrix in Crop Buffer 2
Total land area of NCB (TLANCB): 697.8 MhaCropland as % of TLAZ7: 8.0 %Total net cropland area of Australia (TCAA) = 69.7 MhaCropland as % of TCAA: 100 %
Total land area of CB (TLACB): 477.3 MhaCropland as % of TLAZ7: 11.6%Total net cropland area of Australia (TCAA) = 69.7 MhaCropland as % of TCAA: 100 %
Total land area of CB (TLACB): 579.9 MhaCropland as % of TLAZ7: 9.5 %Total net cropland area of Australia (TCAA) = 69.7 MhaCropland as % of TCAA: 100 %
76
Total Number of Samples: 19,171
Global Validation Samples
77
Global Overall AccuracyContinent Non-weighted
overall
accuracy %
Area
weighted
accuracy
%
Area
weighted
Producer’s
accuracy %
Area
weighted
user’s
accuracy %
Number of
Samples
Africa 93.7 94.5 83.6 72.7 1750
Mongolia 98.4 99.6 80.1 84.0 300
South America 94.7 94.5 80.4 72.9 1250
Europe, Russia, Mid-East, UK, Ireland 89.4 90.8 63.1 91.4 2250
South Asia 89.4 84.4 64.7 74.4 1500
South East Asia 88.6 88.4 80.9 76.9 1750
China 94.0 94.0 68.6 86.7 1972
Australia 93.5 NA NA NA 1500
New Zealand 93.4 93.8 91.7 83.6 500
US 92.3 92.2 92.2 80.3 2250
Canada 96.8 96.9 93.0 75.9 750
Mexico 94.1 93.6 83.7 77.8 1463
Central America 87.5 86.0 95.7 66.1 446
Cuba 89.8 NA NA NA 246
Car Is 87.8 NA NA NA 246
DR Haiti 85.9 NA NA NA 248
Anchorage 99.6 NA NA NA 250
Hawaii 95.2 NA NA NA 250
Iceland 97.6 NA NA NA 250
78
Actual and Expected Samples from
Cropland Area ProportionsAfrica
# Expected
crop samples
# crop samples
in the EM
Zone 1 9 47
Zone 2 20 29
Zone 3 71 39
Zone 4 8 9
Zone 5 39 49
Zone 6 24 26
Zone 7 14 8
ChinaChina East 169 144
West A 7 13
West B 2 8
South AsiaZone 1 56 59
Zone 2 9 12
Zone 3 108 151
Zone 4 144 164
Zone 5 157 140
Zone 6 10 31
SEAsiaZone 1 79 96
Zone 2 78 56
Zone 3 77 67
Zone 4 62 71
Zone 5 108 102
Zone 6 14 12
Zone 7 36 57
South America# Expected crop
samples
# crop samples
in the EM
Zone 1 5 6
Zone 2 34 30
Zone 3 56 49
Zone 4 41 44
Zone 5 23 26
MongoliaZone 1 0 0
Zone 2 0 1
Zone 3 10 15
CanadaZone 1 2 1
Zone 2 54 62
Zone 3 9 6
USZone 4 31 21
Zone 5 24 26
Zone 6 66 63
Zone 7 13 13
Zone 8 107 98
Zone 9 37 26
Zone 10 18 45
Zone 11 68 58
Zone 12 15 24
MexicoZone 13 9 12
Zone 14 25 67
Zone 15 18 20
Zone 16 62 58
Zone 17 52 25
Zone 18 70 50
Central America# Expected
crop samples
# crop samples
in the EM
Zone 19 80 69
Zone 20 50 52
Cuba, Car Is, DR, Hawaii, and
AlaskaZone 21 37 77
Zone 22 48 74
Zone 23 7 43
Zone 24 41 40
Zone 25 0 4
Europe
Zone 1 166 169
Zone 2 151 157
Zone 3 143 164
Zone 4 150 166
Zone 5 14 37
Zone 6 93 97
Zone 7 5 9
Zone 8 24 41
Zone 9 49 40
79
S.No Region Zone No Over all
accuracy
Producer's
accuracy
User's
accuracy
Crop proportions
in zone
Crop proportions
of total cropland
Expected
samples
Error matrix
samplesRepetitive Sampling
# Name # % % %
1 Africa 1 96.4 91.5 89.6 3.46 9.1 9 47 18 16 12 18 13
2 93.6 72.4 72.4 8.04 26.4 20 29
3 90.8 94.9 63.8 28.4 21.7 71 39
4 96.8 88.9 53.3 3.29 6.2 8 9
5 91.3 89.8 72.1 15.5 16.6 39 49
6 94.8 84.6 80.0 9.4 19.9 24 26
7 92.4 37.5 17.7 5.6 0.1 14 8 21 29
2 NA 1 98.4 100.0 20.0 0.76 2 2 1
2 92.4 78.1 95.0 21.63 80.15 54 62
3 99.6 100.0 90.9 3.44 17.83 9 6
4 95.2 92.6 71.4 12.41 1.95 31 21
5 97.2 82.8 92.3 9.6 3.16 24 26
6 96.0 75.0 56.3 5.01 6.84 66 63
7 90.4 81.8 86.3 26.22 36.18 13 13
8 88.8 95.2 81.0 42.94 32.12 107 98
9 92.0 64.5 69.0 14.62 9.16 37 26
10 89.6 80.8 72.4 7.07 4.46 18 45
11 91.2 92.4 78.2 2.04 5.22 68 58
12 90.4 71.0 59.5 6.04 0.87 15 24
13 98.8 83.3 90.9 3.45 2.81 9 12
14 91.1 79.1 86.9 10.18 5.4 25 67
15 93.5 70.0 58.3 7.34 8.1 18 20
16 90.9 89.7 76.5 25.81 33.89 62 58
17 97.2 88.0 84.6 20.75 19.47 52 25
18 93.0 94.0 78.3 30.51 30.29 70 50
19 84.4 94.2 65.0 31.95 82.34 80 69
20 90.7 100.0 69.3 20.38 17.65 50 52
21 89.8 90.9 79.6 15.09 1.94 37 77
22 85.9 96.0 68.9 19.41 1.58 48 74
23 87.8 79.1 61.8 3.03 0.05 7 43
24 95.2 90.0 81.8 16.34 0.12 41 40
25 99.6 100.0 80.0 0.98 0 0 4
Accuracy Summary by Zones
80
S.No Region Zone No Over all
accuracy
Producer's
accuracy
User's
accuracy
Crop proportions
in zone
Crop proportions
of total cropland
Expected
samples
Error matrix
samplesRepetitive Sampling
# Name # % % %
3 Iceland 97.6 68.4 100.0 4.24 100.0 11 19
4 Mongolia 1 100.0 NA NA 0 0 0 0
2 100.0 100.0 100.0 0.04 3.3 0 1
buffer 10km 97.5 73.3 99.5 5.20 96.7 8 15
5 NewZealand 1 96.8 92.3 87.8 13.7 18.8 34 39
2 90.0 91.4 80.4 43.3 81.2 108 81
6 China East 91.6 83.3 84.2 28.5 95.1 169 144
West A 97.7 65.0 81.3 8.2 3.9 7 13
West B 97.1 28.6 100.0 0.9 1 2 8
7 South America 1 96.8 50.0 37.5 1.85 1.8 5 6
2 94.8 83.3 75.8 18.05 17.62 34 30
3 92.4 79.6 81.3 22.32 29.67 56 49
4 94.0 90.9 78.4 16.28 40.6 41 44
5 95.6 80.8 77.8 9.06 10.28 23 26
8 SE Asia 1 85.6 83.3 80.0 31.7 47.6 79 96
2 91.2 73.2 85.4 31.1 7.2 78 56
3 83.2 67.2 69.2 30.7 14.5 77 67
4 88.8 97.2 72.6 24.9 14.4 62 71
5 84.0 87.3 76.7 43.2 4.7 108 102
6 96.4 83.3 58.8 5.4 4.9 14 12
7 91.2 73.7 85.7 14.3 6.7 36 57
9 South Asia 1 80.4 71.2 56.8 22.26 13.54 56 59
2 95.6 33.3 57.1 3.41 2.49 9 12
3 76.4 73.5 85.4 43.35 20.22 108 151
4 83.1 85.4 88.6 57.49 38.3 144 164
5 78.7 74.3 86.0 62.63 23.86 157 140
6 92.4 48.4 83.3 4.16 1.59 10 31
10 Europe 1 88.8 92.3 91.2 55.98 3.7 166 (140) 169
2 79.2 82.2 84.3 26.23 7.9 151 (66) 157 126 127 132
3 87.2 87.8 92.3 33.81 24.47 143 (85) 164 130 116 118
4 87.2 87.4 93.0 41.54 7.46 150 (104) 166
5 90.8 40.5 93.8 5.78 1015 14 37
6 87.2 89.7 79.8 37.65 11.41 93 (94) 97
7 99.6 88.9 100.0 8 1.08 5 9
8 90.4 43.9 94.7 9.51 28.68 24 41
9 94.0 90.0 76.6 19.59 14.16 49 40
11 Australia Entire 97.6 98.8 79.0 8 100 20 80
buffer 25km 93.1 71.4 64.1 11.6 100 29 70
Buffer 50km 93.5 65.9 69.2 9.5 100 24 82
Accuracy Summary Table Contd.
81
QUESTIONS DURING DISCUSSION THIS AFTERNOON
Thanks!!
82
Recommended