55
Crop balances Handbook 2018 Edition

2018 Edition...Eurostat collects the final balance sheets for the main cereal crops and oil seed crops. This handbook is meant to serve as a practical reference document for all national

  • Upload
    others

  • View
    3

  • Download
    0

Embed Size (px)

Citation preview

Page 1: 2018 Edition...Eurostat collects the final balance sheets for the main cereal crops and oil seed crops. This handbook is meant to serve as a practical reference document for all national

Crop balances Handbook 2018 Edition

Page 2: 2018 Edition...Eurostat collects the final balance sheets for the main cereal crops and oil seed crops. This handbook is meant to serve as a practical reference document for all national

2

Preface Following the developments on the cereal crops market and on the oil seed crops market is essential. Reliable high quality statistics on crop balances provide an important tool for agricultural decision makers.

Annual crop production statistics, information on cereal and oilseed stocks, agricultural trade

statistics and statistics on utilization are the main pillars for crop balance sheets.

The European Statistical System Committee endorsed in its 34th meeting on 22 September 2017 the

ESS Agreement on Crop Balance Data on Main Cereals and Oilseeds. The purpose of this ESS

Agreement is to guarantee that the European Commission has at its disposal harmonised high

quality data on the supply and use of main cereals and oilseeds. Based on this ESS agreement

Eurostat collects the final balance sheets for the main cereal crops and oil seed crops.

This handbook is meant to serve as a practical reference document for all national statistical

authorities involved in the compilation of crop balance sheets.

Luxembourg, May 2018

Page 3: 2018 Edition...Eurostat collects the final balance sheets for the main cereal crops and oil seed crops. This handbook is meant to serve as a practical reference document for all national

3

Table of contents

1 Introduction ................................................................................................................................. 5

1.1 General Introduction .................................................................................................................. 5

1.2 User needs assessment ........................................................................................................... 5

1.3 Legal basis for Crop balance sheets ....................................................................................... 6

2 Methodology ............................................................................................................................... 7

2.1 General information ................................................................................................................... 7 2.1.1 Crop balance sheets .......................................................................................................... 7 2.1.2 Cereal crops ....................................................................................................................... 7 2.1.3 Oilseed crops ...................................................................................................................... 7 2.1.4 Unprocessed products ...................................................................................................... 8 2.1.5 Processed products ........................................................................................................... 8

2.2 Coverage ..................................................................................................................................... 8 2.2.1 Cereals ................................................................................................................................ 8 2.2.2 Oilseeds............................................................................................................................... 9

2.3 Reference area ........................................................................................................................... 9

2.4 Reference period ....................................................................................................................... 9

2.5 Reporting frequencies ............................................................................................................... 9

2.6 Units of measurement ............................................................................................................. 10 2.6.1 Metric tonnes in standard humidity................................................................................ 10 2.6.2 Grain equivalents for processed products (cereals) ................................................... 10

3 Classification ............................................................................................................................ 11

3.1 Crop balance classification ..................................................................................................... 11

3.2 Hierarchy of crop balance sheets .......................................................................................... 12 3.2.1 Cereals .............................................................................................................................. 12 3.2.2 Oilseeds............................................................................................................................. 13

3.3 Definitions of the balance entries .......................................................................................... 14 3.3.1 Usable production ............................................................................................................ 15 3.3.2 Humidity............................................................................................................................. 16 3.3.3 Imports ............................................................................................................................... 16 3.3.4 Exports .............................................................................................................................. 17 3.3.5 Stocks ................................................................................................................................ 18 3.3.6 Domestic use .................................................................................................................... 20

4 Data processing ........................................................................................................................ 27

4.1 Calculation of aggregates ....................................................................................................... 27 4.1.1 Calculation of aggregates (cereals) .............................................................................. 27 4.1.2 Calculation of aggregates (oilseeds) ............................................................................. 28

4.2 Imputation ................................................................................................................................. 28 4.2.1 Calculating an entry as a balance ................................................................................. 28

Page 4: 2018 Edition...Eurostat collects the final balance sheets for the main cereal crops and oil seed crops. This handbook is meant to serve as a practical reference document for all national

4

5 Data structure ........................................................................................................................... 29

5.1 General information ................................................................................................................. 29

5.2 SDMX ........................................................................................................................................ 29

5.3 Code lists .................................................................................................................................. 29 5.3.1 Crop products ................................................................................................................... 29 5.3.2 Balance items ................................................................................................................... 30 5.3.3 Reference year ................................................................................................................. 30 5.3.4 Observation status ........................................................................................................... 31 5.3.5 Observation confidentiality ............................................................................................. 31

6 Data transmission..................................................................................................................... 33

6.1 Transmission method (EDAMIS) ........................................................................................... 33

6.2 File naming conventions ......................................................................................................... 34

6.3 Completeness........................................................................................................................... 34

6.4 Flags for data transmission .................................................................................................... 34 6.4.1 Observation status flags ................................................................................................. 35 6.4.2 Confidentiality flags.......................................................................................................... 36

7 Data validation .......................................................................................................................... 37

7.1 Introduction ............................................................................................................................... 37

7.2 Validation procedure................................................................................................................ 38

7.3 Validation rules ......................................................................................................................... 39

8 Quality reports .......................................................................................................................... 41

8.1 Introduction ............................................................................................................................... 41

8.2 Communication of methodological changes ........................................................................ 41

8.3 Quality reports .......................................................................................................................... 41 8.3.1 ESS Standard for Quality Reports (ESQRS 2.0) ........................................................ 42 8.3.2 Updates to the quality reports ........................................................................................ 47

8.4. Transmission method (ESS-MH) ........................................................................................... 47

9 Data dissemination ................................................................................................................... 49

9.1 Confidentiality ........................................................................................................................... 49

9.2 Dissemination tables ............................................................................................................... 49

9.3 Dissemination of EU aggregates ........................................................................................... 49

Annex I .............................................................................................................................................. 51

Conversion coefficients for the revised list of the 2016 combined nomenclature ...................... 51 Coefficients for cereal crops ........................................................................................................... 51 Coefficients for oilseed crops ......................................................................................................... 54

Page 5: 2018 Edition...Eurostat collects the final balance sheets for the main cereal crops and oil seed crops. This handbook is meant to serve as a practical reference document for all national

5

1 Introduction

1.1 General Introduction Crop Balances for cereals cover supply and use of the main cereals (common wheat & spelt, durum

wheat, barley and grain maize & corn-cob-mix) in a reference area during a reference period. Crop

Balances are also done for the main oilseeds rape and turnip rape seeds, sunflower seed and soya

in an equivalent way.

Those balance sheets constitute a synthesis of a large number of quantitative data available for

agriculture, trade and food and other processing industry. The crop balances are balanced when

total supply equals total use. Total supply is defined as the sum of usable production, initial stocks

and imports; total use as the sum of domestic use, final stocks and exports.

Crop Balance data are used by the Commission, mainly DG Agriculture and Rural Development, for

agricultural market management purposes.

The national crop balances for main cereals and main oilseeds are worked out by the Member States

on the basis of common EU concepts described in this handbook.

1.2 User needs assessment The Crop Balances for the main crop products are an important tool to monitor the food security and

the functioning of the crop product markets. The purpose of the supply balance is twofold: on the one

side in the mean of the prediction (prospective) for the next harvest year and on the other side

retrospective for the harvest year done. Eurostat collects the final balance sheets.

Eurostat has collected the supply balance sheet data for a large number of crop products (cereals,

oilseeds and fats, root crops, dry pulses, vegetables and permanent crops) on voluntary basis from

the 1950's up until 2013, when the data collection was stopped due to the lack of legal basis and

data quality issues.

Food security issues are increasingly becoming a political priority, in particular since the price peak

of 2007-2008 and 2010. The G-20 agricultural Ministers have identified market transparency as a key

feature for avoiding excessive price volatility. In this context, the EU has committed itself to send

regular updates of the crop balances for main cereals, oilseeds and rice to the AMIS1 (Agricultural

1 AMIS (Agricultural Market Information System) was established at the request of the Agriculture Ministers of the G20 in 2011. It is an inter-agency platform to enhance food market transparency and encourage coordination of policy actions in response to market uncertainty.

1 Introduction

Page 6: 2018 Edition...Eurostat collects the final balance sheets for the main cereal crops and oil seed crops. This handbook is meant to serve as a practical reference document for all national

6

1 Introduction

Market Information System) secretariat in the framework of the G-20 initiative. In addition, individual

Member States participating to the G-20 (Germany, France, the United Kingdom and Italy plus Spain

as an observer) have committed themselves to provide their balance data to AMIS but then agreed

that the European Commission will transmit balance data at EU level on their behalf. Therefore,

having access to solid and timely information on balance data both at EU and Member State level is

of critical importance for monitoring market developments and for fulfilling the policy commitments

towards G-20.

1.3 Legal basis for Crop balance sheets The European Statistical System Committee endorsed in its 34th meeting on 22 September 2017 the

ESS Agreement on Crop Balance Data on Main Cereals and Oilseeds. The purpose of this ESS

Agreement is to guarantee that the European Commission has at its disposal harmonised high

quality data on the supply and use of main cereals and oilseeds.

AMIS is structured around five main pillars that are interlinked and mutually reinforcing: market monitoring, analysis, collection of the latest and most reliable data on crop balances, capacity building for improved statistical information and policy dialogue for disseminating the key market information.

Page 7: 2018 Edition...Eurostat collects the final balance sheets for the main cereal crops and oil seed crops. This handbook is meant to serve as a practical reference document for all national

7

2 Methodology

2.1 General information

2.1.1 Crop balance sheets

The crop balance sheets can be seen as a commodity counter-part to financial balance sheets which

center on the supply and demand for money available to a business. For the domain of agriculture

Eurostat collects the final crop balance sheets for selected cereal crops and oilseed crops.

2.1.2 Cereal crops

Cereals are herbaceous plants of the graminaceous family (with some exceptions, such as

buckwheat) cultivated mainly for their grain.

Whole cereals are used primarily for human consumption and animal feed and increasingly to

produce bioenergy. They are also used to produce drinks and industrial products (for example,

adhesives and starch). They are generally stored whole and, to a lesser extent, in the form of

processed products such as flour. They are mostly traded whole. The market for the by-products of

the second stage processing of cereals is in general a different market from the cereal market itself.

This applies in particular to products intended for human consumption.

The crop balances ‘cereals’ include both cereals harvested dry for grain (raw product) regardless of

use and the by-products of grain (but only those after first-stage processing, which are mentioned in

section 11 of the combined nomenclature CN). Second stage processing is excluded from the crop

balance.

2.1.3 Oilseed crops

Oilseeds are cultivated both for their high levels of fatty matter (oils intended for human consumption

and industrial use) and for their high levels of protein (cakes for animal feed).

Rape and turnip rape seeds, sunflower seed and soya harvested dry, regardless of the use, are

included in the oilseeds balances. A number of Member States only produce a few types of oilseeds.

That implies that in a non-producing country's balance data, the supply side only covers imports and

initial stocks.

2 Methodology

Page 8: 2018 Edition...Eurostat collects the final balance sheets for the main cereal crops and oil seed crops. This handbook is meant to serve as a practical reference document for all national

8

2 Methodology

The oilseeds are used primarily for processing (crushing), with the goal of producing oils for human

consumption and industrial use (e.g. soap, biofuels). Crushing results in a by-product: cakes. These

are mainly used as animal feed.

The oilseeds supply balances include only the raw product.

2.1.4 Unprocessed products

An unprocessed (raw) product is a product in its initial stage. Both agricultural products 'Cereals' and

'Oilseeds' refer to (naked) healthy, fair and average grain with characteristics in accordance with

current legislation on the standard qualities of crop production and any marketing standards in force.

These characteristics include humidity and impurity content. The humidity must therefore be

provided. It needs to correspond to the standard EU-humidity.

2.1.5 Processed products

Processed products are obtained by processing a raw product. There may be one or more

processing stages.

The Crop Balance data includes only the first stage processing products such as flour. By-products

of processing, i.e. bran, are not taken into account in the balance. Processed products are expressed

in grain equivalent by using technical conversion coefficients. Annex I provides a list of processed

products and Eurostat coefficients for converting them into grain equivalent, based on the combined

nomenclature.

If the balance data of a Member State includes a country specific processed product, that is not yet

included in the combined nomenclature, the Member State should inform Eurostat about this product

– so that it can be added to the annex with a proper conversion coefficient.

2.2 Coverage

2.2.1 Cereals

The crop balances for cereals are drawn up for four types of main cereals:

1. common wheat (Triticum aestivum L. emend. Fiori et Paol.) and spelt (Triticum spelta L.);

2. durum wheat (Triticum durum Desf.);

3. barley (Hordeum vulgare L.);

4. grain maize (Zea mays L.) and corn-cob-mix

Page 9: 2018 Edition...Eurostat collects the final balance sheets for the main cereal crops and oil seed crops. This handbook is meant to serve as a practical reference document for all national

9

2 Methodology

2.2.2 Oilseeds

The Crop Balances for oil seeds are drawn up for three types of oilseeds:

1. rape and turnip rape seeds (Brassica napus L. and Brassica rapa L. var. oleifera (Lam.));

2. sunflower seed (Helianthus annus L.);

3. soya (Glycine max (L.) Merril).

2.3 Reference area The Crop Balance data are worked out for the customs territory of the Member States, defined in

accordance with Regulation (EC) No 471/2009 on Community statistics relating to external trade with

non-member countries and with the implementing regulations linked to the main regulation.

2.4 Reference period The reference period for both cereals and oilseeds crop balances is a calendar year: 1st January –

31st December. It corresponds to the crop harvest year concept in Annual Crop Statistics.

In addition to the initial stock (1st of January) and final stock (31st of December), the end of marketing

year stocks (30th June) are included in the data collections.

2.5 Reporting frequencies The Member States shall transmit to the Commission (Eurostat) the data relative to crop balances on

the 30th November n+1 for the crop harvest year n.

The transmission schedule up to crop harvest year 2020 is presented in Table 1

Table 1 – Transmission schedule

Crop harvest year2 Reference period Final data

transmission: ACS

Data transmission:

CBS

2017 1.1.2017-31.12.2017 31.9.2018 30.11.2018

2018 1.1.2018-31.12.2018 31.9.2019 30.11.2019

2019 1.1.2019-31.12.2019 31.9.2020 30.11.2020

2020 1.1.2020-31.12.2020 31.9.2021 30.11.2021

2 Crop harvest year is the calendar year in which the harvest begins (Regulation (EC) No 543/2009). This definition is used in Annual crop statistics.

Page 10: 2018 Edition...Eurostat collects the final balance sheets for the main cereal crops and oil seed crops. This handbook is meant to serve as a practical reference document for all national

10

2 Methodology

2.6 Units of measurement

2.6.1 Metric tonnes in standard humidity

All items in the Crop Balance for main cereals must be established in thousands of metric tonnes

(1000 t) in the standard humidity, which is:

14% for cereals

9% for rape and turnip rape

9% for sunflower seeds

14% for soya seed

2.6.2 Grain equivalents for processed products (cereals)

In order to be included in the balance, processed products are quantified in terms of grain equivalent.

Their weight is converted into grain weight necessary for their production by using technical

coefficients.

A list of processed products and technical coefficients for conversion into grain weight is given in

Annex I.

Page 11: 2018 Edition...Eurostat collects the final balance sheets for the main cereal crops and oil seed crops. This handbook is meant to serve as a practical reference document for all national

11

3 Classification

3.1 Crop balance classification

For each agricultural commodity the final crop balance sheet has in principle the same structure.

For a balanced sheet 'supply' equals 'use'. Related to terminology it should be mentioned that in

publications sometimes for 'use' also 'demand' is used. 'Change in stocks' corresponds to the

difference between closing stocks and opening stocks.

Opening stock (1.Jan)

Usable Production

Imports

Domestic

Exports

Closing stock (31.Dec)

Supply

Use

3 Classification

Page 12: 2018 Edition...Eurostat collects the final balance sheets for the main cereal crops and oil seed crops. This handbook is meant to serve as a practical reference document for all national

12

3 Classification

3.2 Hierarchy of crop balance sheets

3.2.1 Cereals

Page 13: 2018 Edition...Eurostat collects the final balance sheets for the main cereal crops and oil seed crops. This handbook is meant to serve as a practical reference document for all national

13

3 Classification

3.2.2 Oilseeds

Page 14: 2018 Edition...Eurostat collects the final balance sheets for the main cereal crops and oil seed crops. This handbook is meant to serve as a practical reference document for all national

14

3 Classification

3.3 Definitions of the balance entries

For the definition of the different entries always the same structure is used.

Note that in case a Member State applies a different methodological approach or if the definitions are

different than the ones presented in this handbook, this needs be explained in the Quality Report,

and the impact on the comparability of results needs be assessed.

3.3.i balance item

Code Label Unit

Definition of the item

Followed by general explanations related to the item.

In the fields below some examples are given, what should be included or excluded.

Important: those lists are indicative, but not exhaustive; i.e. the definition does not restrict itself to

those examples that are being mentioned in there!

Includes

Excludes

Page 15: 2018 Edition...Eurostat collects the final balance sheets for the main cereal crops and oil seed crops. This handbook is meant to serve as a practical reference document for all national

15

3 Classification

3.3.1 Usable production

Code Label Unit

PROD_U Usable production 1000 ton (in ref. EU humidity)

Usable production is defined as harvested production minus on-holding losses and wastage, as

mentioned in the Eurostat Handbook for annual crop statistics (Regulation (EC) No 543/2009

amended by Commission Regulation (EU) 2015/1557 & ESS agreement on annual crops).

Table 2 - Production terms

Biological (real) production

Harvested production

Usable production

Marketed production Direct

consumption

On-holding losses

and wastage

Harvesting

losses

Non-

harvested

Includes

For cereals: only grain produced from the soil of the country itself during the reference

period (1st January to 31st December year n)

For oilseeds: only oilseeds produced from the soil of the country itself during the reference

period (1st January to 31st December year n)

For both cereals and oilseeds: the harvest of late crops in southern countries, which can

take place during the first months of year n+1 (Figure 1).

Figure 1 – Reference period

Tip

The usable production can be estimated by extracting an estimate of the amount of on-holding

losses from the harvested production provided to Eurostat in the scope of the Crop Statistics

(according to Reg. 543/2009/EC)

Page 16: 2018 Edition...Eurostat collects the final balance sheets for the main cereal crops and oil seed crops. This handbook is meant to serve as a practical reference document for all national

16

3 Classification

3.3.2 Humidity

Code Label Unit

HUMD Humidity (predefined) 1000 ton (in ref. EU humidity)

In order to be able to draw the EU-level balance, the production needs to be reported in the standard

EU-humidity

Humidity of oilseeds at harvest may vary between EU Member States. The standard EU-humidity

values are indicated in chapter 2.6 above .

3.3.3 Imports

Code Label Unit

IMP Imports 1000 ton (in ref. EU humidity)

IMP_IEU28 Imports intra-EU-28 1000 ton (in ref. EU humidity)

IMP_XEU28 Imports extra-EU-28 1000 ton (in ref. EU humidity)

3.3.3.1 IMPORTS OF CEREALS

Corresponds to the sum of intra-EU28 imports (IMP_IEU28) and extra-EU28 imports (IMP_XEU28)

They need to be reported in grain equivalent.

Includes

Grain

First stage processed products of grain, which are used for human consumption (exceptions

apply)

Excludes

Beer

Alcohol for human consumption

By-products of processing (in order to avoid double counting)

Page 17: 2018 Edition...Eurostat collects the final balance sheets for the main cereal crops and oil seed crops. This handbook is meant to serve as a practical reference document for all national

17

3 Classification

3.3.3.2 IMPORTS OF OILSEEDS

Corresponds to the sum of intra-EU28 imports (IMP_IEU28) and extra-EU28 imports (IMP_XEU28)

They need to be reported in grain equivalent.

Includes

Raw products (seeds and beans) for sowing

Raw products (seeds and beans) for direct human consumption

Raw products (seeds and beans) for crushing

Excludes

Processed products

3.3.4 Exports

Code Label Unit

EXP Exports 1000 ton (in ref. EU humidity)

EXP_IEU28 Exports intra-EU-28 1000 ton (in ref. EU humidity)

EXP_XEU28 Exports extra-EU-28 1000 ton (in ref. EU humidity)

3.3.4.1 EXPORTS OF CEREALS

Corresponds to the sum of intra-EU28 exports (EXP_IEU28) and extra-EU28 exports (EXP_XEU28)

Includes

Grain

First stage processed products of grain, which are used for human consumption (exceptions

apply)

Quantities provided as food aid

Excludes

Beer

Alcohol for human consumption

By-products of processing (in order to avoid double counting)

Page 18: 2018 Edition...Eurostat collects the final balance sheets for the main cereal crops and oil seed crops. This handbook is meant to serve as a practical reference document for all national

18

3 Classification

3.3.4.2 EXPORTS OF OILSEEDS

Corresponds to the sum of intra-EU28 exports (EXP_IEU28) and extra-EU28 exports (EXP_XEU28)

Includes

Raw products (seeds and beans) for sowing

Raw products (seeds and beans) for direct human consumption

Raw products (seeds and beans) for crushing

Quantities provided as food aid

Excludes

Processed products

3.3.5 Stocks

Code Label Unit

STK_I Initial stock 1000 ton (in ref. EU humidity)

STK_F Final stock 1000 ton (in ref. EU humidity)

STK_CH Change in stock 1000 ton (in ref. EU humidity)

STK_ECY Stock at the end of crop marketing year 1000 ton (in ref. EU humidity)

In the balance data collection stock needs to be assessed at three points in time:

initial stock (1st January year n = 31st December year n-1)

stock at end of the crop marketing year (30th June year n)

final stock (31st December year n)

The 'Change in stock' item is the difference between the final and initial stock.

For cereals, stocks cover both unprocessed and processed products. The stock of first stage

processing products is measured in grain equivalent (see Annex I).

Includes

Farm stocks (grain only)

Stocks of collection organisations, intervention or storage bodies

Wholesale trade stocks: importers, exporters, warehouses, trade

Stocks of seed organisations (grain only)

Stocks for denaturing (grain only)

Stocks of processing plants: flour mills, mills, semolina factories, producers of cattle feed,

starch mills, food industries, other processing industries

Government and strategic stocks

Excludes

Stocks at retail level (DOM_HCN)

Household stocks (DOM_HCN)

Page 19: 2018 Edition...Eurostat collects the final balance sheets for the main cereal crops and oil seed crops. This handbook is meant to serve as a practical reference document for all national

19

3 Classification

3.3.5.1 INITIAL STOCK (STK_I)

Initial stock (or opening stock or beginning stock) is defined as all cereals (in grain equivalent) or

oilseeds (in grain equivalent) available on the farm or on the market at the beginning of the calendar

year (1st January year n).

The initial stock corresponds to the final stock of the previous reference period (31st Dec. year n-1).

Tip

Sometimes, industrial firms are obliged to declare their stocks on a monthly or annual base to a

public institute or a private association of producers. These data can be used for the crop balances.

If this is not the case a data collection/estimation needs to be planned (e.g. a survey).

3.3.5.2 STOCK AT THE END OF THE CROP MARKETING YEAR (STK_ECY)

The stock at end of the crop marketing year (30 June year n) is defined as all cereals (in grain

equivalent) or all oilseeds (in grain equivalent) available on the farm or on the market on that day.

Tip

Sometimes, industrial firms are obliged to declare their stocks on a monthly or annual base to a

public institute or a private association of producers. These data can be used. If this is not the case,

a data collection/estimation needs to be planned (e.g. a survey)

3.3.5.3 FINAL STOCK (STK_F)

Final stock (or closing stock or ending stock) is defined as all cereals (in grain equivalent) or all

oilseeds (in grain equivalent) available the stock at the end of the calendar year (31st Dec., year n)

which is equal to the initial stock of the next reference period.

The final stock is equal to the initial stock of the next reference period.

3.3.5.4 CHANGE IN STOCK (STK_CH)

The 'Change in stock' item is the difference between the final and the initial stock.

Tip

For imports and exports, use the data that are provided to Eurostat in the scope of COMEXT. If more

precise data are available, they can also be used

Page 20: 2018 Edition...Eurostat collects the final balance sheets for the main cereal crops and oil seed crops. This handbook is meant to serve as a practical reference document for all national

20

3 Classification

3.3.6 Domestic use

3.3.6.1 DOMESTIC USE OF CEREALS (DOM)

‘Domestic’ includes all possible uses of cereals (excluding exports and final stock) in the reference

area during the reference period.

Includes

Human consumption

Industrial use

Industrial bioethanol or biofuel use

Animal feed

Seeds (for sowing)

Losses

3.3.6.1.1 Human consumption (DOM_HCN)

As the crop balance has no entry for processing, the entry of human consumption is quite extensive.

Includes

Quantities of unprocessed cereals for human consumption, on the territory, during the

reference period

Quantities of processed cereals (only 1st stage of processing) for human consumption, on

the territory, during the reference period. (e.g. wheat flour or wheat starch)

Quantities consumed directly by producers and their families

Quantities delivered by the wholesalers to processors, retailers, canteens, restaurants,

hospitals, etc.

The losses and variations in stocks of retailers, collectives and consumers

Excludes

Quantities entered in ‘industrial use’ (DOM_IND)

Code Label Unit

DOM Domestic use 1000 ton (in ref. EU humidity)

DOM_HCN Human consumption 1000 ton (in ref. EU humidity)

DOM_IND Industrial use 1000 ton (in ref. EU humidity)

DOM_IND_BIO Industrial bioethanol or biofuel use 1000 ton (in ref. EU humidity)

DOM_ANF Animal feed 1000 ton (in ref. EU humidity)

DOM_SEED Seeds 1000 ton (in ref. EU humidity)

DOM_LOSS Losses 1000 ton (in ref. EU humidity)

Page 21: 2018 Edition...Eurostat collects the final balance sheets for the main cereal crops and oil seed crops. This handbook is meant to serve as a practical reference document for all national

21

3 Classification

Example of a raw product and processed products classification:

Raw, unprocessed product: maize

1st processing stage starch

2nd processing stage glucose

3rd processing stage isoglucose

Tip

Data from a panel household survey on expenditure on food can give some guidelines, but likely this

needs to be estimated.

3.3.6.1.2 Industrial use (DOM_IND)

The industrial use of cereals is defined as the quantity used by the industry to produce industrial

products other than those intended for human consumption.

By convention, beer and alcoholic drinks are regarded as industrial products, which do not enter into

the entry of human consumption.

Includes

Wheat for the production of bio-ethanol

Wheat for the production of industrial starch

Wheat for the production of dextrin

Wheat for the production of alcohol

Barley for the production of beer

Excludes

Quantities intended for producing products for human consumption (DOM_HCN)

Quantities intended for producing products for animal feed (DOM_ANF)

Tip

Several data sources could be used:

company data on output of processed products for industrial use (PRODCOM data);

in several Member States firms are obliged to declare the volume of alcohol production

derived from cereals. These data can be used, if the declaration includes information on the

used cereal type.

Not included in Crop Balance sheets

Page 22: 2018 Edition...Eurostat collects the final balance sheets for the main cereal crops and oil seed crops. This handbook is meant to serve as a practical reference document for all national

22

3 Classification

3.3.6.1.3 Industrial bioethanol or biofuel use (DOM_IND_BIO)

Includes

Quantity of cereals used by the industry to produce bioethanol

Quantity of cereals used by the industry to produce biofuel

Tip

Several data sources could be used:

company data on the use of cereals for biofuel;

farmers’ data on the amount of cereals grown for the production of biofuel.

In some Member States, cereals are not used for biofuel production; in others only a few cereal

commodities are used for biofuel production.

3.3.6.1.4 Animal feed (DOM_ANF)

Includes

Quantities of grain (raw or processed products) used for direct animal feed on the farm

Quantities of grain (raw or processed products) used by the feeding stuff industry

Excludes

By-products of industrially used grains that are further used as animal feed

Tip

Several data sources could be used:

the number of animals in the country and the feed input ratio;

company data of the animal feed industry.

Page 23: 2018 Edition...Eurostat collects the final balance sheets for the main cereal crops and oil seed crops. This handbook is meant to serve as a practical reference document for all national

23

3 Classification

3.3.6.1.5 Seeds (DOM_SEED)

Quantities of grain used for sowing during the next production cycle.

Includes

Seed directly used on the farm (taken from own production)

Seed bought on the market

The amount of cereals needed for seed can easily be calculated by using readily available data (e.g.

sown area); for estimating the amount of cereals that is lost (entry of losses) a fixed rule can be

applied, but should be adapted to national circumstances.

Tip

Use data for the area seeded in the next cropping year and multiply this by the amount of seed

needed per ha.

3.3.6.1.6 Losses (DOM_LOSS)

Losses from the use of cereals for human consumption, industrial use, animal feed and seeds.

Includes

Losses during storage, transport, processing and packing

Losses due to denaturation3

Excludes

On-the-farm losses and wastage (as they are not part of the usable production)

Tip

Use a fixed percentage (known percentage or e.g. 1-2%, if not known) of domestic use.

3 Denaturation is a process in which proteins lose their original state by application of some external stress or compound such as a strong acid or base, a concentrated inorganic salt, an organic solvent (e.g., alcohol or chloroform), radiation or heat.

Page 24: 2018 Edition...Eurostat collects the final balance sheets for the main cereal crops and oil seed crops. This handbook is meant to serve as a practical reference document for all national

24

3 Classification

3.3.6.2 DOMESTIC USE OF OILSEEDS (DOM)

Code Label Unit

DOM Domestic use 1000 ton (in ref. EU humidity)

DOM_CRU Crushing 1000 ton (in ref. EU humidity)

DOM_SEED Seeds 1000 ton (in ref. EU humidity)

DOM_LOSS Losses 1000 ton (in ref. EU humidity)

‘Domestic’ includes all possible uses of oilseeds (excluding exports and final stock) in the reference

area during the reference period.

In the balance data for oilseeds as described in this handbook only the entries of crushing, seeds

and losses have to be specified.

Includes

Crushing

Seeds (for sowing)

Losses

Excludes

Human consumption

Animal feed

3.3.6.2.1 Crushing (DOM_CRU)

Crushing refers to the quantities of oilseeds used for crushing (processing) in order to produce

vegetable oils and cakes.

The oils are used either for human consumption or for industrial use; the by-product cakes are an

important ingredient of animal feed.

Usually, if a balance data for a raw product includes the entry of processing (crushing), such a

balance is accompanied by one or more sub-balances for the processed products, for example for

vegetable oils and for cakes. However, in the oilseeds balance as described in this handbook, this

practice is not applied.

Tip

Several data sources could be used:

company data on the crushed amount of oilseeds (PRODCOM data);

company data on output of processed products of oils and cakes;

calculated as fixed percentage of domestic use.

Page 25: 2018 Edition...Eurostat collects the final balance sheets for the main cereal crops and oil seed crops. This handbook is meant to serve as a practical reference document for all national

25

3 Classification

3.3.6.2.2 Seeds (DOM_SEED)

Seeds refer to the quantities of oilseeds used for sowing during the next production cycle.

Includes

Seed directly used on the farm (taken from own production)

Seed bought on the market

Tip

Use data for the area seeded in the next cropping year and multiply this by the amount of seed

needed per ha.

3.3.6.2.3 Losses (DOM_LOSS)

This entry refers to the losses in the use and marketing of oilseeds.

Includes

Losses during storage, transport, crushing and packing

Losses due to denaturation4

Excludes

On-the-farm losses and wastage (as they are not part of the usable production)

Tip

Use a fixed percentage (known percentage or e.g. 1-2%, if not known) of domestic use.

4 Denaturation is a process in which proteins lose their original state by application of some external stress or compound such as a strong acid or base, a concentrated inorganic salt, an organic solvent (e.g., alcohol or chloroform), radiation or heat.

Page 26: 2018 Edition...Eurostat collects the final balance sheets for the main cereal crops and oil seed crops. This handbook is meant to serve as a practical reference document for all national

26

3 Classification

Page 27: 2018 Edition...Eurostat collects the final balance sheets for the main cereal crops and oil seed crops. This handbook is meant to serve as a practical reference document for all national

27

4 Data processing

4.1 Calculation of aggregates

4.1.1 Calculation of aggregates (cereals)

Code Label Aggregate

PROD_U Usable production

HUMD Humidity (predefined)

IMP Imports IMP_IEU28 + IMP_XEU28

IMP_IEU28 Imports intra-EU-28

IMP_XEU28 Imports extra-EU-28

STK_I Initial stock

SUPPLY Supply PROD_USE + IMP + STK_I

DOM Domestic use DOM_HCN + DOM_IND + DOM_ANF + DOM_SEED + DOM_LOSS

DOM_HCN Human consumption

DOM_IND Industrial use

DOM_IND_BIO Industrial bioethanol or biofuel use

DOM_ANF Animal feed

DOM_SEED Seeds

DOM_LOSS Losses

EXP Exports EXP_IEU28 + EXP_XEU28

EXP_IEU28 Exports intra-EU-28

EXP_XEU28 Exports extra-EU-28

STK_F Final stock

USE Use DOM + EXP + STK_F

STK_CH Change in stock STK_F - STK_I

STK_ECY Stock at the end of the crop marketing year

4 Data processing

Page 28: 2018 Edition...Eurostat collects the final balance sheets for the main cereal crops and oil seed crops. This handbook is meant to serve as a practical reference document for all national

28

4 Data processing

4.1.2 Calculation of aggregates (oilseeds)

Code Label Aggregate

PROD_U Usable production

HUMD Humidity (predefined)

IMP Imports IMP_IEU28 + IMPXEU28

IMP_IEU28 Imports intra-EU-28

IMP_XEU28 Imports extra-EU-28

STK_I Initial stock

SUPPLY Supply PROD_USE + IMP + STK_I

DOM Domestic use DOM_CRU + DOM_SEED + DOM_LOSS

DOM_CRU Human consumption

DOM_SEED Seeds

DOM_LOSS Losses

EXP Exports EXP_IEU28 + EXP_XEU28

EXP_IEU28 Exports intra-EU-28

EXP_XEU28 Exports extra-EU-28

STK_F Final stock

USE Use DOM + EXP + STK_F

STK_CH Change in stock STK_F - STK_I

STK_ECY Stock at the end of crop marketing year

4.2 Imputation Member States have to deliver the complete balance. Eurostat will not perform any imputation for

missing values on Member States data.

4.2.1 Calculating an entry as a balance

The Crop Balance is balanced when total supply equals total use. This implies that one entry of the

balance data can be derived as balance calculation. This could be a way of filling an entry for which

no data are available or for which it is complicated to collect data.

This approach should only be applied for entries with a fairly large size.

For example, in the case of the balance for oilseeds the entry of domestic use can easily be derived

as balance calculation if data for all remaining entries are available.

Page 29: 2018 Edition...Eurostat collects the final balance sheets for the main cereal crops and oil seed crops. This handbook is meant to serve as a practical reference document for all national

29

5 Data structure

5.1 General information By using EDAMIS web forms the corresponding SDMX files are generated automatically. So it is

guaranteed that the three files for structure definition, stylesheet definition and the XML file

containing the data, arrive as well-formed, syntactically correct files.

5.2 SDMX SDMX, which stands for Statistical Data and Metadata eXchange, is an ISO standard designed to

describe statistical data and metadata, normalise their exchange, and improve their efficient sharing

across statistical and similar organisations. It provides an integrated approach to facilitating statistical

data and metadata exchange, enabling interoperable implementations within and between systems

concerned with the exchange, reporting and dissemination of statistical data and their related meta-

information. (www.sdmx.org)

More Information on SDMX can be found on the following Eurostat webpage

http://ec.europa.eu/eurostat/web/sdmx-infospace/welcome.

5.3 Code lists

5.3.1 Crop products

From the code list for crop products only the following subset is used:

CODE DESCRIPTION

C1110 Common wheat and spelt

C1120 Durum wheat

C1300 Barley

C1500 Grain maize and Corn Cob Mix

I1110 Rape and turnip rape seeds

I1120 Sunflower seed

I1130 Soya

5 Data structure

Page 30: 2018 Edition...Eurostat collects the final balance sheets for the main cereal crops and oil seed crops. This handbook is meant to serve as a practical reference document for all national

30

5 Data structure

5.3.2 Balance items

From the codelist for the balance items the following subset of the codelist STK_FLOW is used:

CODE DESCRIPTION

BAL Balance

SUP Supply

PROD_U Usable production

HUMD_PC Humidity (%)

IMP Imports

IMP_IEU28 Imports intra-EU-28

IMP_XEU28 Imports extra-EU-28

STK_OP Opening stock (1st Jan year n)

USE Use

DOM Domestic

DOM_HCN Domestic - human consumption

DOM_IND Domestic - industrial use

DOM_IND_BIO Domestic - industrial bioethanol or biofuel use

DOM_ANF Domestic - animal feed

DOM_CRU Domestic - crushing

DOM_SEED Domestic – seeds

DOM_LOSS Domestic – losses

EXP Exports

EXP_IEU28 Exports intra-EU-28

EXP_XEU28 Exports extra-EU-28

STK_CL Closing stock (31st Dec N )

STK_CH Change in stock

STK_BMY Stock at the beginning of the marketing year (1st Jul year n-1 )

STK_EMY Stock at the end of the marketing year ( 30th

Jun year n)

5.3.3 Reference year

For the reference year the codelist for TIME is used.

CODE DESCRIPTION

2016 Year 2016

2017 Year 2017

2018 Year 2018

2019 Year 2019

2020 Year 2020

2021 Year 2021

2022 Year 2022

2023 Year 2023

2024 Year 2024

2025 Year 2025

2026 Year 2026

Page 31: 2018 Edition...Eurostat collects the final balance sheets for the main cereal crops and oil seed crops. This handbook is meant to serve as a practical reference document for all national

31

5 Data structure

5.3.4 Observation status

For flagging an observation value the following observation status flags (Obs_status) are available:

CODE DESCRIPTION

B Time series break

D Definition differs

E Estimated value

L Data exists but not collected

N Not significant

P Provisional value

U Low reliability

(empty) without flag

5.3.5 Observation confidentiality

In case that an observation value is either 'Not for publication' or for the case that statistical

confidentiality applies, they can be flagged with the appropriate flag (Obs_Conf) from below.

CODE DESCRIPTION

C Confidential statistical information

Page 32: 2018 Edition...Eurostat collects the final balance sheets for the main cereal crops and oil seed crops. This handbook is meant to serve as a practical reference document for all national

32

5 Data structure

Page 33: 2018 Edition...Eurostat collects the final balance sheets for the main cereal crops and oil seed crops. This handbook is meant to serve as a practical reference document for all national

33

5 Data structure

6.1 Transmission method (EDAMIS) The data are to be delivered in Web-Forms via EDAMIS (https://webgate.ec.europa.eu/edamis).

For information concerning EDAMIS, or data transmission to Eurostat in general, you can check the

EDAMIS Help Centre online for a user guide for data transmission

(https://webgate.ec.europa.eu/edamis/helpcenter/website/tools/ewp/index.htm) or contact directly the

relevant support team – [email protected].

Figure 2 – EDAMIS data transmission window

6 Data transmission

Page 34: 2018 Edition...Eurostat collects the final balance sheets for the main cereal crops and oil seed crops. This handbook is meant to serve as a practical reference document for all national

34

6 Data transmission

Figure 3 – EDAMIS Web Portal – Crop balances web form

6.2 File naming conventions As stated in 5.1, the SDMX files are created automatically, respecting the EDAMIS naming

convention.

6.3 Completeness Please report all balance items.

6.4 Flags for data transmission The data providers can use flags to communicate to Eurostat and to the data users some

specificities linked to the data. There are two types of flags available:

1. observation status flags

2. confidentiality status flags

Page 35: 2018 Edition...Eurostat collects the final balance sheets for the main cereal crops and oil seed crops. This handbook is meant to serve as a practical reference document for all national

35

6 Data transmission

6.4.1 Observation status flags

Observation status refers to particular information linked to the status of a single value in the data

transmission. It transfers important information both to Eurostat and the end users of the data. The

observation status flags are listed and explained in Table 3.

Table 3 – Observation status flags

Code value Code description Detailed explanation Visible on

the website

B Time series break This flag should be used to indicate a

break in the time-series due to e.g. change

in methodology or definition. The break

has to be described in the Quality Report.

(Value) b

D Definition differs Used to indicate slight deviations from the

established methodology (footnote-type

information); these divergences do not

imply a break in time series. This flag

should be used in cases where the

definition differs from the Eurostat

handbook definition. The definition has to

be defined in the Quality Report.

(Value) d

E Estimated value Observation obtained through an

estimation methodology (e.g. to produce

back-casts) or based on the use of a

limited amount of data or ad hoc sampling

and through additional calculations (e.g. to

produce a value at an early stage of the

production stage while not all data are

available). This flag is used for both MS

and Eurostat estimates in situations when

estimates are calculated for missing data.

(Value) e

L Missing value; data

exist but were not

collected

Used, for example, when some data are

not reported/disseminated because the

data is not collected.

:z

N Not significant Used to indicate an item which has a low

prevalence and is hence considered as

non-significant.

0n

P Provisional value An observation is characterized as

"provisional" when the source agency –

while it bases its calculations on its

standard production methodology –

considers that the data, almost certainly,

are expected to be revised.

(Value) p

U Low reliability This indicates existing observations, but

for which the user should also be aware of

the low quality assigned. These values are

taken into account in calculation the EU-

aggregates but not disseminated as

national values.

:u

Page 36: 2018 Edition...Eurostat collects the final balance sheets for the main cereal crops and oil seed crops. This handbook is meant to serve as a practical reference document for all national

36

6 Data transmission

6.4.2 Confidentiality flags

The confidentiality flag list is presented in Table 7.

Table 4 – Confidentiality flags

Code value Code description Detailed explanation Visible on the

website

C Confidential statistical

information

Confidential statistical information

(primary confidentiality) due to

identifiable respondents. Measures

also should be taken to prevent not

only direct access, but also indirect

deduction or calculation by other

users and parties, probably by

considering and treating additional

observations as “confidential”

(secondary confidentiality

management). No other use than

the above mentioned is allowed.

:c

Page 37: 2018 Edition...Eurostat collects the final balance sheets for the main cereal crops and oil seed crops. This handbook is meant to serve as a practical reference document for all national

37

7 Data validation

7.1 Introduction Validation is a key task performed in all statistical domains. It is important to have a common data

validation policy for the different statistical domains. Efficient data validation is essential for high

quality statistics. Guidelines for assigning validation responsibilities within the whole production

chain, standard validation levels, a good selection of validation rules, standards for validation reports

and error/warning messages and common documentation standards of the validation process are

important elements of a good data validation policy.

In principle all data validation processes share a common approach, which is shown in the diagram

below.

For the future it is an objective to document and formalize all validation and transformation rules

using only one standard language like VTL (Validation and Transformation Language). For the

moment each validation step is still documented in a specific not standardized way.

7 Data validation

Page 38: 2018 Edition...Eurostat collects the final balance sheets for the main cereal crops and oil seed crops. This handbook is meant to serve as a practical reference document for all national

38

7 Data validation

7.2 Validation procedure The data supplied to Eurostat are validated according to the following procedure:

Figure 4 - Validation in the Crop balance sheet process (GSBPM notation)

Step 4.3 is the first sub process of GSBPM where validation checks are done. Those checks are

purely related to one instance of a dataset. Due to the fact that Eurostat's Edamis web portal and

web forms are used the corresponding SDMX files, which include the data file, are created

automatically. This implies that they are syntactically correct and well formed, which corresponds to a

level 0 structural validation. Closely linked is a level 1 validation, which is a basic content validation.

There a basic checking of the records within the data file is done. Firstly a semantic check of the

records itself is made. Then a set of validation rules for an intra-file check is applied.

Step 5.3 is the part of the process where a level 2 validation takes place. In GSBPM this sub-process

is specifically referred to validation, it is in fact named ‘review & validate’. This sub-process examines

data to try to identify potential problems, errors and discrepancies. It can also be referred to as input

data validation. At this stage of the process the new data file is checked against the corresponding

time series. The new data are checked using predefined validation rules in a set order. In case

problems are found, suspicious or erroneous data are marked for manual inspection. At this stage it

is also checked whether all data for the reference year were reported, i.e. a check for completeness.

Step 6.2 is named 'Validate outputs'. In this sub-process statisticians validate the quality of the

outputs produced in accordance with a general quality framework and with expectations. For crop

balance data mirror checks (Validation Level 3) and consistency checks (Validation Level 4) are

done at this stage of the process. The crop balance data are compared with other agricultural

statistics and trade statistics.

In practice this is an iterative process. After those validation steps data are disseminated.

Page 39: 2018 Edition...Eurostat collects the final balance sheets for the main cereal crops and oil seed crops. This handbook is meant to serve as a practical reference document for all national

39

7 Data validation

7.3 Validation rules

Certain basic checks are done already very early in the process. For example: the absolute value of

a reported number has to be within the interval [0, 500 000]. Only for code 'Change in stock'

(STK_CH) the sign of the number can be negative.

Afterwards the following validation rules are currently used in MDT for level 2 validation:

IMP = IMP_IEU28 + IMP_XEU28

EXP = EXP_IEU28 + EXP_XEU28

DOM_IND >= DOM_IND_BIO

DOM = DOM_HCN + DOM_IND + DOM_ANF + DOM_CRU + DOM_SEED + DOM_LOSS

Remark: If a subitem is not defined for a certain crop product it is not considered for the

sum. E.g. for cereals DOM_CRU is not considered for the sum.

SUP = PROD_U + HUMD_PC + IMP + STK_OP

USE = DOM + EXP + STK_CL

STK_CH = STK_CL - STK_OP

Further validation rules for cross validation against Annual Crop Statistics and Trade statistics are

currently under development.

Page 40: 2018 Edition...Eurostat collects the final balance sheets for the main cereal crops and oil seed crops. This handbook is meant to serve as a practical reference document for all national

40

7 Data validation

Page 41: 2018 Edition...Eurostat collects the final balance sheets for the main cereal crops and oil seed crops. This handbook is meant to serve as a practical reference document for all national

41

8 Quality reports

8.1 Introduction Regulation (EC) No 223/2009 provides a reference framework for European statistics and requires

Member States to comply with the statistical principles and quality criteria specified in that

Regulation. Quality reports are essential for assessing, improving and communicating on the quality

of European statistics. The ESSC has endorsed a European Statistical System (ESS) standard for

Quality Reports Structure, in accordance with Article 12 of Regulation (EC) No 223/2009.

8.2 Communication of methodological changes

Member States are required to inform the Commission of methodological or other changes which

would have a considerable effect on the statistics.

This should be done by e-mail to [email protected] and updating the

corresponding quality report.

8.3 Quality reports The ESS Agreement on Crop Balances stipulates the obligation for the Member States to provide the

Commission (Eurostat) with a report on the quality of the data transmitted.

The first report is to be submitted before 30th November

In 2018 for reference year 2017

In 2021 for reference year 2020

In 2024 for reference year 2023

The reports will published on Eurostat website which follows the ESS Standard for quality reports.

8 Quality reports

Page 42: 2018 Edition...Eurostat collects the final balance sheets for the main cereal crops and oil seed crops. This handbook is meant to serve as a practical reference document for all national

42

8 Quality reports

8.3.1 ESS Standard for Quality Reports (ESQRS 2.0)

The ESS Standard for Quality Reports Structure (ESQRS) contains the description and

representation of statistical metadata concepts to be used for providing detailed information for

assessing data quality. The broad concepts used are compatible with the SDMX cross-domain

concepts and with the common terminology as published within the SDMX Glossary (2016). The

detailed quality concepts are based on the ESS Standard for Quality Reports (ESQR) from 2009.

The ESQRS is addressed to the European Statistical System. It is implemented at Eurostat and at

national level: the application of the concepts and sub concepts at European level and at national

level are provided in the ESS Handbook for Quality Reports (EHQR) from 2014 and the ESS

Guidelines for the implementation of the ESS Quality and Performance Indicators from 2014.

Table 5. Main headings of the ESS Standard for Quality Reports

Concept Name Descriptions

1 Contact

Individual or organisational contact points for the data or

metadata, including information on how to reach the contact

points.

1.1 Contact organisation The name of the organisation of the contact points for the data

or metadata.

1.2 Contact organisation unit An addressable subdivision of an organisation

1.3 Contact name The name of the contact points for the data or metadata.

1.4 Contact person function The area of technical responsibility of the contact, such as

"methodology", "database management" or "dissemination".

1.5 Contact mail address The postal address of the contact points for the data or

metadata.

1.6 Contact email address

1.7 Contact phone number The telephone number of the contact points for the data or

metadata.

1.8 Contact fax number Fax number of the contact points for the data or metadata.

2 Statistical presentation A general description of the statistical process, its outputs,

and their evolution over time

2.1 Data description

Main characteristics of the data set described in an easily

understandable manner, referring to the data and indicators

disseminated.

2.2 Classification system Arrangement or division of objects into groups based on

characteristics which the objects have in common.

2.3 Sector coverage Main economic or other sectors covered by the statistics.

2.4 Statistical concepts and

definitions Statistical characteristics of statistical observations.

2.5 Statistical unit Entity for which information is sought and for which statistics

are ultimately compiled.

2.6 Statistical population The total membership or population or "universe" of a defined

Page 43: 2018 Edition...Eurostat collects the final balance sheets for the main cereal crops and oil seed crops. This handbook is meant to serve as a practical reference document for all national

43

8 Quality reports

Concept Name Descriptions

class of people, objects or events.

2.7 Reference area The country or geographic area to which the measured

statistical phenomenon relates.

2.8 Time coverage The length of time for which data are available.

2.9 Base period The period of time used as the base of an index number, or to

which a constant series refers.

3 Statistical processing Operations performed on data to derive new information

according to a given set of rules

3.1 Source data Characteristics and components of the raw statistical data

used for compiling statistical aggregates.

3.2 Frequency of data

collection Frequency with which the source data are collected.

3.3 Data collection Systematic process of gathering data for official statistics.

3.4 Data validation Process of monitoring the results of data compilation and

ensuring the quality of the statistical results.

3.5 Data compilation Operations performed on data to derive new information

according to a given set of rules.

3.6 Adjustment

The set of procedures employed to modify statistical data to

enable it to conform to national or international standards or to

address data quality differences when compiling specific data

sets.

4 Quality management Systems and frameworks in place within an organisation to

manage the quality of statistical products and processes.

4.1 Quality assurance

All systematic activities implemented that can be

demonstrated to provide confidence that the processes will

fulfil the requirements for the statistical output.

4.2 Quality assessment Overall assessment of data quality, based on standard quality

criteria.

5 Relevance The degree to which statistical information meets the real or

perceived needs of clients.

5.1 User Needs Description of users and their respective needs with respect to

the statistical data.

5.2 User Satisfaction Measures to determine user satisfaction.

5.3 Completeness The extent to which all statistics that are needed are available.

5.3.1 Data completeness - rate The ratio of the number of data cells provided to the number

of data cells required.

Page 44: 2018 Edition...Eurostat collects the final balance sheets for the main cereal crops and oil seed crops. This handbook is meant to serve as a practical reference document for all national

44

8 Quality reports

Concept Name Descriptions

6 Accuracy and reliability

Accuracy: closeness of computations or estimates to the exact

or true values that the statistics were intended to measure

Reliability: closeness of the initial estimated value to the

subsequent value.

6.1 Accuracy - overall

Assessment of accuracy, linked to a certain data set or

domain, which is summarising the various components into

one single measure.

6.2 Sampling error

That part of the difference between a population value and an

estimate thereof, derived from a random sample, which is due

to the fact that only a subset of the population is enumerated.

6.2.1 Sampling error -

indicators

Precision measures for estimating the random variation of an

estimator due to sampling.

6.3 Non-sampling error Error in sample estimates which cannot be attributed to

sampling fluctuations.

6.3.1 Coverage error Divergence between the frame population and the target

population.

6.3.1.1 Over-coverage - rate The proportion of units accessible via the frame that do not

belong to the target population.

6.3.1.2 Common units -

proportion

The proportion of common units covered by both the survey

and the administrative sources in relation to the total number

of units in the survey.

6.3.2 Measurement error Error in reading, calculating or recording numerical value.

6.3.3 Non response error

The difference between the statistics computed from the

collected data and those that would be computed if there were

no missing values.

6.3.3.1 Unit non-response - rate

The ratio of the number of units with no information or not

usable information to the total number of in-scope (eligible)

units.

6.3.3.2 Item non-response - rate

The ratio of the in-scope (eligible) units which have not

responded to a particular item and the in-scope units that are

required to respond to that particular item

6.3.4 Processing error

The error in final data collection process results arising from

the faulty implementation of correctly planned information

methods.

6.3.4.1 Imputation - rate The ratio of the number of replaced values to the total number

of values for a given variable.

6.3.5 Model assumption error Error due to domain specific models needed to define the

target of estimation.

6.4 Seasonal adjustment The statistical technique used to remove the effects of

seasonal calendar influences operating on a series.

6.5 Data revision - policy Policy aimed at ensuring the transparency of disseminated

Page 45: 2018 Edition...Eurostat collects the final balance sheets for the main cereal crops and oil seed crops. This handbook is meant to serve as a practical reference document for all national

45

8 Quality reports

Concept Name Descriptions

data, whereby preliminary data are compiled that are later

revised.

6.6 Data revision - practice Information on the data revision practice.

6.6.1 Data revision - average

size

The average over a time period of the revisions of a key item.

The 'revision' is defined as the difference between a later and

an earlier estimate of the key item.

7 Timeliness and

punctuality Timeliness and punctuality

7.1 Timeliness Length of time between data availability and the event or

phenomenon they describe

7.1.1 Time lag - first result The number of days (or weeks or months) from the last day of

the reference period to the day of publication of first results.

7.1.2 Time lag - final result

The number of days (or weeks or months) from the last day of

the reference period to the day of publication of complete and

final results.

7.2 Punctuality Time lag between the actual delivery of the data and the

target date when it should have been delivered.

7.2.1 Punctuality - delivery and

publication

The number of days between the delivery/release date of data

and the target date on which they were scheduled for

delivery/release.

8 Coherence and

comparability

Coherence: adequacy of statistics to be reliably combined in

different ways and for various uses. Comparability: the extent

to which differences between statistics can be attributed to

differences between the true values of the statistical

characteristics.

8.1 Comparability -

geographical

Extent to which statistics are comparable between

geographical areas.

8.1.1 Asymmetry for mirror flow

statistics - coefficient

The difference or the absolute difference of inbound and

outbound flows between a pair of countries divided by the

average of these two values.

8.2 Comparability - over time Extent to which statistics are comparable or reconcilable over

time.

8.2.1 Length of comparable

time series

The number of reference periods in time series from last

break.

8.3 Coherence - cross

domain

Extent to which statistics are reconcilable with those obtained

through other data sources or statistical domains.

8.4 Coherence - sub annual

and annual statistics

The extent to which statistics of different frequencies are

reconcilable

8.5 Coherence - National

Accounts

The extent to which statistics are reconcilable with National

Accounts.

8.6 Coherence - internal Extent to which statistics are consistent within a given data

Page 46: 2018 Edition...Eurostat collects the final balance sheets for the main cereal crops and oil seed crops. This handbook is meant to serve as a practical reference document for all national

46

8 Quality reports

Concept Name Descriptions

set.

9 Accessibility and clarity The conditions and modalities by which users can obtain, use

and interpret data.

9.1 News release(s) Regular or ad-hoc press releases linked to the data.

9.2 Publications Regular or ad-hoc publications in which the data are made

available to the public.

9.3 Online database Information about on-line databases in which the

disseminated data can be accessed.

9.3.1 Data tables -

consultations

Number of consultations of data tables within a statistical

domain for a given time period displayed in a graph.

9.4 Microdata access Information on whether micro-data are also disseminated.

9.5 Other References to the most important other data dissemination

done.

9.6 Documentation on

methodology

Descriptive text and references to methodological documents

available.

9.7 Quality documentation Documentation on procedures applied for quality management

and quality assessment.

9.7.1 Metadata completeness -

rate

The ratio of the number of metadata elements provided to the

total number of metadata elements applicable.

9.7.2 Metadata - consultations Number of consultations within a statistical domain for a given

time period.

10 Cost and Burden Cost associated with the collection and production of a

statistical product and burden on respondents.

11 Confidentiality

A property of data indicating the extent to which their

unauthorised disclosure could be prejudicial or harmful to the

interest of the source or other relevant parties.

11.1 Confidentiality - policy

Legislative measures or other formal procedures which

prevent unauthorised disclosure of data that identify a person

or economic entity either directly or indirectly.

11.2 Confidentiality - data

treatment

Rules applied for treating the data set to ensure statistical

confidentiality and prevent unauthorised disclosure.

12 Comment Supplementary descriptive text which can be attached to data

or metadata

Page 47: 2018 Edition...Eurostat collects the final balance sheets for the main cereal crops and oil seed crops. This handbook is meant to serve as a practical reference document for all national

47

8 Quality reports

8.3.2 Updates to the quality reports

Each Member State shall inform about the most important issues and deviations from the rules

expressed in the ESSC agreement and in the handbook.

The comments should include the following issues:

1. What kind of threshold is used for the survey?

2. Is there any deviation from the instructions in the ESSC agreement and in the handbook?

3. What are the differences in methodology?

4. What are the differences in definitions of variables?

5. Are there important changes in comparison to a previous quality report?

8.4. Transmission method (ESS-MH) The European Statistical System – Metadata Handler (ESS MH) is a web application which has been

developed for the production, management, exchange and dissemination of European and national

reference metadata files. Its main objective is to enable the ESS members (Eurostat, NSI’s, Banks,

International organizations) to produce reference metadata files based on common European

Standards.

The Metedata handler is available at the following link: //webgate.ec.europa.eu/estat/spe/metaconv/.

In order to be granted access to the application, all ESS-MH users must have a functional ECAS

account.

Page 48: 2018 Edition...Eurostat collects the final balance sheets for the main cereal crops and oil seed crops. This handbook is meant to serve as a practical reference document for all national

48

8 Quality reports

Page 49: 2018 Edition...Eurostat collects the final balance sheets for the main cereal crops and oil seed crops. This handbook is meant to serve as a practical reference document for all national

49

Annex 1

9.1 Confidentiality Statistical confidentiality is a fundamental principle of European statistics. EU Regulation 223/2009

on European statistics defines confidential data as: "…data which allow statistical units to be

identified, either directly or indirectly thereby disclosing individual information".

For the data collection of crop balance sheets it is not very likely to need to flag data as 'confidential',

but nevertheless the possibility for flagging those items with 'C' exists.

9.2 Dissemination tables There will be two tables on Eurobase:

o Crop balance data on cereals

o Crop balance data on oilseeds

9.3 Dissemination of EU aggregates Partial EU-aggregates are calculated at Eurostat. At the date of publication of the handbook, they are

not expected to be published as not all member states signed the agreement.

9 Data dissemination

Page 50: 2018 Edition...Eurostat collects the final balance sheets for the main cereal crops and oil seed crops. This handbook is meant to serve as a practical reference document for all national

50

9 Data dissemination

Page 51: 2018 Edition...Eurostat collects the final balance sheets for the main cereal crops and oil seed crops. This handbook is meant to serve as a practical reference document for all national

51

Annex I

Annex I

Conversion coefficients for the revised list of the 2016 combined nomenclature

COEFFICIENTS FOR CEREAL CROPS

All processed products in the Crop Balance data should be expressed in grain equivalent. For this

purpose, product specific conversion coefficients are used. For doing the conversion, the quantity of

processed products should be multiplied by the conversion coefficient.

Example

A conversion coefficient of 1.37 for wheat flour means that:

1 kg of wheat flour is obtained by processing 1.37 kg of wheat grain;

1 kg of wheat flour x 1.37 = 1.37 kg of common wheat

The list of products of the Combined Nomenclature is not static but dynamic. This means that in the

course of time some products have been disappeared whereas other products have been added.

The table below provides an overview of the changes in the list of cereal products of the Combined

Nomenclature. The updating of the list is done in co-operation with the Commission and the Member

States. The list is updated upon a need. The status of the list is checked at least every second year

in the Crop Statistics Working Group meeting.

Relevant codes are given in:

chapter 10 of the Combined Nomenclature for grain (http://eur-lex.europa.eu/legal-

content/EN/TXT/PDF/?uri=OJ:L:2016:294:FULL&from=EN p. 106)

chapter 11 of the combined nomenclature for products of first-stage processing (http://eur-

lex.europa.eu/legal-content/EN/TXT/PDF/?uri=OJ:L:2016:294:FULL&from=EN p. 111)

Page 52: 2018 Edition...Eurostat collects the final balance sheets for the main cereal crops and oil seed crops. This handbook is meant to serve as a practical reference document for all national

52

Annex I

List of Combined Nomenclature Codes for cereal products that have been modified since 1988

Conversion coefficients for common wheat and processed products

Code CN 2016

Conversion coefficient

Description Start of validity of the CN code

End of validity of the CN code

10019110 1.00 Spelt seed for sowing 01/01/2012 31/12/2500

10019120 1.00 Seed of common wheat or meslin, for sowing 01/01/2012 31/12/2500

10019190 1.00 Wheat seed for sowing (excl. durum, common wheat and spelt)

01/01/2012 31/12/2500

10019900 1.00 Wheat and meslin (excl. seed for sowing, and durum wheat)

01/01/2012 31/12/2500

11010015 1.37 Flour of common wheat and spelt 01/01/1995 31/12/2500

11031190 1.37 Common wheat and spelt groats and meal 01/01/1988 31/12/2500

11032060 1.00 Wheat pellets 01/01/2002 31/12/2500

11041910 1.00 Rolled or flaked wheat grains 01/01/1988 31/12/2500

11042917 1.00 Hulled [shelled or husked] wheat grains 01/01/1990 31/12/1994

11042930 1.00 Pearled cereal grains (excl. barley, oats, maize or rice)

01/01/1988 31/12/1989

11042951 1.00 Cereal grains of wheat, not otherwise worked than kibbled

01/01/1995 31/12/2500

11042981 1.00 Cereal grains of wheat (other than hulled [shelled or husked], sliced or kibbled, pearled or not otherwise worked than kibbled)

01/01/1995 31/12/2500

11043010 0.75 Wheat germ, whole, rolled, flaked or ground 01/01/1988 31/12/2500

11071011 1.78 Wheat malt in flour form (excl. roasted) 01/01/1988 31/12/2500

11071019 1.33 Wheat malt (excl. flour and roasted) 01/01/1988 31/12/2500

11081100 1.69 Wheat starch 01/01/1988 31/12/2500

11090000 2.30 Wheat gluten, whether or not dried 01/01/1988 31/12/2500

Conversion coefficients for durum wheat and processed products

Code CN 2016

Conversion coefficient

Description Start of validity of the CN code

End of validity of the CN code

10011100 1.00 Durum wheat seed for sowing 01/01/2012 31/12/2500

10011900 1.00 Durum wheat (excl. seed for sowing) 01/01/2012 31/12/2500

11010011 1.37 Durum wheat flour 01/01/1995 31/12/2500

11031110 1.5 Groats and meal, of durum wheat 01/01/1994 31/12/2500

1988-1990 1991 1992 1994 1995 1996 2005 2006 2007 2008 2012

10011100

10011900

10019010 10019110

10019091 10019120

10019190

10019900

10030010 10031000

10030090 10039000

10051011

10051019

11031110 11031110

11031311

11031319

11031910 11031910

11031930 11031930

11032010 11032010

11032020 11032020

11042310

11042330

11042390

11042399

11042901

11042903

11042907 11042908

11042909

11042931 11042931

11042935 11042935

11042939 11042939

10011000

10051018

19

96

-20

05

no

mo

dif

ica

tio

n

20

08

-20

12

no

mo

dif

ica

tio

n

20

12

-20

16

no

mo

dif

ica

tio

n

11042904

11042930 11042930 11042930

11031310

10019099

11031920

11032025

1042340

11042398

Page 53: 2018 Edition...Eurostat collects the final balance sheets for the main cereal crops and oil seed crops. This handbook is meant to serve as a practical reference document for all national

53

Annex I

Conversion coefficients for barley and processed products

Code CN 2016

Conversion coefficient

Description Start of validity of the CN code

End of validity of the CN code

10031000 1.00 Barley seed for sowing 01/01/2012 31/12/2500

10039000 1.00 Barley (excl. seed for sowing) 01/01/2012 31/12/2500

11029010 1.37 Barley flour 01/01/1988 31/12/2500

11031920 1.37 Groats and meal of rye and barley 01/01/2012 31/12/2500

11032025 1.00 Pellets of rye and barley 01/01/2012 31/12/2500

11041961 1.00 Rolled barley grains 01/01/2002 31/12/2500

11041969 1.00 Flaked barley grains 01/01/2002 31/12/2500

11042904 1.00 Hulled, even sliced or kibbled barley grains 01/01/2012 31/12/2500

11042905 1.00 Pearled barley grains 01/01/2002 31/12/2500

11042908 1.00 Sliced, kibbled or otherwise worked barley grains (excl. rolled, flaked, hulled, pearled, and pellets and flour)

01/01/2012 31/12/2500

11071091 1.27 Malt in flour form (excl. roasted and wheat) 01/01/1988 31/12/2500

11071099 1.27 Malt (excl. roasted, wheat and flour) 01/01/1988 31/12/2500

11072000 1.49 Roasted malt 01/01/1988 31/12/2500

Conversion coefficients for grain maize and processed products

Code CN 2016

Conversion coefficient

Description Start of validity of the CN code

End of validity of the CN code

10051013 1.00 Three-cross hybrid maize seed 01/01/1988 31/12/2500

10051015 1.00 Simple hybrid maize seed 01/01/1988 31/12/2500

10051018 1.00 Hybrid maize seed for sowing (excl. three-cross and simple hybrid seed)

01/01/2012 31/12/2500

10051019 1.00 Hybrid maize seed (excl. Double, top cross, three-cross and simple hybrid maize seed)

01/01/1988 31/12/2011

10051090 1.00 Maize seed (excl. hybrid) 01/01/1988 31/12/2500

10059000 1.00 Maize (excl. seed) 01/01/1988 31/12/2500

11022010 1.40 Maize flour, with fat content of <= 1,5% by weight 01/01/1988 31/12/2500

11022090 0.45 Maize flour, with fat content of > 1,5% by weight 01/01/1988 31/12/2500

11031310 1.37 Groats and meal of maize, "corn", with a fat content, by weight, of <= 1,5%

01/01/1992 31/12/2500

11031311 1.37 Groats and meal of maize, with fat content of =< 1.5 % by weight, for the brewing industry

01/01/1988 31/12/1991

11031319 1.37 Groats and meal of maize, with fat content of =< 1.5 % by weight (excl. For the brewing industry)

01/01/1988 31/12/1991

11031390 1.37 Groats and meal of maize, "corn", with a fat content, by weight, of > 1,5%

01/01/1988 31/12/2500

11032040 1.00 Maize pellets 01/01/2002 31/12/2500

11041950 1.00 Rolled or flaked maize grains 01/01/1988 31/12/2500

11042340 1.00 Hulled maize grains, even sliced or kibbled; pearled maize grains

01/01/2012 31/12/2500

11042398 1.00 Sliced, kibbled or otherwise worked maize grains (excl. rolled, flaked, hulled, pearled, and pellets and flour)

01/01/2012 31/12/2500

11043090 0.30 Cereal germ, whole, rolled, flaked or ground (excl. wheat)

01/01/1988 31/12/2500

11081200 1.51 Maize starch 01/01/1988 31/12/2500

Page 54: 2018 Edition...Eurostat collects the final balance sheets for the main cereal crops and oil seed crops. This handbook is meant to serve as a practical reference document for all national

54

Annex I

COEFFICIENTS FOR OILSEED CROPS

The list of products of the Combined Nomenclature is not static but dynamic. This means that in the

course of time some products have been disappeared whereas other products have been added.

The table below provides an overview of the changes in the list of oilseed products of the Combined

Nomenclature.

The updating of the list is done in co-operation with the Commission and the Member States. The list

is updated upon a need. The status of the list is checked at least every second year in the Crop

Statistics Working Group meeting.

The relevant codes to be used are given in Chapter 12 of the Combined Nomenclature (CN).

(http://eur-lex.europa.eu/legal-content/EN/TXT/PDF/?uri=OJ:L:2016:294:FULL&from=EN p. 116).

List of Combined Nomenclature Codes for oilseed products that have been modified since 1988

Rape and turnip rape seeds

Code CN 2016

Conversion coefficient

Description of the CN code Start of validity of the CN code

End of validity of the CN code

12050010 1.00 Rape or colza seeds, for sowing 01/01/1988 31/12/2001

12050090 1.00 Rape or colza seeds (excl. for sowing) 01/01/1988 31/12/2001

12051010 1.00

Low erucic acid rape or colza seeds "yielding a fixed oil which has an erucic acid content of < 2% and yielding a solid component of glucosinolates of < 30 micromoles/g", for sowing

01/01/2002 31/12/2500

12051090 1.00

Low erucic rape or colza seeds "yielding a fixed oil which has an erucic acid content of < 2% and yielding a solid component of glucosinolates of < 30 micromoles/g", whether or not broken (excl. for sowing)

01/01/2002 31/12/2500

12059000 1.00

High erucic rape or colza seeds "yielding a fixed oil which has an erucic acid content of >= 2% and yielding a solid component of glucosinolates of >= 30 micromoles/g", whether or not broken

01/01/2002 31/12/2500

1988-1994 1994 2002 2012

12010010 12011000

12010090 12019000

12051010

12059000

12051090

12059000

12060091

12060099

12050090

12050010

19

94

-20

02

no

mo

dif

ica

tio

n

20

02

-20

12

no

mo

dif

ica

tio

n

20

12

-20

16

no

mo

dif

ica

tio

n

12060090

Page 55: 2018 Edition...Eurostat collects the final balance sheets for the main cereal crops and oil seed crops. This handbook is meant to serve as a practical reference document for all national

55

Annex I

Sunflower seed

Code CN 2016

Conversion coefficient

Description of the CN code Start of validity of the CN code

End of validity of the CN code

12060010 1.00 Sunflower seeds for sowing 01/01/1988 31/12/2500

12060090 1.00 Sunflower seeds (excl. for sowing) 01/01/1988 31/12/1993

12060091 1.00 Sunflower seeds, whether or not shelled and in grey and white striped shell (excl. for sowing)

01/01/1994 31/12/2500

12060099 1.00 Sunflower seeds, whether or not broken (excl. for sowing, whether or not shelled and in grey and white striped shell)

01/01/1994 31/12/2500

Soya

Code CN 2016

Conversion coefficient

Description of the CN code Start of validity of the CN code

End of validity of the CN code

12010010 1.00 Soya beans for sowing 01/01/1988 31/12/2011

12010090 1.00 Soya beans (excl. for sowing) 01/01/1988 31/12/2011

12011000 1.00 Soya bean seed, for sowing 01/01/2012 31/12/2500

12019000 1.00 Soya beans, whether or not broken (excl. seed for sowing)

01/01/2012 31/12/2500

12081000 1.00 Soya bean flour and meal 01/01/1988 31/12/2500

*