ORFEO Preparatory Program progress - Pleiades · ORFEO Preparatory Program progress CNES Preparatory Program S. CHERCHALI ORFEO Thematic meeting – May 21st, 2008 – CNES Paris

1ORFEO ORFEO ThematicThematic meeting meeting –– May 21st, 2008 May 21st, 2008 –– CNES ParisCNES Paris 1

ORFEO Preparatory Program progressCNES Preparatory Program

S. CHERCHALI

ORFEO ORFEO ThematicThematic meeting meeting –– May 21st, 2008 May 21st, 2008 –– CNES ParisCNES Paris 2

Plan of the presentation

■ ORFEO Preparatory Program� Organization and responsibilities for the program� Objectives

■ ORFEO Thematic activities� Objectives� First phase

• Summary & Results

� Second phase • Services & tools development, validation through feasibility studies

� Perspectives


■ Organization and responsibilities for the program � Program responsible :

• Earth observation delegation of CNES Strategy and Programmes Direction : Benoit BOISSIN

� Monitoring and technical chairing : CNES Toulouse Center (DCT/SI/AP service)

• Team coordination : Hélène De BOISSEZON• Thematic part : Selma CHERCHALI • Methodological part : Jordi INGLADA • Links between the methodological part / thematic part : Selma CHERCHALI• "ORFEO Accompaniment Program" server and simulated data : Soon Known

In coordination with the PLEIADES Project : Eric BOUSSARIE

ORFEO Preparatory Program



■ Objectives : � To define evaluate and prepare adequate future services� To prepare user to develop their own routine processes

• “in very close cooperation with the final users”

• “at ORFEO level to give the best answer”

■ Two complementary approaches� Methodology : About 50 researchers from 25 institutes

• Definition and development of tools for the operational exploitation of the images :– High volume of data's : Automatic processing mandatory– Processing techniques to be adapted to the new kind of visible objects

� Thematic : 55 users (mainly from institutions) • Better understanding of the users needs in terms of services

• Better understanding by the users of the performances and system limitations



■ Two phases :� Phase 1 : Identification of users needs (Services, Value-added Products, Tools)

Identification of methodology state of the art

� Phase 2 : Services & tools development , validation through feasibility studies

We are now in Phase 2 of the ORFEO Preparatory Program

2011

Phase2 Demonstrate the capacity of Orfeo data for development of new servicesobjectives : Facilitate Orfeo users tasks, thanks to specific tools : Orfeo ToolBox, etc.

2004Methodological work

2006 2007 2008 2009 2010Thematic work

2005 2006 2007 2008 2009 2010

Phase 1 Phase 2

Synthèse travaux GTPlan de travail 2006-2009

6ORFEO ORFEO ThematicThematic meeting meeting –– May 21st, 2008 May 21st, 2008 –– CNES ParisCNES Paris 6

ORFEO preparatory programThematic activities



■ ORFEO Preparatory Program

■ ORFEO Thematic activities� Objectives / Main thematic output awaited – Organisa tion – Chronology� First phase - RESULTS� ORFEO work plan logic 2006-2010� Second phase� Perspectives


ORFEO Thematic activities Objectives

� Main thematic output awaited� Assessment of ORFEO data capability to meet thematic requirements

� Demonstrate the capability for new products/services (i.e. product-sheets)

� Increase of technical expertise on HR optical and radar images� Raising ORFEO capability awareness among institutional users


Composition of the Thematic WG: CNES responsible person

1- Ocean & Coastal zone : A Sand / Soon Known

2- Risks & Humanitarian aid : A Husson / S. Cherchali

3- Cartography, Town and country planning : S Marzocchi / JP Cantou

4- Geology & Geophysics : S Hosford / S. Cherchali5- Hydrology : H Jeanjean / S. Cherchali6- Forest : H Jeanjean/ Soon Known

7- Agriculture : A Husson / Soon Known

8- Defence B Boissin / S. Cherchali

Belgian experts are present in 5 WG Austrian, Spanish and Swedish experts have recently integrated 5 WG

Spot Image representatives are present in 5 WG

Thematic WG mission:

Expression of convergent users needs

Specification of value-added products&services

Feasibility tested through pratical studies

ORFEO Thematic activitiesOrganisation : Main events / changes recently


ORFEO Thematic activitiesChronology

■ First phase� Identification for various applications of services and products:

• including operational constraints and order book

� Identification of needed functionalities and tools� Definition of feasibility studies

■ Second phase : � Validation using simulated Data Including the demons trations and

Validations of the new services




■ ORFEO Thematic activities� Objectives / Main thematic output awaited – Organisa tion – Chronology� First phase - RESULTS

• Phase 1 : Service/Product data sheet• Phase 1 : Service/Product data sheet Synthesis

• Phase 1 : Functionalities to develop

� ORFEO work plan logic 2006-2010� Second phase� Perspectives


ORFEO Thematic activitiesPhase 1 : Program progress

■ Phase 1 : � Thematic activities : Identification of needs in te rms of products, services,

tools and proposition of thematic feasibility studi es� Methodology activities : State of the art; R&D and research; assessment of

technical readiness of “priority functionalities” as defined by thematic groups.

2004

2011

Methodological work

2006 2007 2008 2009 2010

Thematic work

2005 2006 2007 2008 2009 2010

Phase 1 Phase 2

1st Meth/Them meeting

Thematic needs

Methodo state of the art


ORFEO Thematic activitiesPhase 1 : Service/Product data sheet

■ General description, objectives■ Technical specification

� Information required (nomenclature, spatial accurac y, precision level)� Ancillary data required� Surface and scale of elementary product� Format

■ Operational constraints assessment� Temporal constraints, delay between request and dat a reception, …

■ Yearly acquisitions evaluation� nb km², geographical location, …


ORFEO Thematic activitiesPhase 1 : Example of Service/Product data sheet


ORFEO Thematic activitiesPhase 1 : Example of List of Service/Product data sheet


….Product-

sheet….

WGx

Information to Pléiades & Cosmomission teams

Functionalities

Objects of interest

Informationrequired by WG experts

System constraints

Acquisition scenarii

Product-sheets synthesis

Methodologynetwork

Thematic WG experts

feasibility studies

From WG “product-sheet” to required “functionalities”

TechnicalTechnicalTechnicalTechnical

feasibilityfeasibilityfeasibilityfeasibility? ? ? ?

test on

practical

cases

ORFEO Thematic activitiesPhase 1 : Service/Product data sheet synthesis


ORFEO Thematic activitiesPhase 1 : Functionalities to develop

■ Methodological needs expressed by thematic WG �� Functionalities to develop� Main “geometric” functionalities

• Images superposition : Optical / Optical , Optical / SAR, SAR / SAR• Image / map and image / geographical database superp osition• Localisation, ortho-rectification, projection in the local geographical reference system• Correlation map – Distortion calculation (3D)• DTM & DEM• 3D navigation (at t, t+ ∆t….

� Radiometry: Reflectance estimation (atmospheric corr ection, calibration, radiative transfer model ….)

� Objects of general interest (VHR object Database) � Information extraction

• Objects recognition (specific list to be built)• Specific land cover classification (burnt areas; fl ooded areas..)• Change detection between 2 or more images, optical/SAR : damaged areas identification• Change detection for some identified and recognized objects• Identification of some specific land cover classes (specific list to be built)• Calculation: water height, flood duration, …

snow height, …• Vectorization of areas


ORFEO Thematic activitiesORFEO workplan logic 2006-2010

■ The “thematic driven” approach adopted during the OR FEO preparatory programme has a twofold purpose:� Check whether ORFEO data can meet the thematic requirements

A panel of validation studies will allow to check this in a large number of situations, through the use of simulated data.

� Simplify and automate the production of specified information requirements, through adapted and efficient tools

Issues addressed by methodological network , OTB development, R&D, thesis and post-doc : the most important needs expressed by users.

■ Such purpose can only be met through � Relationships between Thematic and Methodology partners :

Methodology interest/competence areas list ↔ Thematic studies topics� Joint technical work , mainly (and logically) in the framework of Thematic

validation studies .■ Thematic studies should/could also be the place for “ inter-WG work ”

when covering common interest applications (agric & hydro; coastline & risks; coastline & hydro, …) : share of data, exp erience, results…




■ ORFEO Thematic activities� Objectives / Main thematic output awaited – Organisa tion – Chronology� First phase - RESULTS� ORFEO work plan logic 2006-2010� Second phase

• Phase 2 : Objectives – Present status of Thematic validation studies• Phase 2 : Technical Meetings (2007) – Objectives of specific t hematic meetings• Phase 2 : Links between Methodology & Thematic sections• Phase 2 : ORFEO ToolBox (OTB) • Phase 2 : Object database development using VHR images• Phase 2 : Overview of input images for “Thematic validation studies”

� Perspectives


ORFEO Thematic activitiesPhase 2 : Program progress

■ We are now in Phase 2 of the ORFEO Preparatory Prog ram■ Phase 2 :

� Services & tools development, validation through fea sibility studies

2004

2011

Methodological work

2006 2007 2008 2009 2010

Thematic work

2005 2006 2007 2008 2009 2010

Phase 1 Phase 2

Products, services & tools development and validation


ORFEO Thematic activitiesPhase 2 : Objectives

■Objectives : technical developments and validations� Demonstrate capacity of Orfeo data for creating new products & services

� Thematic feasibility studies results (26)

� Facilitate the Orfeo users tasks, thanks to specific methods and tools� R&D, thesis, post doc� OTB : Orfeo Tool Box development, new tools answering specific thematic demands� Validation of these tools by Thematic WG (through Thematic studies)

� Feed-back of Thematic WG on :� OTB test, validation, enrichment, through OTB concrete use (feedback on VHR Database images)

Links with Methodology network

Methodology� Test sites : Simulated images � OTB� Creation of a “Very High Resolution ORFEO dataset”, allowing technical exchanges between Thematic and Methodology teams, based on Thematic studies images


ORFEO Thematic activitiesPhase 2 : Present status of Thematic validation studies

26 studies started since 2004 (http://smsc.cnes.fr/PLEIADES)

Preference to studies requiring CSK & Pleiades data : CSK AO in april 2007ORFEO experts have contributed to this AO : 24 stu dies presented

Total/GTend 2004 end 2005 2006 2007 2008 AO CSK 08

GT1 / Sea & Coastline 3 3 6GT2 / Risks & Humanitarian aid 2 1 1 4GT3 / Carto. & Town planning 2 2 1 3 8GT4 / Geology & Geophysics 1 1 4 6GT5 / Hydrology 2 2 1 1 6GT6 / Forest 1 2 3GT7 / Agriculture 1 4 4 9GT8 / Security & Defense 2 6 8

26 24 50Total studies

Thematic studies started (optical and radar)


Configuration of the Thematic WG technical meetings :

1- Sea & Coastlines

2- Risks & Humanitarian aid

3- Cartography, Town and country planning

4- Geology & Geophysics

5- Hydrology

6- Forest

7- Agriculture

8- DefenceSpecific meetings : GT5 (Jul, 7th); GT1 (Sep, 17th) ; GT 5, 7 (October, 26th)

Functioning rules :

Attendees : WG experts + Methodology representative

Invited for information : other WG coordinators + Defence representatives

Jan, 18th

Mar, 23rd

May, 14th

ORFEO Thematic activitiesPhase 2 : Technical Meetings (2007)


ORFEO Thematic activities Phase 2 : Objectives of specific thematic meetings

The technical meetings for all WG in phase 2 …■ Thematic studies

� Technical progress (or results) of studies started since several months

� Presentation of technical objectives (and/or preliminary work) for studies started since a few weeks

� Identification of “hard points” that could be addressed by Methodology network� Expression of refined or new needs for OTB (Tools, Functionalities, etc)

� First feed-back (?) from Thematic experts about their OTB v1 experience

■ Technical exchanges� Thematic WG/ Methodology, inter-WG� Additional product-sheets and Thematic studies (with QB, Pelican, CSK data) ?

■ Post Pleiades� First assessment of WG 5-6-7 needs at the horizon 2015-2020


ORFEO Thematic activities Phase 2 : Links between Methodology & Thematic sections

■ First subjects of interest from Thematic WG� WG1: Numbering of ships, buoy, width beach (Internship CNES 2008)� WG2: Characterization of the damaged buildings : contract Arkemie� WG5: Detection flow pathways / riverbeds (Internship M2 2007 TETIS)

Segmentation : radiers / mouilles (Internship M2 2007 TETIS)Network Connectivity (Internship M2 2007 + 1 Internship 2009?)

� WG7: The use of optic and radar: orientation sillons/ radar analysis (Internship optic 2008 and another radar 2008-2009?)

� Example of generic need transverse to all WG: orthorectification and fusion of the data

■ PhD Thesis� « VHR imagery Flow paths, multi scale analysis of the river network system on watershed subjected to

flash floods » (Denis Maréchal)� Faults mapping Fuyun (Chine) (Marie Etchebes) Link with IPGP� Mapping and characterization of perennial crops (Baptiste Mougel)� Soil spatial variability mapping in 2009? Resp: N. Baghdadi

■ Several Internships planned and already started for some (5 internship (TETIS) in 2007)� WG5 : Internship M2 2008 : Accurate identification of land use (vineyards) and hydro objects (Roujan)� Internship conjoint WG5 et WG7 : Roughness mapping and soil surfaces characteristics 2008-2009?� WG5: Internship M2 : VHR optical images / Soil surface characteristics (Blosseville) 2008?� WG7: 2 Internships 2008 Mapping and characterization of perennial crops (OTB: SVM)


■ Internship developed by the Methodology network usi ng � OTB

� The VHR object database• Generic supervised object segmentation (any kind of object)• Automatic object counting using object templates (ships, buildings)

• Specific automatic object segmentation (vegetation, bare soils, water surfaces, shadows,…)

The three Internships are complementary

ORFEO Thematic activities Phase 2 : Links between Methodology & Thematic sections





• Phase 2 : Objectives – Present status of Thematic validation studies• Phase 2 : Technical Meetings (2007) – Objectives of specific t hematic meetings• Phase 2 : Links between Methodology & Thematic sections• Phase 2 : ORFEO ToolBox (OTB)

– Development context– Functionalities planned and proposed…

• Phase 2 : Object database development using VHR images• Phase 2 : Overview of input images for “Thematic validation studies”

� Perspectives


ORFEO Thematic activities Phase 2 : ORFEO ToolBox development context

■ The main concrete output of the ORFEO Preparatory P rogramme

� OTB development must focus on “priority functionali ties”� Identification of “priority functionalities” dependi ng on several parameters :

1- Functionalities required by thematic users

2- Technical feasibility3- Technology readiness, quoted from 1 ”research on basic technology” to 9 ”fully

operational”

4- OTB perimeter :generic functionalitiesexisting legal engagements, © and licences (DIAPASON, Medicis, …)

5- Financial and human means

� The “priority functionalities” identified by CNES: • Validation (or not) of our understanding (requirements, readiness)• Validation (or change) of identified priorities

R1 R9R4 R7


ORFEO Thematic activities Phase 2 : OTB Functionalities implemented and

proposed…

■ ORFEO ToolBox V1.0 (june 2006)� Image I/O� “Change indicators” detection tool (surface approach )� Segmentation / Classification� Feature extraction(the two last points = basic elements for “simple o bjects” detection)

■ ORFEO ToolBox V2.0 ( December 2007)� Image/image registration (when “readiness ” OK) � Image / DB registration (premiers éléments when “rea diness ” OK) � Image / Photography registration (when “readiness ” O K) � “Simple objects” detection� Fusion, Image synthesis basic tools: pyramidal deco mposition, fusion

operator

■ Further versions of ORFEO ToolBox (yearly, at least)

depending on OTB users feed-backs, R&D results, source code availability …





• Phase 2 : Objectives – Present status of Thematic validation studies• Phase 2 : Technical Meetings (2007) – Objectives of specific t hematic meetings• Phase 2 : Links between Methodology & Thematic sections• Phase 2 : ORFEO ToolBox (OTB) • Phase 2 : Object database development using VHR images

– Development of a predefined object catalogue– Objects and functions relating to a theme– Objects of general interest– Attributes concerning some objects of general inter est

• Phase 2 : Overview of input images for “Thematic validation studies”

� Perspectives


ORFEO Thematic activitiesPhase 2 : Object database development using VHR images

■ Development of a predefined object catalogue� Catalogue can be a support

• for algorithmic tests of extraction information tools• for the validation of these tools by thematic experts

� Catalogue interesting different themes considered i n Orfeo Preparatory Programme

• Sea & Coastal areas

• Risk & Humanitarian aid• Geology & Geophysics

� Information sources• QuickBird images used as basic information in Orfeo thematic studies• Reports and presentations prepared by the thematic groups• Thematic studies reports

• Hydrology• Forest• Agriculture

• Cartography & town and country planning


ORFEO Thematic activitiesPhase 2 : Objects and functions relating to a theme

Agricultural Functions� Soil humidity� Roughness� Variability of soil properties� Agricultural practices� Surface changes� Health indicators� Quantitative and qualitative

estimation� ….

Agricultural Objects� Crops� Row formations� Grassed borders� Slash-and-burn

agriculture� Winter vegetation� ….

Geological Objects� Faults� Terraces� Lava flow� ….

Risk Objects� Burnt areas� Gas tanks� Ploughlands� Military camps� Cars� Shelters� Log jams � Wetlands, burnt

areas, areas cleared of brushwood,

� ….

Geological Functions�Centimetric 3D displacements�Set of correlated surface measurements�…

Risk Functions� Calculating water

levels � Duration of flooding� Depth of snow� ….

Hydrology Objects�Saturated areas�Hydrogr. network�Major & low-water bed�…..

Hydrology Functions� Soil moisture content� Soil roughness …


Sea and Coastline Objects� Sand� Seagrass beds� Rocks� Coral� Ships � Colour of water� Oil discharge� Anchorage zones� Sea defense breakwater� …

Cartographic Objects

Cartographic nomenclature at 10.000e, 25.000e BD Carto, Scan25, BD Topo

� Networks� Industrial area� Commercial area� Housing� …..

Forest Objects� Forest stands� Isolated trees� Lanes� …..

Forest Functions■ Tree recognition

� Type, height, top� Estimation of damage� Budbreak, senescence,

abnormal change in reflectance

� Exposure (derived from DTM)

� …

Cartographic Functions � DEM (urban 3D models)� Alert / 3D changes� Surface measurements� DTM, slopes, orientations� Virtual reality� ….

Sea and Coastline Functions� Speeds and headings

(ships)� Surface currents� Wave directional

spectrum, sea state� Swell: height, direction,

length of wave� Wind speed and direction� ….

ORFEO Thematic activitiesPhase 2 : Objects and functions relating to a theme


ORFEO Thematic activitiesPhase 2 : Objects of general interest

■ Methodological needs expressed by thematic WG: some examples� NETWORKS AND INFRASTRUCTURES

• Road networks – With or without asphalt surfacing

• Railways• Hydrographic networks• Built-up areas, buildings• …

� LANDSCAPE• Plots• Access roads• Drainage canals• Hedgerows • Ditches• Forests• Glaciers• Trees• Vines• Orchards• Permanent grasslands• …


ORFEO Thematic activitiesPhase 2 : Attributes concerning some objects of general interest

■ Networks and infrastructures: Attributes:� Road networks Type of surfacing, width� Railways� Hydrographic networks Conne ctions� Built-up areas, buildings, Type: dense, reside ntial, commercial, hospitals,

…. Geometry: perimeter, v olumes, facets� Car parks Outline, type of surfacing� Bridges Local width � Dykes Length, width� ….

The « VHR ORFEO Database »integrates most of these objects,

from the QuickBird images or Pléiades simulations from the

thematic test sites






� Perspectives


ORFEO Thematic activitiesPhase 2: Overview of input images for Thematic validation studies

PELICAN raw images

Simulated PleiadesP, XS, P+XS images

Availability

Massif des Maures (WG2)

April 2006 October 2006 ORFEO Web site

Abers Wrach, Benoît (WG1)

Several unsuccessfultentatives in Oct

06,07...

Cannes (IQ site)Interesting for WG1

April 06 March 2007for WG1 needs

ORFEO Web site

Simulated Pleiades images


QuickBird imagesLevel 1A images Orthorectified

P and XS imagesOrthorectifiedP+XS images

1st set (archive images)

16 scenes on 12 sites 12 scenes 12 scenes

Received early 2006 April-June 2006 July 2006

2nd set (progr. images)

18 scenes on 9 sites 18 scenes 16 scenes

Received during 2006 Oct 2006 Dec 06 (Feb Mar 07)

A new setBoumerdes (QB: 20/03/2006) – Blosseville (Ikonos)Villamblain (QB: ) – Drôme 1500km2 acquired (two segments: one archive, th e other program.)Roujan (Ikonos) – Torrejon (Stereo Ikonos 19/02/2004)



CNES Expertise: radiometric and geometric qualificat ion of Kompsatimages

opportunity to acquire a set of free imagesInfo on Kompsat images : www.space-risks.com

■ Blosseville 29/03/2008 et 11/05/2008■ Boumerdes 06/03/2008■ Roujan 06/03/2008■ Bruche 08/05/2008■ Other ordered images ongoing: Villamblain (2), Mars eille (12),

Cannes (2 or 4), Drôme (6)

Kompsat images

A still potential acquisitions : Express your needsfuture acquisition for China



No new CSK simulation from RAMSES aerial data in 2006 (8 sites)

But one opportunity to get real X band SAR metric data « soon » :

Cosmo SkyMed AO June 07: 24 proposals: 15th Sept 07

SAR metric data in X band




■ ORFEO Preparatory ProgramORFEO Thematic activities� Objectives / Main thematic output awaited – Organisa tion – Chronology� First phase - RESULTS� ORFEO work plan logic 2006-2010� Second phase


� Perspectives


Results

Methodological part

Thematic part

Laboratoriesnetwork

7 civil WG + Defence


Pleiades&Cosmo simulated data

QuickBird images

ORFEO Web site

Thematicfeasibilitystudies

VHR DB

ORFEO objectsimage

patches

Requiredfunctions

Product sheets

MethodsOTB

develop.

MethodsOTB tests,

validation

ORFEO research«task force »

Interfaces withhighly specialisedsoftware (DEM…)

Interfaces withimage proc. COTS

OTB

Integration intooperational systems

Decision-makerssensibilisation

Value-AddedProducts &

Services

R&T CNES

PhD, PostDocInternal studies

Contracts


ORFEO Thematic activitiesPhase 2: Perspectives / Works to continue

■ And again reinforcement the links between Methodol ogy and Thematic Sections� Exchanges, users feed-backs, concrete links through the tools developed using the «

VHR object database»

■ Fostering joint methodology/thematic work in the fr ame of the Thematic studies� A list of the interest/competence areas of each met hodological member will be

established, to help Thematic responsible finding m ethodological support.� Methodological experts participating to a Thematic study will be invited to attend the

Thematic WG meetings and to make a feed-back to Met hodology network

■ How would you like to use OTB?� GUI� Tools for specific applications: ship detection, ro ad extraction, etc.� Integrated application for building processing chai ns

■ PhD Thesis, Post-Docs, specific Internships « Orfeo » a nd « OTB »� WG 2 / WG 5 Hydro, WG 2 /WG1 Sea and coastal zone, WG2 /Methodo, …

■ Works on metric radar, radar/optic : to be conducte d !!!



■ ORFEO Web site: http://smsc.cnes.fr/PLEIADES/

■ Regularly updated :� Program information: planned meetings,

minutes….� Methodology documentation

� Thematic documentation� Access to images

■ Additional data, new presentation of WG product-sheets, WG Synthesis reports, …



■ Some information� ORFEO Meeting 10 June 2008 at Spotimage : Presentation of Pleiades and

the Preparatory Program to the Added Value Compagny� Specific thematic meetings as needed� A planned technical meeting probably on March / Apr il 2009� ORFEO Symposium planned on October / November 2009� Some Thematic studies (the most achieved ones) will benefit of Pleiades

images during one year after in orbit acceptance� Final meeting one year after in orbit acceptance


Thank you for your attention …

Documents

ORFEO Preparatory Program progress - Pleiades · ORFEO Preparatory Program progress CNES Preparatory Program S. CHERCHALI ORFEO Thematic meeting – May 21st, 2008 – CNES Paris