LatestfeaturesofMELODIES’underpinningtechnologypla;ormProcessingofOpenData

usingTerradueCloudPla;orm

HervéCaumontProjectAdvisoryBoardMee2ngBologna,October22nd2015

Point of Contact : Hervé Caumont, Program Manager http://www.terradue.com

•  Italian SME, created in 2006 –  ESA ESRIN spin-off (Rome)

•  UK subsidiary, created in 2011 –  Space Cluster (Harwell Oxford)

•  11 start-upers –  5 different EU nationalities

Cloud Services for Earth Sciences

Agenda

•  AcriDcalneedtosolve

helpingOpensciencetoaddressSocietalissues•  Threechallengesaheadwiththeexploita5onof

Earthobserva5onOpenData

•  TowardssustainableMELODIESservices whatwehavelearnt,andhowweimproved

•  TerradueCloudPla;orm’sBusinessModel newtypesofpartnershipsbasedonopenness

AcriDcalneedtosolve

OpenScienceaddressingenvironment-relatedsocietalissues,

globally

Our customers Earth sciences

Mécanique Appliquée et Sciences de l'Environnement

MERIS MKL3 User Guide

Copyright � 2006 ACRI-ST

MERIS

Medium Resolution Imaging Spectrometer

ENVISAT-1 Ground Segment

MERIS Level 3 - MKL3 User Guide

MERIS average water vapour in 2005

Title: MERIS Level-3 MKL3 User Guide

Doc. no: P0-RS-ACR-GS-2001

Issue: 1

Revision: 1

Date: June 14, 2006

ClimateChange

Oceanecosystem

EOdataisthere

…butEarthScienceapplicaDons

•  ares2llinsomeearlystages.•  Onlyafewopera2onalprocessestransferredtotheindustry,mostlywithinnichemarkets,

•  mainlyoutsideofthe“OpenWeb”anditspoten2altoscalethemoutglobally.

•  EOdatasetsremainverytechnicalproducts,•  withnoWeb-na2veprocessmaturedenough,hamperinginnovaDonsthatwouldimpactsocietalchallengesglobally.

11

TheWebasaPla;orm

Data-intensivescienceisthe4thparadigm

TheInternetcandomore“Youcanbereadingapaperbysomeoneandthengooffandlookattheiroriginaldata.Youcanevenredotheiranalysis.Oryoucanbelookingatsomedataandthengooffandfindoutalltheliteratureaboutthisdata.Suchacapabilitywillincreasethe‘informaDonvelocity’ofthesciencesandwillimprovethescien2ficproduc2vityofresearchers”–  JimGray,The4thparadigm,2009,MicrosoSResearch

Threechallengesahead

withtheexploitaDonofEarthobservaDonOpenData

3proverbsofPla;ormoperaDons

Ifyoucan'tbeat'em,join'em

APIs

Buildinnova2on

withoutowningallassets

Nomanisan

island

Pla;ormeconomy

Seek

partnershipsthatchallengeyouridea

Ifyoucan'tbeat'em,join'em

APIs

Buildinnova2on

withoutowningallassets

WheninRome,doastheRomansdo

Networkeffects

Exploitthe

Webatitsfullscale

Ifyoucan'tbeat'em,join'em

APIs

Buildinnova2on

withoutowningallassets

Nomanisan

island

Pla;ormeconomy

Seek

partnershipsthatchallengeyouridea

TerradueCloudPla;ormConceptofoperaDon

20

VirtualMachinesfordevelopers

myRPMs!

21

Clouddeploymentsreadytoscaleout

22

CloudStorageonrequest

23

DataAgency:auserdriven,automatedresourcesselector

Addconnector

24

CitableapplicaDons&datasets

TowardssustainableMELODIESservices

WhatwehavelearntaboutOpenData

WhatwehaveimprovedonTerradueCloudPla\orm

Weareaimingat

• Rapidprototypingandbenchmarkingofalgorithms• Seamlessdataaccesswhateverstageoftheprocess• Automateddataprocessingfornonexpertusers

26

Whatiscostly?

•  OpenDataaccessiss2llfragile,itdoesnotinheritedyettheresilienceoftheWeb.LinkedOpenDataisonestepaheadinthatdirec2on.

•  TherequiredknowledgestackforvaluingOpenDataiswidelyspread,andnosingleorganiza2oncanaffordthecosttocontrolitall.

•  Thelegalconstraintswithdissemina2nginforma2onproductsbasedonOpenDataares2llvaried,andare2me-consumingtounderstandwell.

Whatwe’velearntaboutOpenData

•  OpenDatabenefitscannottakeupwithoutearlyadopterservices,growingthepla\ormwithus

•  S2llneedtobeYercommunicateontheuseofavailableCloudservices:PaaS,DaaS,SaaSaresuppor2ngtheInforma2on-as-a-Serviceendgame

•  It’s2metospreadthewordonbusinessmodelsforpla\ormopera2ons:OpenScience,e-Gov,commercial,…

TerradueCloudPla;orm’s

BusinessModelNewtypesofpartnershipsbasedonopenness

ThecaseofMELODIESCloudPla;ormsupportforEnvironmentalservices

ESABiDS’14Conference

hdp://dx.doi.org/10.5281/zenodo.12728

32

HostedCommuniDes

5ClimateChange

Carbonmarket

Climatology

Oceanography

Shiplogis2cs

Landmanagement

Waterquality

Deser2fica2on

Biodiversity

Urbanaccoun2ng

Volcanology

Seismicanalysis

DisasterRiskReduc2on

ECFP7GEOWOW(2011-2013)

ECFP7SenSyF(2013-2015)

ECFP7MELODIES(2014-2016)

ESAExploita2onPla\orms(2014onwards)

8

14

ì

35+

H2020EcoPoten2al(2015-2018)

30+

Campaigns(2013onwards)

33

TheMELODIESuniqueopportuniDesforTerradueCloudPla;orm

ECFP7MELODIES(2014-2016)14

MELODIESbringscollabora2onopportuni2estodevelopandsustainonanEO-dataspecializedCloud

Pla\ormnewEnvironmentalservices

MELODIESbringsontoTerradueCloudPla\ormsomeuniqueLinkedDataManagementSolu2ons&experts

MELODIESallowstobederstructureandscale-uptheac2vi2esoftheOpera2onsSupportteamatTerradue

Partners’keydevelopmentsonthePla;orm

•  AdvancedHadoopusers,gepngreadyforlargescaledeploymentsofEOdataprocessing

•  AdvancedStrabonusers,buildingapplica2onsandbenchmarkingperformances

•  Somepoten2alpowerfulusecasesforMelodiesCloudPla\ormtodisseminateLinkedOpenDataproducts(we’restudyingtheintegra2onpoints)

34

35

So,inanutshell…;)

Moresolu2ons

TerradueCloudPla\orm-CurrentFlagships-

SoluDons

hdps://cloud.terradue.com

hdps://geohazards-tep.eo.esa.int/

CommuniDes

Moresolu2ons

Addsolu2ons AddCommuni2es

StrongerSoluDons&Communitybuildingahead!

hYp://melodiesproject.euhYp://www.terradue.com

@MelodiesProject

@terradue

References•  TerradueCloudPla\orm–DeveloperCloudSandboxdocumenta2on

hdp://docs.terradue.com/developer-sandbox•  ECFP7SenSyF–Sen2nelsSynergyFramework

hdp://www.sensyf.eu/•  ESAGeohazardsExploita2onPla\orm

hdps://geohazards-tep.eo.esa.int/•  ESABigDataFromSpaceConference2014

hdp://congrexprojects.com/2014-events/BigDatafromSpace/•  CantoneseproverbsJ

hdp://www.dramafever.com/news/81-cantonese-proverbs-explained-in-one-beau2ful-poster/

42