View
222
Download
0
Embed Size (px)
Citation preview
8/8/2019 Apollon - Research Framework and investigation strategy
1/24
8/8/2019 Apollon - Research Framework and investigation strategy
2/24
Apollon Deliverable D.1.2
ICT PSP Project Reporting Template 2 FinalVersion
RevisionHistory
RevisionDate Author Organisation Description
1 3.8. Petra+Mark AaltoUniversity
Initialstructure
2 5.8. Petra Aalto Input from Deliverables x.1, 5.2and5.3
3 13.8. Petra Aalto Streamlining,morefocusonChapter6
4 20.8. Petra Aalto IntroducingDesignScienceframework
5 31.8. Petra Aalto Finalizing
6 5.11. Petra Aalto GAcomments
Statementoforiginality:
Thisdeliverablecontainsoriginalunpublishedworkexceptwhere
clearlyindicatedotherwise.Acknowledgementofpreviously
publishedmaterialandoftheworkofothershasbeenmade
throughappropriatecitation,quotationorboth.
Theinformationinthisdocumentisprovidedasisandnoguaranteeorwarrantyisgiventhattheinformationisfitforanyparticularpurpose.The
userthereofusestheinformationatitssoleriskandliability.
8/8/2019 Apollon - Research Framework and investigation strategy
3/24
Apollon Deliverable D.1.2
ICT PSP Project Reporting Template 3 FinalVersion
Contents
1. Introduction ...................................................................................................................... 4
2. ApollonResearchFramework .................................................................................... 4
3. ApollonResearchDesign .............................................................................................. 6
4. ApollonMethodologyandToolsdevelopment...................................................... 84.1 ReviewofStateoftheArtandLiterature........................................................................9 4.2 ApollonMethodologyCategories.................................................................................... 104.3 EvaluationFramework....... .................. ................. .................. .................. .................. ....... 11
5. ApplyingResearchFrameworktoApollonthematicexperiments ..............145.1 ApplyingResearchFrameworkIterationatGeneralAssembly......................... 16
6. APOLLONCross-WorkPackageCollaboration ....................................................167. CollaborationPracticesforApollonProject.........................................................207.1 Requirementcollection ..................................................................................................... 207.2 Liaisonpartnerstoverticalexperiments .................................................................... 217.3 Regularcollaborationforiterativeconceptvalidation .......................................... 227.4 Wikiforcollaborationandknowledgesharing......................................................... 227.5 SMEEngagement .................................................................................................................. 23
8. Conclusion........................................................................................................................24
8/8/2019 Apollon - Research Framework and investigation strategy
4/24
Apollon Deliverable D.1.2
ICT PSP Project Reporting Template 4 FinalVersion
1.IntroductionThe main issues addressed by the APOLLON project are the present lack ofLiving Lab methodology harmonization and collaboration, and the seriousdifficultiesofSMEsinengagingincross-borderLivingLabexperimentation.Inordertoprovideconcretecontributiontothisidentifiedgapincurrentresearchandoperations,APOLLONprojectmustconductdetailedanalysisof thevarious
stakeholders, their objectives, ways of working as well as factors hinderingcross-border experimentation and exchange. This work will culminate increation of scalable experience based APOLLON methodology for cross-borderlivinglabnetworks.
APOLLON research approach has been described in general terms in theDescription of Work (DoW). Thus this deliverable will focus on theimplementation of the project, and especially on the co-development with the
variousAPOLLONworkpackages.Itpresentsadesignsciencebasedapproachtoformalizing the collaboration, knowledge transfer and reporting between the
workpackage1andotherworkpackages.ThisoperationalmodelcanbecalledResearch Framework or Investigation strategy,and in essence it describestheway of working towards creation of common cross-border Living Lab
methodologywithinApollonproject.
TheResearchframeworkwilldescribetheprocesses,methodsandtoolsusedforcollaboration, knowledge sharing and joint development for vertical andhorizontaldomainswithintheAPOLLONprojectandrelatedstakeholders.The
related tools and environments will be provided by work package 7 Projectmanagement. Thetaskalsohas relation with work package 6 Dissemination,
especiallyforthepartofSMEengagement.
Collaboration betweenthepartnerswithin andacross living lab networkslike
APOLLONisnotatrivialtasktodo.Inthisdeliverableweaddressthisissuebyproposing concrete processes, responsibilities, and tasks that can be used as
guidance to set up and formalize the collaboration for maximal benefit for allstakeholders.
2.Apollon Research FrameworkIn APOLLON methodology development the principle objective is to supportAPOLLONthematicexperiments,andatthe same timecollaboratein validating
andcreatingagenericmethodologyforcrossborderlivinglabnetworks.Insucha complex environment there are several alternative approaches to groundingtheresearchanddevelopmentactivities.Thefigurebelowseekstoillustratethe
plethoraofresearchstrandsassociatedtoAPOLLONmethodologydevelopment.
8/8/2019 Apollon - Research Framework and investigation strategy
5/24
Apollon Deliverable D.1.2
ICT PSP Project Reporting Template 5 FinalVersion
Figure1.Strandsofresearchthatcontributeconcepts,terminologyandresearchframeworkforthecreationofAPOLLONMethodology
InthisoperatingcontextmethodologydevelopmentworkinWP1essentiallyhas
to focus on two types of elements: research activities and outputs. With thistwofoldsetofobjectivesweconsidermodifiedMarchandSmith(1995)designscienceframeworkthatconnectsthesetwoelementsasasuitablebasisforour
research framework. The proposed framework has been widely used foridentifyingandfillinghumanneedsinexplorativeresearch.Asaframeworkitisflexible enough to include and allow for the numerous objectives, drivers andexpectations of the various stakeholders. It further allows the use of variousdifferent research methods, cyclic development models, as well as the use of
iterations.
Activities/Outputs Build Evaluate Justify Theorize
Constructs
Model
Method
Installation
Table1.Designscienceframework(MarchandSmith,1995)
In this framework research outputs cover constructs, models, methods andinstantiations. In APOLLON context we apply the model with the following
representations:
8/8/2019 Apollon - Research Framework and investigation strategy
6/24
Apollon Deliverable D.1.2
ICT PSP Project Reporting Template 6 FinalVersion
- Constructsarethetermusedtodescribeproblemsorusecaseswithinadomain.
- A model is a set of statements representing research questions and
proposedoutcomes.- Amethodisasetofstepsusedtoperformatask.
- Aninstantiationinthiscontextisathematicpilot
According to the framework the research activities comprise building,evaluating, theorizing on and justifying artifacts. In APOLLON context the
scalable APOLLON methodology for cross-border Living Lab collaborationrepresents this artifact. The work that we perform towards this end includes
tasks of building, validating and evaluating methodology framework with the
thematic pilots. Build refers to creation of templates, scenarios and referencematerialtothepilotsbasedonstateoftheartknowledgeandexperiencesfrom
theexperiments.Validatingoftheproposedmodelsinaniterativemannerreferstothejustificationtask.Evaluatereferstothedevelopmentofcriteriaandthe
assessmentoftheoutput.TowardstheendoftheprojectWP1filterselementsthatarespecifictoonethematicdomainorexperimentfromthefinalversionofAPOLLONmethodology.Thistaskrepresentstheorizingin ourenvironment.In
thefollowingweseektoapplythisframeworktoAPOLLONproject.
3.Apollon Research DesignTheimportanceofcollaborationandseamlesscommunicationsishighlightedinApollon project due to the high level of participants and complexity of theproject. The project includes various application areas and contexts for the
developedmethodologiesandtools,and thus provides one-of-a-kind validationplatform for Living Lab methodologies and other developed models. Figure 1
belowdescribesthesetupofAPOLLONprojectandrelationshipsbetweenthevarious thematic experiences, methodology development and disseminationactivities.
8/8/2019 Apollon - Research Framework and investigation strategy
7/24
Apollon Deliverable D.1.2
ICT PSP Project Reporting Template 7 FinalVersion
Figure2.OverviewoftheverticalandhorizontalAPOLLONapproachSince the project aims at comparing the experiences in various thematicdomains, little practical level collaboration exists directlybetween the verticalexperiments in the project. Most of the sharing and escalation of things isorganized through management team meetings (organized by projectmanagement), or through dissemination events (responsibility of WP6
Dissemination). Thus it becomes evident that close collaboration is neededbetweentheoperationalworkpackagesofAPOLLONproject.Workpackage1ashorizontal work package will collect information from the various thematicexperiments,andcollectthelearningsintoaharmonizedmethodologyandtoolsfor cross-border living lab experimentation. Work package 1 will collect andsharethebestpracticesandprocessesthatareofcommoninterestandtogetherwiththeexperimentselaborateandsharethedevelopedmodelsinpracticalreallifesetting.
Thus this task focuses mainly on methodology and tool development for theverticalexperiments,andanalysestheopportunitiesandchallengesofapplyingshared approach and methodology for the shared development. This link isessential in ensuring that the experiments will follow similar approaches andthatthedevelopedmethodologyisrelevantandsufficientlyvalidatedwithinthe
vertical experiments in the course of the project. In practical terms thedeveloped framework willpresent theadded value of harmonized approaches
8/8/2019 Apollon - Research Framework and investigation strategy
8/24
Apollon Deliverable D.1.2
ICT PSP Project Reporting Template 8 FinalVersion
andworkingpractices,andthusactsasamotivatorforthevariouspartnerstoadapt Apollon methodology in their operations. We stress the importance ofsystematically monitoring impact: to observe and trace what is actuallyhappeningintermsofinteractions,actions,decisions,andtheireffectsinvarious
levelsofanalysis.Forthispurpose,WP1togetherwiththeotherworkpackagesco-produces standardized guidelines and frameworks. WP1 further providestemplates dedicated for each work package separately to support operational,handsonworkintheworkpackages.
Chosen approach forApollon methodology and tools development emphasizesthe collaborative nature of the initiative. Methodology and tools developmenthasbeenorganizedasaseparateWorkPackage(WP1)inordertosufficientlyaddresstheidentifiedneedforharmonizationofmethodologiesandapproachesin Living Labs across Europe. The underlying motivation for the methodologydevelopment work is to provide models and tools for European Network ofLiving Labs (ENoLL), and thus add value to the whole European living labcommunity. This is to show how organizations leverage their expertise andcombinecustomersandsuppliersintoaseamlesslyintegratedvaluenetworkbyembedding their local ecosystems into a broader cross-border ecosystem ofLivingLabnetworks.
4.Apollon Methodology and Tools developmentAPOLLON Methodology and Tools Work Package will advance the scientificvalidity and quality of Living Lab research by developing sustainable,
scientificallysoundresearch,developmentandinnovation(RDI)methodologiesforLiving Labsin Europe andbeyond. Thedeveloped set of multi-disciplinary
methodologies and platforms for experimenting with people, societies andcompaniesinLivingLabsinsystemiclevelinreal-lifecontextswillbeempiricallyvalidated for reliable and trustworthy socio-techno-economic impact analysis
andrecommendationsforcompanies,publicsectorandpolicyimplementation.
TheexpectedresultsfromAPOLLONMethodologyandToolsWorkPackageare
todeliver:1. A Catalogue of state-of-the-art concepts, existing tools and lessons
learnedforcross-borderLivingLabnetworks
2. A set of validated methodologies to set up and conduct cross-border
LivingLabnetworks
3. Arecommendedtoolsetforfacilitatingcross-borderLivingLabactivities
4. AplatformandpracticalguidelinesforinvolvingSMEs
5. Animpact assessment ofthe specificadded valuein termsof results as
wellasoperationalefficienciesofthecross-borderapproach
6. Recommendationsforfutureresearchandinstrumentation
8/8/2019 Apollon - Research Framework and investigation strategy
9/24
Apollon Deliverable D.1.2
ICT PSP Project Reporting Template 9 FinalVersion
Thefollowingillustratestheschedulingandrelationshipsbetweenthefivetasks.
Figure3.SchedulingAPOLLONWP1Tasks
Inthefollowingwepresentthevarioustasksindetailfocusingontheprocesses
ofcreating,aswellastheoutcomesofthetasks.Thiswillallowtheotherworkpackages to better understand the approach and stages of the methodologydevelopment,andseehowthevariousactivitiestietogether.
4.1 Review of State of the Art and LiteratureWork in WP1 has been organized in five parallel tasks. The tasks have beendivided following typical CIP projects, where the focus is on integrating andbuildingonalreadyexistingpracticesratherthaninventingnewones.
Theworkbeganwithextensivestateoftheartanalysisoncrossborderlivinglab
networks (D1.1). This analysis addressed theneed for European Living Labs tomove from awareness creation to true collaboration, and to implement a more detailed
analysis of Europe-wide user, market and technology characteristics and an
economically more valuable mode of experimentation, by networking, comparing andscaling up cross-border Living lab networks.
The state of the art analysis was concluded in M1-M6 of the project in form of a
literature study of previous Living Lab projects and questionnaire that was designed
for semi-structured interviews within and outside of the APOLLON consortium. The
interviewees have been chosen according to their proven record of experience and
expertise within the European Living Lab community and network. For more detailson the studied initiatives, persons and interview questions, please refer to Deliverable
D1.1 at mybbt. One of the main targets of the interviews was to capture qualitative
data on existing Living Lab networking initiatives in order to derive a rating of how
T1.3EvaluationFramework
T1.2Methodolo Develo ment
T1.4CollaborationFrameworkSOTA
T1.1SOTA
T1.5Recommendations
8/8/2019 Apollon - Research Framework and investigation strategy
10/24
Apollon Deliverable D.1.2
ICT PSP Project Reporting Template 10 FinalVersion
successful methodologies, tools or organizational structures have been applied in real
life.
The state of the art analysis concluded that the main objectives are similar: to knoweach partner better and to learn from each other. The exchange of best practices andlessons learned is seen as the most important goal of the network followed by
harmonizing an integrating tools and methods between the partners. Finally, a thirdobjective that the networks indicated is performing joint research. Here the aim is that
between partners of the various Living labs and over the border of each Living Lab
research on a larger scale is set-up and executed.
The outcomes of the interviews served as input for a collection of availablemethodologies, tools and structures including a SWOT analysis that also reflects
expressed lessons learned. SOTA analysis also provided the bases for justification of
the assumptions and constructs used in the first version of APOLLON methodology.
4.2 Apollon Methodology Categories
As a basis for the methodology development (Task 1.2) we have selected a holistic
Living Lab management approach, and divided Living Lab management into four
categories: Connect, Set Boundaries and Engage, Support and Govern and Manage
and Track. The categorization reflects the stages of Living Lab network initiation,
experimentation and evaluation. The objective of the categorization is to establish a
common approach to methodology, and divide the related tasks and elements to easily
managed entities. The proposed categorization will be applied in all APOLLON WP1(Methodology and Tools) related tasks (State of the art, methodology framework,
collaboration model, evaluation framework, future recommendations and roadmap).
In the state of the art analysis the categorization was applied to the interview data in
order to structure the findings and better indicate their relevance to APOLON project.The data was categorized as follows:
Main category and sub-category according to the categorization of the
APOLLON methodology framework
The concept category distinguishing between methodologies,
organizational/governance structures and tools
The origin of the finding naming the projects or initiatives name and its
concept
A verbal description summarizing the main facts about the finding
A SWOT analysis listing strengths, weaknesses, opportunities and threats of
the findings
Available references for further details
An indication of the relevance of the findings for the APOLLON methodology
framework
The principle value of the current state of the categorization was to better understandthe maturity of the Living Lab network in regards to the various stages of Living Lab
8/8/2019 Apollon - Research Framework and investigation strategy
11/24
Apollon Deliverable D.1.2
ICT PSP Project Reporting Template 11 FinalVersion
network development, as well as to divide the various activities into events. In regards
to APOLLON research framework, the categorization represents basic constructs that
will form a common terminology for the various experiments to use in their dialogue.
The categorization was introduced to APOLLON consortium in April 2010 (M6)together with the state of the art analysis. The results were disseminated to all
APOLLON members via email by WP1 leader, as well as through mybbt website andwiki. The format of the dissemination was in form of a deliverable report D1.1, as
well as summary power point presentation. The categorization and summary of thefindings were presented to wider Living Lab community and interest groups in
APOLLON presentation in conjunction to Spanish EU Presidency event in Valencia
in April 2010.
4.3 Evaluation FrameworkMethodologydevelopmentalsoincludesan evaluationframeworkfor assessingtheimpactofAPOLLONmethodologyandcross-borderlivinglabcollaborationin
general(D1.3).Theevaluation andimpactassessmentframeworkdevelopedinthe APOLLON project, aims to monitor, analyse and assess the APOLLONmethodologyaswellastheaddedvalueofcrossborderLivingLabnetworking.In this framework key performance indicators are defined which will be usedand subsequently identify and develop mechanisms to measure the keyperformance indicators. This evaluation framework will therefore assess twodifferentprocesses,(1)theAPOLLONmethodologysupportingthecrossborder
networking,and(2)theaddedvalueofthecrossborderLivingLabnetworking.
Inordertobeabletomeasuretheimpactoftheproject,theworkstartedwithabaselinequestionnairetoApollonpartnersinthebeginningoftheproject.Theobjectiveofthisonlinequestionnairewastofindoutaboutthecurrentimpactscreated inthe localand cross-borderoperations, aswellastolearnaboutthe
success factors and identified challenges in Living Lab collaborations. Thebaseline questionnaire was conducted M5 of the project through IBBT webresources. The questionnaire was answered by 30 persons, which wasconsidered sufficient for the saturation of the available data inputs. The
questionnaire highlighted the fact that little emphasis had been given formethodologicalandevaluationrelatedissuesinthepreviousprojects.Noneoftherespondentsreportedsystematicallyappliedtools,frameworksorKPIsforimpact assessment in their projects. Therefore the evaluation frameworkdevelopmentworkhadtostartfromveryprofoundelementsanddefinitions.Inorder to address the challenges of the practical experimentation work,collaboration with the other WPs is a key success factor for the developmentwork.
Thebaselinequestionnairewasconductedatthesametimeasthemilestone2
(MS2) was planned for requirements input from the thematic work packagestowardsthemethodologydevelopment.Sincethebaselinequestionnairedidnot
8/8/2019 Apollon - Research Framework and investigation strategy
12/24
Apollon Deliverable D.1.2
ICT PSP Project Reporting Template 12 FinalVersion
provideasmuchdetailsashopedfor,othermeansfortherequirementcollectionwere set up. The foremost means was regular teleconferences with the WorkPackageleadersfromthethematicworkpackages.TheWPleadswereinvitedtoWP1 teleconferences, where methodology related requirements were
establishedasapermanentagendaitem.Furthertothis,allworkpackageswereassignedadedicatedWP1personthatwouldattendverticalWPmeetingsandthus provide inputs to methodology and especially evaluation frameworkdevelopment.
In the following we present how the various elements of the evaluationframework assess the different project outcomes. Baseline questionnairecomplemented SOTA analysis in construct development (categorization). Thefinaloutcomeoftheprojectisamodelforcross-borderLLcollaboration,namelythemethodology.Methodforthedevelopmentisverticalcollaboration.Alsothecollaborationwillbemeasuredintermsofqualityandquantityofcontactsandcollectionsmade.ApollonCollaborationmodel
Systematically applied methodologies and supporting tools provide companiesand organizations with a controlled environment for collecting, modeling,analyzing and storing qualitative user generated data in various contextual
settings, and thus further develop their services, as well as speed up productadaptationthroughrelevantmarketcommunicationsandcampaigns.
In this context wedefine tools inthe broadsense of the term toinclude any
mediausedforsystematicallycollectinguserinputs,collaboratingandanalyzingtheresults.APOLLONtoolswillincludevirtualonlinetools,aswellastemplates,questionnairesandartifacts. These tools will support Apollon communication andknowledge sharing within the consortium as well as with the supporting partners,
SMEs and other stakeholders. APOLLON collaboration tools will be described in
detail in D1.4.
The developed collaboration model is targeted to support operational collaboration
between the various stakeholders in cross-border Living Lab experiments. Thus the
development of the model also requires inputs and experiences from all parties in
applied projects and processes. Thus collaboration model development will build on
the state of the art experiments and learning. In the initial phases the modeldevelopment will focus especially on supporting ongoing cross-border initiatives. The
model will be developed based on experiences from Apollon thematic experiments,
and validated in an iterative process towards a more scalable, general model that can
support any future cross-border living lab network. Knowledge transfer and
collaboration between the various experiments as well as within experiments will provide grounds for the collaboration model. During the project we have the
opportunity to assess models and practices that work and add value to the process, as
well as those not so well suited for such contexts. The input from the various
experiments will be collected with standardized templates in order to be able to
compare the various experiments, and to analyze how the collaboration has developed
over time.
8/8/2019 Apollon - Research Framework and investigation strategy
13/24
Apollon Deliverable D.1.2
ICT PSP Project Reporting Template 13 FinalVersion
In addition to the descriptions of the communications and collaborations in the
various interfaces, the developed collaboration model will further feature the channels
and tools for collaboration. This includes ICT platforms used for partner search,
promotion as well as knowledge sharing and storing. WP1 will develop a platform
where the various Living Labs and SMEs can present their profile in a unified
manner, and promote their projects, ideas and services for other parties. The platform
supports searches on multiple criteria and thus enables wider networking and new
contacts for the various partners. Further to partner matching the platform will
provide tangible support for initiating and running cross-border projects. This support
includes knowledge resources, templates, process descriptions, check lists as well assuccess stories from previous and ongoing projects. Special emphasis will be given to
impact assessment and evaluation of the projects. This area has been identified as
underdeveloped in the previous projects, and thus would need further focus and
development.
Applying to our researchframework, the collaboration model willpresent themethodforjustifying/validatingtheconstructs,modelsandmethodswehavedevelopedinthethematicpilots.
Activities/Outputs Build Evaluate Justify Theorize
Constructs Categorization Evaluation
framework:Baseline
questionnaire
Collaboration
model: WP1internal
collaboration
SOTA, Policy
recommend-dations
Model Collaboration
model:
Collaboration
with all
APOLLON
partners
Evaluation
framework:
Apollonmethodology
Collaboration
model:
Collaboration
with all
APOLLON
partners
SOTA, Policy
recommend-
dations
Method Collaboration
model:Collaboration
with allAPOLLON
partners
Evaluation
frameworkVertical
collaboration
Collaboration
model:Collaboration
with allAPOLLON
stakeholders
SOTA, Policy
recommend-dations
Installation Collaboration
model:
Collaboration
with all
APOLLONpartners
Evaluation
framework:
Impact
assessment
Collaboration
model:
Collaborating
withthematics
SOTA, Policy
recommend-
dations
Table2.Apollonmethodologydevelopmentpositionedinresearchframework
8/8/2019 Apollon - Research Framework and investigation strategy
14/24
Apollon Deliverable D.1.2
ICT PSP Project Reporting Template 14 FinalVersion
APOLLON methodology development work culminates in reflection of the project
and results, and collecting these findings into a set of recommendations for policy
changes and instrumentation for future research and development (D1.5). This final
task will also, based on the lessons learned, propose new projects, initiatives and
member services for ENoLL and the European Living Lab community in general.
5.Applying Research Framework to Apollon thematicexperiments
Apollon organizes twelve pilots under four thematic domains in order todemonstrate the benefits of cross-border experimentation for building singleEuropean research area and market. This chapter will describe the variousexperiments briefly with the main emphasis on the operational tasks and
relationshipsintheexperiments.Theverticalexperimenttypesandaddressedchallengesineachthematicexperimentaredescribedinthefigure2below.
Figure4.TheFourAPOLLONexperimentsandthechallengestheyaddress
8/8/2019 Apollon - Research Framework and investigation strategy
15/24
Apollon Deliverable D.1.2
ICT PSP Project Reporting Template 15 FinalVersion
Each Apollon wok package has slightly different focus and thus differentapproach. However, in the quest to simplify the project design, the various
thematicexperimentshavebeenorganizedasseparateworkpackagesthatwillallgothroughthesamesteps,organizedastaskswithintheworkpackages:
Figure5.Stepswithintheverticalexperimentsregardlessofapproach
In the following we summarize how the various experiments can apply theframeworkintheirexperiments.Alreadyduringthefirststagesoftheprojectithasbecomeapparentthatthereisneedforharmonizationandmethodologicalsupportfortheexperiments.Theapplicationof acommonresearchframeworkwillassisttheexperimentsinstructuringtheactivitiesintheexperimentsandputting them into a process oriented frame. This will later assist incommunicationswiththevariouspartnersinvariousexperimentsandlocations,and allow WP1 to collect data in pre-defined categories. Common researchframeworkwillalsoestablishcommonlanguageandterminologyfortheprojectasawhole.
InthecontextoftheexperimentswecanapplytheApollonresearchframeworkbyansweringthequestionsineachofthefollowingclasses.
Activities/Outputs Build Evaluate Justify Generalize
Constructs Whatarethe
variablesthat
youstudy?
Whatarethe
elementsthat
youmeasure?
Howdoyou
decidebest
practicesacrossthe
experiments?
Howdoyoufilter
pilotspecific
elementsout?
Model Whatarethebasic
assumptions,
causalitiesand
outcomesthat
youperceive?
Whatmeasuresdo
youuseto
evaluatethe
validityofthe
assumptions?
Whatarethesuccesscriteria
thatyouuse?
Howdoyouassessthewider
applicabilityof
themodel?
Method Whatisthe
processfor
validatingthe
Howdoyou
evaluateand
adjustthe
validation
Howdoyou
justifytheuse
ofselected
Howdoyou
ensurethe
scalabilityand
wider
8/8/2019 Apollon - Research Framework and investigation strategy
16/24
Apollon Deliverable D.1.2
ICT PSP Project Reporting Template 16 FinalVersion
assumptions? process? methods? applicabilityof
themethods?
Installation Whoarethe
stakeholdersatyour
experiment?
Howdoyou
evaluateaddedvalueforeach
stakeholder?
Howdoyou
justifytheselected
collaboration
model?
Howdoyou
compilerecommendations
forsustainability
Table3.Thematicexperimentsfocusandcontentcommunicatedincategoriesofactivitiesandoutputs
Inshouldbenotedthattheresearchapproachiscloselylinkedtotheobjectivesoftheexperimentsaswellaseachstakeholdersdriversandmotivationsto
engageincollaboration.Thefollowingchapterswillfeaturetheapplicationoftheframeworkineachthematicinmoredetail.
5.1 Applying Research Framework Iteration at General Assembly
ApollonGeneralAssemblyatSeptember30-October1servedasaplatformforapplyingApollonresearchframeworktothematicexperiments.ThefirstversionofApollonmethodologywaspresentedtotheprojectconsortium,andplenarysessions organized with all experiments. During these sessions it becameevident, that in addition to a harmonized approach to the cross-borderexperiments is a necessity. Furthermore, it was realized that at this stage ofpilotingthevariousexperimentsvarysignificantlyinregardstotheirapproach,set up and objectives. Thus also the framework and related evaluation andcollaborationprocessesneedtobeplannedseparatelyforeachexperiment.
The research framework was applied separately for each stakeholder groups,namely Living Labs, SMEs and users. In addition tostakeholderspecificplans,theapplicationwasalsodoneseparatelyforbothexperimentlevel(locally),andto the cross-border level. The same categorization is used throughout theApollon methodology development and evaluation. The various methodologyelementswillbeappliediterativelyeitheron cross-borderor experimentlevel,andevaluatedasapartofmethodologydevelopmentprocessinthreemonthlyintervals.
6.APOLLON Cross-Work Package CollaborationThe various thematic domains conduct their experiments following the samehigh level schedule but with very different emphasis and contexts. Thereforecollaborationbetweenthethematicworkpackagesislimitedduetofocusandlimited resources. However, already in the initial phases of the project (Pilot
preparations, Deliverable Dx.1) is has become apparent that there is need forharmonizationandmethodologicalsupportfortheexperiments.Theapplicationofacommonresearchframeworkwillassisttheexperimentsinconceptuallevel.
The clear, process-oriented approach enables structuring the research effortsandassistincommunicationswiththevariouspartnersinvariousexperiments
8/8/2019 Apollon - Research Framework and investigation strategy
17/24
Apollon Deliverable D.1.2
ICT PSP Project Reporting Template 17 FinalVersion
andlocations.Thiswillestablishcommonlanguageandtermsfortheprojectasawhole.
ItistheroleofthehorizontalworkpackagesWP1,WP6andWP7toensurethatrelevantresults,practicesandbenchmarksfromeachthematicworkpackageare
disseminated to all relevant parties. Work package 7, Project managementensures that the communication channels and project infrastructure supportsthe experiments and collaboration between the work packages. WP1 assumesresponsibilityfordisseminatingandassistinginimplementationoftheproposedframeworkinthethematicexperiments.
InoperationallevelworkWP1workstogetherwiththethematicworkpackagesin order to develop common approaches, methodologies and tools for cross-
borderexperimentationandSMEengagement.Thescopeoftheworkincludesmethodology development in thematic cross-border projects, as well as in thewholeApollonlevel.Ithasbeenidentifiedthatinthefirstphasesoftheprojectthe thematic level collaboration and harmonizing of the practices within thethematic experiments is of more importance than Apollon level collaboration.The scalable methodologies and tools that will live on after the projectcompletion will be developed with the thematic experiments during thefollowingyear,andfilteredintoharmonizedmethodologyofcross-borderlivinglab networks. Proposal for collaboration between the WPs and taskswas firstpresented during Apollon project kick off event in Brussels on November 27,
2009.Thesummaryoftheinitialproposalincludesthefollowing:
8/8/2019 Apollon - Research Framework and investigation strategy
18/24
Apollon Deliverable D.1.2
ICT PSP Project Reporting Template 18 FinalVersion
Figure6.Interconnectionbetweenthedifferentworkpackages
Thetasksreferredtointheearlierdescriptionareasfollows:
ApollonWP2-5Tasks:
Taskx.1Preparationoftheexperiments
Taskx.2Transferring,implementationanddeploymentoftheexperiment
Taskx.3Cross-borderpiloting
Taskx.4Evaluationandrecommendationsofthecross-bordernetworkactivities
Taskx.5Thematicnetworkactivities
In addition to the interrelations to the thematic work packages, collaborationwiththethematicworkpackagesandthedisseminationWP6hasbeendescribedinthemodel.Thefollowingsummarizesdisseminationtasks.
ApollonWP6Tasks:
Task6.1.DisseminationPlan
Task6.2.NetworkingandEvents
8/8/2019 Apollon - Research Framework and investigation strategy
19/24
Apollon Deliverable D.1.2
ICT PSP Project Reporting Template 19 FinalVersion
Task6.3.Actionplanforsustainablecross-borderLivingLabnetwork
Task6.4.Extra-Europeandissemination
It was recognized that work package level sharing would not be sufficientenough,andthusthefocuswillbeontasklevelcollaborationandsharing.Thefollowingprincipleswereproposed:
- WP Collaboration would be a permanent item on Apollon management
teammeetings- Task leaders will assume responsibility for WP collaboration: the task
leader providing input to another task responsible for establishing thelinkandprovidinginformation
- WPleaderswilldiscussanyemergingandescalatedissuesasneeded
In order to ensure seamless knowledge flow and formalize the collaboration
withclearstructure,amodelforcollaborationbetweenthematicworkpackagesand WP1 in task level has been proposed. This model includes the roles,responsibilitiesanddedicatedpersonsforcommunications.Inpracticethislead
toamodel,whereApollonWP1Tasksrelationtotasksintheverticaldomainswasinitiallyplannedasfollows:
A) Task 1.1.State-of-the-art: Benchmarking best practice for cross-bordernetworksofLivingLabs(TaskLeaderSAPwillfeedinputtotasksx.1,x.2.
B) Task 1.2. APOLLON Methodology Framework (Task Leader SAP) will
provide input to tasks x.2, x.3, 6.2, 6.3, 6.4. The task will also bebeneficiaryfordeliverablesfromtasksx.1,x.2,x.3.
C) Task1.3.EvaluationandAssessmentFramework(TaskLeaderLTU)willfeedtotaskx.4andreceiveinputfromtasksx.4.
D)Task 1.4.Collaboration Process and Living Lab Network engagement
model(TaskLeaderNOV)willprovideinputtotasksx.3,x.5,and6.3.Dataforthetaskwillbeprovidedbytasksx.3,x.4.
E) Task1.5.ProjectEvaluationandLessonsLearned(TaskLeaderAalto)willfeedtotasks6.2,6.3and6.4,whilereceivinginputfromtasksx.4,andx.5.
ThispresentationillustratedtheapproachtoknowledgeflowsandmanagementstructurewithinApollonpilot.Naturallythecollaborationinpracticeislessrigidand structured, and consists of numerous knowledge sharing events andchannelsalsoacrossandbeyondthedescribedtasks.Theobjectiveistoestablishcontinuousdialoguebetweenthevarioustasksandactivitieswithintheproject.
8/8/2019 Apollon - Research Framework and investigation strategy
20/24
Apollon Deliverable D.1.2
ICT PSP Project Reporting Template 20 FinalVersion
7.Collaboration Practices for Apollon ProjectCollaboration practices for the initial phases of Apollon project follow theprinciplesdescribedintheApollondescriptionofwork.Projectmanagerbears
the main responsibility for implementing the operational and communicationpracticesandchannelsfortheproject.
In regards to collaboration between WP1 and thematic work packages,
processes, guidelines, and tools will be developed in close contact with thepartnersfromthedifferentworkpackages.Bymeansofthesepracticesthebodyof knowledge around collaboration practices will evolve both in terms of sizeand in terms of accuracy and level of detail throughout the project. Toaccomplishthis,weneedtobeincontactwiththeverticalexperimentsregularly.
We need their contribution and experiences in order to provide them withusableadviceoncollaborationpracticeswithintheirlivinglabnetwork.
Initially,weproposethefollowingpractices:
1. Requirementcollectionfromthematicexperiments
2. DedicatedWorkPackage1membersasliaisontoverticalexperiments
3. Regular collaboration and formal meetings for iterative conceptvalidation
4. A wiki as platform to share insights practices and with verticalexperiments
5. SMEengagementprocess
7.1 Requirement collection
Rigor, robustness and especially relevance are among the main attributes for
evaluation of APOLLON methodology. Therefore it is of essence to thoroughlyunderstand the requirements and realities of the partners working in the
thematic experiments. Furthermore, we need to understand the priorities andneedsofpotentialfuturepartnersofthenetwork,especiallythoseofSMEsandmicroentrepreneurs.Theapproachwouldbestbedescribedasparticipatory.
WithinWP1teleconferencesarescheduledonceineverythreeweeks.Forthese
teleconferences, representatives of the other work packages are invited toparticipatetolearnandinfluencethedevelopmentwork.Asthesemeetingshavedraw little attention from the other work packages, WP1 members further
participate in the operational meetings of the various work packages. Thispracticewillenableustobetterservetheverticalexperiments,andseewhatarethe commonalities and differences in the approaches. These issues are thendiscussedintheWP1meetingsinordertoseehowthemethodologywouldbestaddress andsupport thevariouscontexts andapplication areas. In addition, it
willalsohelptoshareknowledgebetweentheexperiments.WP1memberswill
8/8/2019 Apollon - Research Framework and investigation strategy
21/24
Apollon Deliverable D.1.2
ICT PSP Project Reporting Template 21 FinalVersion
accumulateknowledgeandanoverallviewofAPOLLONproject,andthuswillbeabletoactasliaisonpartnersbetweenthevariousworkpackages.
7.2 Liaison partners to vertical experiments
In order to effectively support the vertical experiments requires us to learn
about the peculiarities of the planned studies, the parties involved and thepractical circumstances within their living lab network. In the state of the artanalysisthepartnersindicatedthatthemostimportantvalueofthenetworkwassharing and benchmarking. In order for the partners to benefit from theknowledge and expertise of the whole APOLLON network rather than just thenetwork around their own thematic domain, WP1 partners will act as liaisonofficersbetweentheworkpackages.
Thisisdoneinamodel,whereforeachverticalexperimentthereisaresponsiblecontact person in WP 1. These persons will participate in the meetings andpractical work in thethematic work packages,andthen share theinformationandemergingrequirementsfromthethematicworkpackagestoWP1team.Inthismodel, we can leveragethe resources effectively, and create methodologythatwillsupportthethematicexperiments.Thededicatedpersonsforeachworkpackageare:
LiaisonPerson(s) WorkPackage
BramLievens,HendrikHielkema WP2E-Health
AnnaSthlbrst WP3EnergyEfficiency
ChristianMerz WP4E-Manufacturing
ClaudioVandi WP5E-participation
Theinformation sharingwiththeexperimentsisorganizedina non-structured
way in order to avoid unnecessary paperwork. The data collection focuses onhigher level concepts, development and plans for the experiments. In thisprocess WP1 seeks to identify the best practices and their applicability to the
network as a whole. The practices and other thematic WP related issues is apermanent item in WP1 meetings. This information is used for shapingAPOLLONmethodology,aswellasforfilteringtheelementsofmethodologythataregenericasoppositetothoserelevantforspecificthematicdomainsorsingleexperiments. The results will be shared at the APOLLON wikipage on regular
pages. WP1 will also collect the discussions and findings to a log in order toanalyzehowthecollaborationhasevolvedandwhatbenefitsithasproducedtothevariousbeneficiaries.
8/8/2019 Apollon - Research Framework and investigation strategy
22/24
Apollon Deliverable D.1.2
ICT PSP Project Reporting Template 22 FinalVersion
7.3 Regular collaboration for iterative concept validation
After theinitialrequirement collection that WP1initiated throughthestate of
theartreview,thebaselinequestionnaireandthedeliverablesx.1,theevolving
methodological requirements and experiences will be collected and shared onregularbasesthroughoutthedurationoftheproject.
WP1willpresentthefirstversionsofthemethodologyandproposedtemplates
for pilot support in August 2010, and discuss their implementation in detailduringthegeneralassembleinSeptember2010.Thesediscussionswillkickoffaregularcollaborationwiththepilotexperiments.Theprocesswillfeaturedatacollection regarding collaboration, user engagement, SME support andevaluationwithastandardtemplateonregularbases.Thedataisreviewedin
teleconferenceswithallrespectiveWPleaderson3monthintervals.
Thiswouldeffectivelymeanthattherewillalsobeanewversionoftheproposed
frameworks available after each iteration round. Altogether there will be 5rounds of iterations before the final version of APOLLON methodology iscompiled.ResponsibilityforcallingthesemeetingwillbewithWP1,andallWPleaders commitment to participate in the process either themselves of with anominated representative will be needed. This process would kick off at the
APOLLONgeneralassembleinSeptember30 th,andmeetat3monthintervals.Thenextproposedmeetings:
- DuringFIConferenceatGhent,Belgium,13-17December2010,- During ICT for Energy Efficiency or similar seminar at Brussels, April
2011,
- June2011,
- September2011
- November2011
TheobjectiveistosetallthedatesduringtheGeneralAssemblee,andpositionthemclosetootherrelatedeventsinordertohaveasmanypersonsaspossible
present,butalsocontrolthecost.
7.4 Wiki for collaboration and knowledge sharing
Collaboration practices and insights evolve over time. In order to openly andeffectivelysharethelatestnewsandactionsinWP1wesetupawiki.Thewikiwillcontainagrowingbodyofknowledgewithprocesses,guidelinesandadvicefortoolsupportandlearningforthevariousworkpackages.Itwillbeusedasameanstodisseminateandconsolidateouradviceforthebenefitoftheverticalexperiments.
The framework that is outlined in the initial versions of methodologydevelopmentwill bethe basisfor the wiki. Itwillbesupplemented with tools
8/8/2019 Apollon - Research Framework and investigation strategy
23/24
Apollon Deliverable D.1.2
ICT PSP Project Reporting Template 23 FinalVersion
andguidelinesonthevariousstagesofdevelopment.Thewikicanalsocontaininformationregardingvarioususerengagementtools,andthusworkasaone-stop-shopforthepartnerswishingtolearnmoreaboutLivingLabmethodologyand development. The wiki can be found at mybbt pages, address:
https://www.mybbt.be/share/page/site/Apollon/wiki-page?title=Share_your_experiences_-_thoughts.
Herebyproposedresearchframeworkwillbedisseminatedinitiallythroughthe
wikipages and emails. The framework will also be presented to WP leaderstogether with templates for their plans to implement framework in their
experiments.
7.5 SME Engagement
Since the objective of APOLLON project is to engage and empower EuropeanSMEs,specialemphasisinthemethodologydevelopmentworkwillbegivenfor
theaspectofSMEengagementandsupport. Common methodology and tools forcreating and managing cross-border collaborations would provide SMEs, users and
academic community a set of harmonized user-centred research and innovation
services (best practices, services, methods, tools, operational and business models and
platforms) and advance the rigor and quality of living lab experimentation in Europe.
Thus Living Lab networks can support SMEs to:
- increase the yield on product and process innovation to accelerate top-linegrowth
- reduce time-to-market through lean processes, a higher yield on designs andfaster cycle times
- ensure compliance by incorporating customer and regulatory requirements atall stages of the product lifecycle and by automating the process of
documenting compliance
- optimize resources by gaining greater efficiency through the productlifecycle and digital product and process validation, and leverage globalization
through real-time collaboration with global partners, suppliers and
customers
InordertoassesstheneedsoftheSMEsengagedinAPOLLONprojectwehavetakenthefollowingapproach:
1. Develop and administer a questionnaire, referred to as baseline
investigation
ThebaselineinvestigationwasdevelopedtolearnfromthevariouspartnersintheApollonprojectswhatthedemandsandwishesareforthemethodologytobedevelopedbyworkpackage1.Thequestionnairedevelopedfocusedonthevariousaspectsofcross-bordercooperationbetweenlivinglabsandSMEs.
2. Developscenarios
8/8/2019 Apollon - Research Framework and investigation strategy
24/24
Apollon Deliverable D.1.2
Thesescenarioswillbeinspiredbytheresultsofthequestionnaire.Atthisstagethescenariosarepre-evaluationversionsthatwillevolveduringtheproject.
3. EvaluatethescenarioswithSMEsintheverticalexperiments
Afterthepre-evaluationscenarioshavebeendeveloped,theywillbepresentedtoSMEsandfedbycurrentpracticesintheverticalprojects.Forthispurposean
evaluation approach needs to be elaborated that requires only a small effortfromtheSMEs.
Proposed SME support model will be described in detail in Deliverable 1.4Collaboration Model, which includes scenarios for SMEs participation andinvolvement incross-borderLivingLabexperimentation. SMEengagementwillalsobeacentralthemeintheD1.5APOLLONmethodology,whichwillprovideoperational support and guidance for any SME willing to participate in Living
Lab work in the future. Detailed SME engagement plan will also be a centralsubjectofWP6Disseminationswork.
8.ConclusionThis deliverable summarizes the research approach applied in APOLLONmethodologydevelopmentinWP1.Themainprinciplesoftheresearchapproachhave been developed during the project preparation phase, and presented toAPOLLON consortium already at the project kick off. This deliverablesummarizestheapproachandpresentsan adjustedresearchframeworkthatisapplicable to all Apollon thematic experiments. The framework formalizes thevarious tasks into events and group activities and outcomes in a harmonizedway. This simplifies comparisons, evaluations and assessments of theexperiments.
ThefirstphasesofAPOLLONprojecthaveindicatedthatmoreemphasismustbegiven for cross work package communications. This deliverable contributes tothisidentifiedchallengebyformallypresentingacommunicationandknowledgesharing model for knowledge sharing within APOLLON project. The presented
modelhasalreadybeenimplementedinAPOLLONproject,butmoreworkanddisciplineisneededforactivelyfollowingandadheringtoit.
ThebeneficiariesofthedeliverableareallAPOLLONpartners.Thedeliverablewill be disseminated via several channels including wikipages, emails andgeneral assemble. Wider implementation plan forthepresented model will beformulatedtogetherwiththeleadersofeachAPOLLONworkpackageinregularmeetingsduringthefallof2010.