18
Digital Fabrication and Maker Movement in Education Making Computer – supported Artefacts from Scratch Deliverable D4.3 A software solution for the educational extension (v1) This project has received funding from the European Union’s Horizon 2020 Research and Innovation Programme under Grant Agreement No 731345.

Deliverable D4 · showcasing, through sharing, the final solution (Figure 1). Figure 1 - eCraft2Learn craft and project-based methodology (the 5 stages) • Ideation: The learners

  • Upload
    others

  • View
    1

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Deliverable D4 · showcasing, through sharing, the final solution (Figure 1). Figure 1 - eCraft2Learn craft and project-based methodology (the 5 stages) • Ideation: The learners

DigitalFabricationandMakerMovementinEducation MakingComputer–supportedArtefactsfromScratch

DeliverableD4.3Asoftwaresolutionfortheeducationalextension(v1)

This project has received funding from the European Union’s Horizon 2020 Research andInnovationProgrammeunderGrantAgreementNo731345.

Page 2: Deliverable D4 · showcasing, through sharing, the final solution (Figure 1). Figure 1 - eCraft2Learn craft and project-based methodology (the 5 stages) • Ideation: The learners

©2017eCraft2Learn|Horizon2020|731345

2

PROJECTDESCRIPTION

Acronym: eCraft2Learn

Title: DigitalFabricationandMakerMovementinEducation:MakingComputer-supported

ArtefactsfromScratch

Coordinator: UniversityofEasternFinland

Reference: 731345

Type: RIA

Program: HORIZON2020

Theme: TechnologiesforLearningandSkills

Start: 01.January,2017

Duration: 24months

Website: http://www.project.ecraft2learn.eu/

E-Mail: [email protected]

Consortium: UniversityofEasternFinland,Finland,(UEF),Coordinator

Edumotiva,Greece(EDUMOTIVA)

MälardalenUniversityofSweden,Sweden(MDH)

ZentrumfürSozialeInnovation,Austria,(ZSI)

TheUniversityofOxford,UnitedKingdom,(UOXF)

SYNYOGmbH,Austria,(SYNYO)

UniversityofPadua,Italy,(UNIPD)

TechnopolisCityofAthens,Greece(TECHNOPOLIS)

Evothings,Sweden(EVOTHINGS)

Arduino,Sweden(ARD)

Ultimaker,UnitedKingdom(ULTIMAKER)

LinnaeusUniversity,Sweden,(LNU)

Page 3: Deliverable D4 · showcasing, through sharing, the final solution (Figure 1). Figure 1 - eCraft2Learn craft and project-based methodology (the 5 stages) • Ideation: The learners

©2017eCraft2Learn|Horizon2020|731345

3

DELIVERABLEDESCRIPTION

Number: D4.3

Title: Asoftwaresolutionfortheeducationalextension(v1)

Leadbeneficiary: MDH

Workpackage: WP4

Disseminationlevel: Public(PU)

Type Report(R)

Duedate: 30.09.2017

Submissiondate: 30.09.2017

Authors: AfshinAmeri[MDH],KenKahn[UOXF],AndreaAlessandrini[LNU],

EmanueleMenegatti[UNIPD],BaranÇürüklü[MDH],IlkkaJormanainen

[UEF],TapaniToivonen[UEF],MicheleMoro[UNIPD],

FrancescaAgatolio[UNIPD]

Contributors: Allconsortiumpartners

Reviewers: SophiaManika[TECHNOPOLIS]

VersionControl

Version Date Personincharge[Organization] Changes QualityAssurance

1 08.06.2017 BaranÇürüklü[MDH] Guidelines,layoutandcriticalparts

AfshinAmeri[MDH]

2 23.09.2017 AfshinAmeri[MDH] Sectionsfilled,figuresadded

BaranÇürüklü[MDH]

3 29.09.2017 AfshinAmeri[MDH] Finalversion.Refinements

basedonreviews

SophiaManika[TECHNOPOLIS]

Acknowledgement:Thisprojecthasreceivedfunding

fromtheEuropeanUnion’sHorizon2020ResearchandInnovationActionunderGrantAgreementNo731345.

Disclaimer:Thecontentofthispublicationisthesole

responsibilityoftheauthors,anddoesnotinanywayrepresenttheviewoftheEuropeanCommissionorits

services.

Page 4: Deliverable D4 · showcasing, through sharing, the final solution (Figure 1). Figure 1 - eCraft2Learn craft and project-based methodology (the 5 stages) • Ideation: The learners

©2017eCraft2Learn|Horizon2020|731345

4

TABLEOFCONTENT

EXECUTIVESUMMARY...........................................................................................................................6

1 Introduction...................................................................................................................................7

1.1. eCraft2LearnLearningMethodology....................................................................................7

2 Educationalextension....................................................................................................................8

3 UnifiedUserInterface....................................................................................................................8

4 TechnologiesfortheeCraft2LearnLearningMethodology...........................................................9

4.1. Ideation(Imagine)Stage.......................................................................................................9

4.2. PlanningStage.....................................................................................................................10

4.3. CreationStage.....................................................................................................................11

4.3.1. 3DModellingandPrinting..............................................................................................11

4.3.2. HardwareSimulation......................................................................................................12

4.4. ProgrammingStage.............................................................................................................13

4.4.1. AICloudservices.............................................................................................................14

4.4.1.1. SpeechSynthesis........................................................................................................14

4.4.1.2. SpeechRecognition....................................................................................................14

4.4.1.3. ImageRecognition......................................................................................................15

4.4.1.4. DemosforAICloudservicesinSnap!.........................................................................15

4.4.2. FileManagement............................................................................................................15

4.4.3. DataAnalyticsandDebuggingTools...............................................................................16

4.5. SharingStage......................................................................................................................16

4.5.1. Thingiverse.....................................................................................................................16

4.5.2. eCraft2LearnThingiverseApp........................................................................................17

5 Conclusion....................................................................................................................................17

6 References....................................................................................................................................18

Page 5: Deliverable D4 · showcasing, through sharing, the final solution (Figure 1). Figure 1 - eCraft2Learn craft and project-based methodology (the 5 stages) • Ideation: The learners

©2017eCraft2Learn|Horizon2020|731345

5

TABLEOFFIGURES

Figure1-eCraft2Learncraftandproject-basedmethodology(the5stages).......................................7 Figure2-TheUnifiedUserInterface.....................................................................................................9 Figure3-IdeationinCoggle.................................................................................................................10 Figure4-ProjectPlanningwithTrello.................................................................................................11 Figure5-3DModellinginTinkerCad...................................................................................................12 Figure6-DIYElectronicsSimulationinTinkerCadCircuits..................................................................13 Figure7-SpeechSynthesisBlocksforSnap!.......................................................................................14 Figure8-SpeechRecognitionBlocksforSnap!...................................................................................15 Figure9-ImageRecognitionBlocksforSnap!.....................................................................................15 Figure10-SharingonThingiverse.......................................................................................................17

Page 6: Deliverable D4 · showcasing, through sharing, the final solution (Figure 1). Figure 1 - eCraft2Learn craft and project-based methodology (the 5 stages) • Ideation: The learners

©2017eCraft2Learn|Horizon2020|731345

6

EXECUTIVESUMMARY

This deliverable (D4.3) is in the format of a sequence of three demonstrations (corresponding toversions v1 - v3). This report is part of the first demonstration for v1/M9. The intention of thisdeliverablereportistoprovideaninsightintothefirstversionoftheeducationalextensionanditsintegrationwiththeunifieduserinterface(UUI).

This deliverable includes accompanying videos that demonstrate the integration of educationalextension with the UUI (D4.4). In this version, the focus of development has been on creation,programming and sharing tools as these are necessary tools for the first pilots. Based on thecollecteddatafromfirstpilots,furtherimprovementsandnewfunctionalitieswillbeaddedtolaterversions.

Page 7: Deliverable D4 · showcasing, through sharing, the final solution (Figure 1). Figure 1 - eCraft2Learn craft and project-based methodology (the 5 stages) • Ideation: The learners

©2017eCraft2Learn|Horizon2020|731345

7

1 INTRODUCTIONFollowing the footsteps of deliverables D4.1 and D4.2, this is the starting point of design andimplementation of the pedagogical framework, including the 5 stage learning methodology (SeeD3.1,D4.1andD4.2)fromatechnicalperspective.Thus,inthisdocumentthefirstimplementationofeCraft2Learn’seducationalextension,whichwillactasagluetoconnectdifferent toolsused inthe 5 stages of eCraft2Learn’s learning methodology is implemented. In addition, thisimplementationwillalsoextendthefunctionalitiesofsomethesetoolstosupportthelearnerswithmore advanced features, such as artificial intelligence (AI) services and augmented realityvisualizations,intheirjourneytowardscreatingandlearning.

1.1. ECRAFT2LEARNLEARNINGMETHODOLOGY

eCraft2Learn is an ecosystem which is based on craft and project based teaching methods. Thismethodology includes 5 stages,which together guide the learner froman idea todeveloping andshowcasing,throughsharing,thefinalsolution(Figure1).

Figure1-eCraft2Learncraftandproject-basedmethodology(the5stages)

• Ideation:The learnersexplore theworld to findchallenges.Thisexplorationcanbe in thephysicalorvirtualworld(i.e.onlinecommunities).

• Planning: The learners collect information and material. They also start making projectplans.

• Creation: Through a co-design and co-creation process, the learners start creating theirsolutions.Thisstagemight involvemanydifferent technologiessuchasdo-it-yourself (DIY)electronics,visualization,simulationand3Dprinting.

• Programming: Learners add functionality to their crafted artefacts through high-levelprogramminglanguages.

• Sharing:Bysharingthesolutionsononlinecommunities,thelearnerscanlearnfromotherprojects,whilereceivingfeedbackfromdesigners,engineersandprogrammers.

Each of the aforementioned stages requires a different set of tools and materials. Developing acentral place (software) for managing these stages is the aim of the educational extension ineCraft2Learn.Suchasolutionwillmake iteasier tomanage the learners’ co-creationprojectworkandalsocanprovidethenadditionaltoolstoimprovetheirprojectsevenfurther.

Page 8: Deliverable D4 · showcasing, through sharing, the final solution (Figure 1). Figure 1 - eCraft2Learn craft and project-based methodology (the 5 stages) • Ideation: The learners

©2017eCraft2Learn|Horizon2020|731345

8

2 EDUCATIONALEXTENSIONInordertohaveaclearviewofthegoalsfortheeducationalextension,heresomeinformationfromeCraft2Learn’sprojectproposalispresented.Theroleoftheeducationalextensionisto:

1. Connect toUUI:The firstversionof theeducationalextension, is fully integrated into theUUI(D4.4)andthereforetheaccompanyingdemovideosaresharedforbothdeliverables.

2. Provide communication with hardware equipment such as 3D printers and DIYelectronics:Communicationwithelectronicalhardware(Arduino,RaspberryPi)ispresentinthisversion.3Dprintingextensionswillbepresentedinlaterversionsofthesoftware.

3. Provideprojectplanningtoolsfor learnersandteachers:TheUUIprovidestheuserswithproject planning tools. The integrationof these toolswith educational extension is underdevelopmentbutpresentintheUUI.

4. Provide analytics, debugging and feedback from hardware to learners and teacher:Providing the data analytics tools with required information from the users (i.e. useractions)ispresentinthisversion.

5. ProvideaccesstoAIcloudservices:Incurrentversion,userscanuseAIcloudservicesfromGoogle, IBM Watson and Microsoft for a variety of tasks such as speech and imagerecognition.

6. Provide high-level components (such as libraries for data visualization and visualprogramming):Most of the programming tools inUUI are visual programming languagesand the aforementioned AI services are also presented as specific visual programmingblocks.Theeducationalextensionalsoincludesanaugmentedrealityviewerforvisualizing3Ddesignsinrealworldbeforeprintingthem.

7. Provide smart sharingmodules,both for showcasing learner results andaccessingopencommunities: Using online communities, learners can now share their 3D designs andprojectswiththeworldandeachother.

Asamaingoal, theeducationalextensionshouldprovide the learnerswithmeans to followthe5stage learningmethodologyofeCraft2Learnwithease. Inorder todemonstrateall thesteps fromideation toplanning, creating,programmingandsharing, the restof thisdocument isdivided intosections foreachof these5stages. Ineachsection,wediscuss the tools supporting thatstepandtheirrelationtotheeducationalextension.WealsoprovideasectionrepresentingtheUUIanditsintegrationwiththeeducationalextension.

3 UNIFIEDUSERINTERFACEThe UUI (accessible here: https://afsheenam.github.io/UUI) is the main hub for accessing theeducationalextension tools. It ispresented indetail inD4.4andausermanual isalsoavailable inD4.5. As seen in Figure 2, the interface contains 5 clusters of tiles that represent the 5 stages ofeCraft2Learnmethodology.Inthefollowingsections,wepresenteachclusteranditstoolsthatareintegratedintothefirstversionofeducationalextension.

Page 9: Deliverable D4 · showcasing, through sharing, the final solution (Figure 1). Figure 1 - eCraft2Learn craft and project-based methodology (the 5 stages) • Ideation: The learners

©2017eCraft2Learn|Horizon2020|731345

9

Figure2-TheUUIisa2Dspace.Inthisfirstversion,themostevidentfeatureistheclustersofsetoftoolsforeachofthe5stages(Ideation/Imagine,Plan,Create,Program,Share)oftheeCraft2Learncraft-andproject-basedlearning

methodology.Ascanbeseenalltoolarevisibleandavailable,atthesametimethe5stagesofthemethodologyisevident.

4 TECHNOLOGIESFORTHEECRAFT2LEARNLEARNINGMETHODOLOGYAlthoughtheprimeobjectiveItodevelopthesetechnologiesforthe5stagesoftheabovementionedlearningmethodologytheproposedsolutionisflexibleenoughtoallowtheusageofasubsetofthetechnologies,orlessridgedlearningsettings.

4.1. IDEATION(IMAGINE)STAGE

InD3.1theideationstageisdescribedas(notethattheideationstageiscalledImagineintheUUIFig.2),sinceitwasassumedthatthelattertermwouldbeeasiertounderstandbythelearners):

“Ideationthroughworldexploration:Inordertoexplorethekindsofchallengesthatstudents or others face in their daily lives, a student could explore the worldphysically (e.g. taking pictures, exploring situations outside the classroom,newspapers, etc.) or virtually (e.g. through online support community discussion,online news, documents, local news/websites) and then decide what theirchallenge/problemwillbe.ThisprocessisalsoguidedbytheSTEAMcoach.”

Ideascanformanytimeandanywhere,thereforethetoolsprovidedforthisstageshouldbeabletocoverdifferentsituationsandcontexts.Notethat,havingaccesstocertaindigitaltools(notpartofthesetoftools,suchasdigitalcameras,mobiledevices,voicerecorders,etc.)isessential,sincetheycanprovidethelearnerwithoptionstologandideateonaproblem.Forexample,theycantakeaphotoofanobjectthattheythinkcanbedesignedbetterorimproved.Inaddition,thesetoolscanbecarriedandusedinmostlocations.Thetoolsprovidedintheideationstageprovidesthelearnersservices tosaveanduse thedata, images, recordingsthatarecollectedwith theabovementioneddigitaltools.Evenifdigitaltoolsarenotavailable,thelearnersmightstillusepenandpapertotakenotesand lateradd themtoeCraft2Leaern ideation toolsby scanning thedocuments.Thismeansthat the ideationtoolsshouldbeable toprovidethe learnerswithcollaborative tools, support for

Page 10: Deliverable D4 · showcasing, through sharing, the final solution (Figure 1). Figure 1 - eCraft2Learn craft and project-based methodology (the 5 stages) • Ideation: The learners

©2017eCraft2Learn|Horizon2020|731345

10

different file typesandwideavailability.This isachievedbyusingGoogleDriveserviceandCogglesoftware.

GoogleDriveisawell-knownserviceforstoringdifferentfiletypesanditalsoprovideseditingtoolsformostdocumenttypes,thereforeitcanprovideasharedspaceforthemembersofaprojecttostoreimages,voicerecordings,etc.thatcanlaterbeusedfortheideageneration.

The educational extension also usesGoogleDrive to store auto-save files fromother tools that alearnerisusingineCraft2Learnenvironment,i.e.Snap!programmingenvironment(seeSect.4.4.2).Thiswaythe learners,notonlyhaveaccesstotheir ideasthroughthis tool,butalsousethesamespacetoanyprojectfilerelatedtoit.

Coggle isawebapplicationthatallowstheuserstocreatemindmapsand ideas.Theycandiscussand improve the ideas collaboratively in real-time using this tool. Creatingmindmaps is done byaddingtext, imagesand linkstothemindmaps.AnygroupmemberortheSTEAMcoachcanadd,remove or modify the document or comment on specific parts of it. This way the group cancollaborativelyimprovetheirideasandpreparethemfordevelopment.AsimplescreenshotofaminmapinCoggleispresentedinFigure3.

Figure3-IdeationinCoggle

4.2. PLANNINGSTAGE

Theplanning tool shouldallowthe learners todefineawork timeline,collectmaterial (digitalandnon-digital)andassignrolestogroupmembers.Toachievethesegoals,theUUImakesuseofTrello.This isaneasytousewebapplicationdesignedforcollaborativeprojectmanagement.Theworkisdividedintoboards,andeachboardconsistsofseverallists(orcards)thatrepresentdifferentstagesoftheworkordifferenttasks.Eachtaskcanhaveadeadline,canbeassignedtoadifferentgroupmemberandcanalsohavedifferentmaterial(i.e.fromideationstage)attachedtoit.TrelloalsohasdirectcommunicationwithGoogleDrive,soimportingandattachingideationfileswhicharestoredinGoogleDriveinideationstageisstraightforward.

Page 11: Deliverable D4 · showcasing, through sharing, the final solution (Figure 1). Figure 1 - eCraft2Learn craft and project-based methodology (the 5 stages) • Ideation: The learners

©2017eCraft2Learn|Horizon2020|731345

11

Trellomakesiteasyfortheteacherstosupervisetheprojectaswell.Teacherscanbeaddedtotheprojects as group members and can comment on different aspects of the plan. They can evensubscribetotheprojectsandbenotifiedofanychangesastheyoccur.Figure4showsascreenshotofTrellowithgoal,todo,doing(inprogress)anddonecards.Beloweachtasktheinitialsforgroupmembersthatareresponsibleforthattaskisalsovisible.

Figure4-ProjectPlanningwithTrello

4.3. CREATIONSTAGE

Inthisstage,thelearnerscreatecomputer-supportedartefacts.ThisinvolvescreatingDIYelectronicsand3DobjectsandsimulationofDIYelectronics.Toachievethesegoals,theeducationalextensionshouldprovidethelearnerswithtoolsthatcanbeusedfor3Dmodelling,DIYelectronicsdesignandsimulationand3Dprinting. Inthisdemonstration,wefocuson3Dmodellingandhardwaredesignandsimulation,allofwhichcanbeachievedusingTinkerCadfamilyofproducts.

4.3.1. 3DMODELLINGANDPRINTINGTinkerCad isa free,web-based3Dmodellingandprintingwebapplication fromAutodeskwhich isaimedatyoung learnersandmakers. Ithasashape-based3Dmodelling interface,where learnerscan create new shapes by (i) manipulating basic geometrical objects, (ii) performing logicaloperation, such as conjunction and disjunction, and (iii) using pre-built 3D objects, e.g. Arduinocases.TinkerCadcanalsogenerateSTLfilesfor3Dprintingfromuserdesigns.

The softwareallows for collaborativeworkon3Ddesignsand the learners can inviteother groupmemberstojointhemintinkeringthe3Dmodels.Theinvitationsareintheformofaccesslinksthatcanbesenttoothergroupmembersthroughothertools intheeCraft2LearnenvironmentsuchasTrello.Sharing3DdesignsisalsoeasywhenusingTinkerCad,asitcandirectlysharethedesignson“Thingiverse”(seeSect.4.5.1).

Page 12: Deliverable D4 · showcasing, through sharing, the final solution (Figure 1). Figure 1 - eCraft2Learn craft and project-based methodology (the 5 stages) • Ideation: The learners

©2017eCraft2Learn|Horizon2020|731345

12

Figure5-3DModellinginTinkerCad

4.3.2. HARDWARESIMULATIONDesigningDIYelectronicsandsimulatingthedesignscanalsobedoneusingTinkerCad.“Circuits”isapartoftheTinkerCadapplication(a.k.a.“TinkerCadCircuits”)thatallowsthelearnerstodesignDIYelectronics and simulate the behaviour of their design. This application has built-in support forArduinoUNOR3microcontrollersandhasalonglistofdifferentelectronicalcomponentsincludingdifferenttypeofsensors,outputsandactuators.TinkerCadCircuitscanalsogeneratea“componentlist”whenthedesignisfinalized.

SimilartoTinkerCad3Ditispossibletosharethedesignswithclassmatesandteachers,althoughthesharingplatformisnotThingiverseandisbasedonsharingdirectlinkstoinvitees.Thosewhohavethe access link can collaborate in the design process by making changes to the design. Groupmembers caneasily share the links to circuitdesignsand3DmodelsonTrelloandassign tasks tothem.

“Circuits”alsoincludesacodeeditorfordevelopinginnativeArduinolanguage.Theeditorincludesmanydifferent librariesandadebugger.Thedebuggerprovides tools tosetupbreakpoints in thecodeandwatchthevariablesduringsimulation.

Page 13: Deliverable D4 · showcasing, through sharing, the final solution (Figure 1). Figure 1 - eCraft2Learn craft and project-based methodology (the 5 stages) • Ideation: The learners

©2017eCraft2Learn|Horizon2020|731345

13

Figure6-DIYElectronicsSimulationinTinkerCadCircuits.

4.4. PROGRAMMINGSTAGE

Deliverable D4.2 provides a set of recommended programming tools that cover a wide range ofpossibleapplications.Theseinclude:

• Snap! And Snap4Arduino: Snap! Is an open-source visual programming language. TheSnap4Arduinoflavourofithasbuilt insupportforcommunicatingwithArduinodevices(aspresented in the demo video), while original flavour of Snap! Can be used to programRaspberryPidevicesandGPIOpinswithease.

• ArduinoIDE:Whileoriginallyadesktopapplication,recentlyweb-basedversionofitisalsoavailable.TheprogramminglanguageisC-likeandtheSDKcanbeusedtogeneratecompiledcodetorunonArduinodevices.

• Scratch and Scratch4Arduino: Scratch can be seen as little brother of Snap!. It is a visualprogramming language and can be used to access the hardware (Arduino/Raspberry Pi).UnlikeSnap!,Scratchcannotbeeasilyextendedwithoutmodificationsinthesourcecode.

• Othertoolssuchas:ArduBlocks,AppInventor,PocketCode,NetsBlox.

InD4.3(v1)thefocushasbeenonintegratingprogrammingtoolswiththefollowingfeatures:

• Providevisualprogramming.• Can be easily extendedwith new components. This is especially useful when it comes to

addingnewfunctionalitiessuchasAICloudservices.• Provide open source solutions to allows the development team to make required

modificationsi.e.foraddingdataanalyticssupporttothesystem.• Caneasilyaccessthehardware(Arduino/RaspberryPi).

ThesepropertiesareallfoundinSnap!AndSnap4Arduinoprogrammingenvironments.Therefore,inD4.3 these toolsare integrated intoeCraft2Learneducationalextension.Thismeans thatAI cloudservices,dataanalyticsandfileservicesareincorporatedintoSnapandSnap4ArduinointhisversionoftheeducationalextensionandUUI.

Page 14: Deliverable D4 · showcasing, through sharing, the final solution (Figure 1). Figure 1 - eCraft2Learn craft and project-based methodology (the 5 stages) • Ideation: The learners

©2017eCraft2Learn|Horizon2020|731345

14

4.4.1. AICLOUDSERVICESSeveralcompaniesofferAIbasedcloudservices,namely:Google’smachine learning, IBMWatson,MicrosoftcognitiveservicesandAmazonAIservices.Theseservicesvaryandnormallyinclude:textand speech analysis, image analysis, pattern recognition, etc. Although these are commercialservices,theyofferfreeservicesaswellforlimitednumberofqueriesperdaywhichisinmostcasessufficientforschoolprojectsassumedinthiscontext.

Theinterfacesfortheseservicesaredesignedforprofessionalprogrammers.Thus,inordertomakethese services available to learners simplified interfaces are required. Therefore, as part of theeducational extension a set of programming interfaces are developed that can easily access theservicesfromGoogle,IBMandMicrosoft.

The interfaces expand the Snap! programming language by adding new blocks that provide theprogrammerswithspeechsynthesis,speechrecognitionandimagerecognition.Theworkpresentedbelowcanbefoundinmoredetailhere(KahnandWinters2017).

4.4.1.1. SPEECHSYNTHESISSnap!blocksforspeechsynthesisisshownbelow(Figure7).TheseblocksaresupportedonpopularbrowsersexceptInternetExplorer.Ascanbeseentheprogrammercanhavecontroloverpitch,rate,voice,volumeandeventhelanguage.

Figure7-SpeechSynthesisBlocksforSnap!

4.4.1.2. SPEECHRECOGNITIONSince the recognition services present asynchronous behaviour, the Snap! blocks designed forspeech recognition rely on continuations. These blocks have a success and an error continuation.The error continuation is optional. As continuations might be a difficult topic to grasp for thelearners,aspecialoptionalblockisaddedthatsupportseventbroadcastingandaglobalvariable.Inthisway,theprogrammercanmakeacallto“listen”,receivebroadcastwhensomethingisreceivedand retrieve the utterance from the global variable. Figure 8 shows Snap! blocks for speechrecognition.

Page 15: Deliverable D4 · showcasing, through sharing, the final solution (Figure 1). Figure 1 - eCraft2Learn craft and project-based methodology (the 5 stages) • Ideation: The learners

©2017eCraft2Learn|Horizon2020|731345

15

Figure8-SpeechRecognitionBlocksforSnap!

4.4.1.3. IMAGERECOGNITIONDifferentserviceprovidersrepresentimagerecognitiondataindifferentformats.Thismakesdesignof image recognitionblocksmorecomplex. In simple form, theeducationalextension forAI cloudservicesprovidesthelearnerswithsimpleblocksthatreturnatextualrepresentationoftheimage.Moreadvancedblockscanreturnasetofpropertiesfortheimageandreadaspecificpropertyfromit.

Figure9-ImageRecognitionBlocksforSnap!

4.4.1.4. DEMOSFORAICLOUDSERVICESINSNAP!A tutorial forusing theAI cloud services inSnap is availablehere:https://toontalk.github.io/slide-show/listen-and-speak.html

More demos can be found here: https://docs.google.com/document/d/1jnibYTmeu_Y06rhLNLI-zel4Im0O68TqH9Z0U023RXs/edit

PleasenotethatthesedemosrunbestinChromebrowser.

4.4.2. FILEMANAGEMENTeCraft2Learnprojects can includedifferent files. Althougheach tool allows for storing theprojectfiles in its own system, implementing a central place to track project files and keeping a copy of

Page 16: Deliverable D4 · showcasing, through sharing, the final solution (Figure 1). Figure 1 - eCraft2Learn craft and project-based methodology (the 5 stages) • Ideation: The learners

©2017eCraft2Learn|Horizon2020|731345

16

themwouldmaketheprojectmanagementeasierforthelearners.Inthisdeliverable,anautosavefeatureforSnap!andSnap4Arduinoisimplemented.

The educational extension for Snap! creates snapshots of the Snap! and Snap4Arduino programswhile the learners are programmingwith these tools. The snapshot is then saved in the learners’GoogleDriveprojectfolder.

4.4.3. DATAANALYTICSANDDEBUGGINGTOOLSInordertoprovidethelearninganalyticsanddebuggingtoolswithuserdata,userinteractionwithUUI should be observed and reported back to learning analytics system. For version 1, theeducationalextensionrecordsuser interactionwithUUIwhen:1)theyopenatool,2)theycloseatool,and3)theyclickonhelpdialogsrelatedtoaspecifictool.Thisdataistimestampedandsentbackfordataanalysis.

4.5. SHARINGSTAGE

Sharingthelearners’resultswithothersand/orthecommunityisanimportantpartofeCraft2Learnlearningmethodology.Thiswillnotonlyallowthelearnerstosharetheirworkwithclassmatesandfriends,itwillalsoallowthemtoshowcasetheirwork(withmakercommunities),andhenceinteractwiththisthisonlinecommunitytoshareideasandsolutions.

Sharing also allows for opening up the design/program/etc. to other tools within or outside theeCraft2Learn environment. Some of the tools which are being integrated into eCraft2Learnenvironment,alreadyhave support for sharing functionality. In thisdemo,wepresent the sharingpossibilities between TinkerCad and Thingiverse and use this to provide the learners witheCraft2Learn Thingiverse App(s) that can be used to provide the learners with wide variety ofpossibilities.

4.5.1. THINGIVERSEThingiverseisawebsiteforsharinguser-createddesignfiles.Italsoprovidesfreelessonsforpeopleofdifferentagestolearnhowtodesign3Dmodelsforprintingandhowtoprintthem.Thingiversehas close collaboration with TinkerCad and allows direct sharing of design from TinkerCad intoThingiversebyasingleclick.ByusingThingiverseasasharingplatformfor3Ddesignsthe learnersnotonlycansharetheirwork,butcanalsodownloadinterestingdesignfromothermembersofthecommunity,importthemtoTinkerCadandusethemintheirprojectsorimprovetheirdesigns(onlyopensourceandcopyleftdesignsareallowedtobepublishedonThingiverse).

Page 17: Deliverable D4 · showcasing, through sharing, the final solution (Figure 1). Figure 1 - eCraft2Learn craft and project-based methodology (the 5 stages) • Ideation: The learners

©2017eCraft2Learn|Horizon2020|731345

17

Figure10-SharingonThingiverse

4.5.2. ECRAFT2LEARNTHINGIVERSEAPPThingiverse also provides developers with a Web API that programmers can use to developThingiverseApps.ThisfeatureisespeciallybeneficialtoeCraft2LearnbecauseitallowsustodirectlycommunicatewithThingiversethrougheCraft2LearnThingiverseApps.

In this deliverable and as part of the Educational Extension, we present an Augmented RealityVisualization tool for Thingiverse. This part is not directly integrated into UUI, but as seen in thedemovideoauser candesignanobject in TinkerCad, send it to Thingiverseand immediatelyusetheirmobilephonetovisualizetheobject inareal lifesettingthroughanaugmentedrealityview.This allows the learners to visualize the object in its final environment while tinkering with it inTinkerCad.

AdemooftheaugmentedrealityvisualizerextensionforTinkerCad/Thingiversecanbefoundinthefollowinglink:https://www.youtube.com/watch?v=y9qIy02yt7M

5 CONCLUSIONThis document and accompanying videos demonstrated the first version of educational extensionand its integrationwith the UUI. The online software includes tools that support the 5 stages ofeCraft2Learn methodology. It also extends some of these tools to provide the learners withfunctionalities such as using AI cloud services in Snap! Programs, augmented reality visualizationtools for 3D modelling and auto-save features for programming tools that saves program filesdirectly on the learners’ project space. This version also includes data gathering services for dataanalytics tools that laterwillbeusedtoprovidethe learnersandteacherswithuseful informationduringtheprojectworkanddebugging.

Thissetoffunctionalitiesforversion1areselectedtoprovidethebasicsforthefirstroundofpilottests. The results of the pilot studies will provide useful insight into the next versions in thedevelopmentofeducationalextensionandUUI.

Page 18: Deliverable D4 · showcasing, through sharing, the final solution (Figure 1). Figure 1 - eCraft2Learn craft and project-based methodology (the 5 stages) • Ideation: The learners

©2017eCraft2Learn|Horizon2020|731345

18

6 REFERENCES

Literature:

Kahn,K.andN.Winters(2017).Child-friendlyprogramminginterfacestoAIcloudservices.EC-TEL2017:DataDrivenApproachesinDigitalEducation:566-570.

Websites:

https://afsheenam.github.io/UUI

https://coggle.it

https://trello.com

https://www.tinkercad.com

https://toontalk.github.io/slide-show/listen-and-speak.html

https://www.thingiverse.com