Proof of concepts and usecases with IoT technologies

Productivity with Internet ofThings /Industrial internet

202/01/2015 2

Sensor networks

3

IoT Challenge:Dynamically and reliably measure and transmit info as close to teeth contacts aspossible to get a representative figure of affecting circumstances and load profilesPotential customer segment is critical mechanical component e.g. gear, bearingsmanufacturers and users e.g. in marine and wind power industrySupport model based lifetime estimation in industrial applications.

Result1. DWTS to spray wear and high temperature tolerant stain gauges, wirings andconnectors on the functional surfaces of gear tooth profile. 2. Passive DWTS toothcrack sensor successfully connected to NFC tag reader for wireless crack indication.3. Ultrasound technology to measure and transmit deflections along the gearcontacts.Technology Readiness Level: PoC at the laboratory level

Benefits:Identification of operational gear teeth loadings and impending faults withimplemented sensors supporting for process management and model based lifetimeestimation. Robust sensors technologies will provide new possibilities for future gearcondition based maintenance solutions.No existing low cost solutions on the market.

Contact person:Jari Halme

Use case example:

Gear tooth loading and impact sensing

Utilization e.g. atWärtsilä, ATA Gearsetc. CBM cases forextending overhaulinterval. UtilizatioFurther development/utilization will becarried out in ArTEcoproject (Martec II)

4

Flexible wireless sensor for structural andcondition monitoring

IoT ChallengeLimited number of wireless solutions to measure strain on curvedsurfaces in structural and condition monitoringRigid sensors tend to get damaged or broken on curved surfaces

ResultFlexible wireless sensor demonstrator strain measurement of curvedsteel structureMobile phone as a user interfaceWell protected against environmental stresses by vacuum castingencapsulation technique.TRL 6 proof-of-conceptCustomer segments: construction and building, machine shop industry,healthcare

BenefitsLow-cost easily deployable measurement systemEnergy efficient cable-free instrumentationCustomised measurement systemProtected against environmental stressesHigh volume pilot manufacturing possibility at VTT PrintoCent

Contact personMarkus Tuomikoski

Use case: Distributed, wirelessmonitoring of roof structures of largebuildings, such as supermarkets, musicand sport halls etc.

Mobile terminalas display andcontrol unit

5

Real-Time Sensor Life-Cycle Management and Sensor R&D

IoT Challenge:Sensors & laboratory instruments are not managed efficiently:

– Most of the problems relate to SW.– High risk involved in SW upgrades: versions, calibrations, etc.

Sensor network lifecycle management has severe problems:– Lack of support & availability/usability issues.– Manual calibrations and maintenance.

• Excessive needs for customization and modifications:– Vendor and end-user systems are all different.– Lack of interoperability, connectivity and interfacing.

Future Factories have interrogative sensors that are actively troubleshooting processes.

ResultWe have demonstrated real-time sensor R&D and production versions that enablesimultaneous usage and development of sensor software.Similarly, we can run multiple sensor calibrations and have smooth transition between them.There is a proof-of-concept demonstrator, software packages, algorithm libraries, IPRMaturity as Technology Readiness Level (TRL: 3-4), by the end of year 2014 (TRL: 5-6)There should be 1-2 patents by the end of year. Already 7 invention disclosures.In early October, we will have two real sensors for demonstration.

Benefits:Sensor availability, robustness, connectivity, easy of maintenance and interoperability.Real-time sensor R&D, comparisons, support, diagnostics.Parallel SW versions (prod, R&D, trouble-shooting, disruptive R&D…).

Contact persons:Pekka Teppola (Pekka.Teppola@vtt.fi, +358 40 834 0661)Pasi Hyttinen (Pasi.Hyttinen@vtt.fi, +358 40 532 8724)

Use case example: With SpectraCloudtechnology, sensor companies canspeed up their sensor R&D andsimultaneously validate sensor softwarein real-time. This directly translates toimproved sensor performance and betterservice quality for end-users. In addition,end-users (and automation companies)can validate safely and, in parallel,different sensor calibrations beforeimplementing the closed-loop processcontrol. CONFIDENTIAL

6

Networked sensoring and measurements in miningindustry

IoT Challenge:Mining industry needs more reliable on-line measurements for processoptimization to achieve energy and material savings as well as betterproduct qualityThe most potential customer segment is mining industry (both miningand instrument companies)Data handling and calibration can be realized remotely

ResultMeasurement needs in mining industry identifiedVTT offering for those needs mapped (TRL 3-6)A proof-of-concept study as well as development of algorithm forparticle size analysis of crushed stone for Metso Minerals (TRL 3)

Benefits:Reliable, robust on-line measurement of particle size distributionNo existing robust, low cost solutions which can measure reliably thewhole particle size distribution of crushed stone on the market.

Contact person:Matti Okkonen, Katariina Rahkamaa-Tolonen

Use case example:Minimizing losses in batchingplants with the help of on-line

information about particlesize of chips.

7

Sensor fusion for more accurate activity detection(& navigation)

IoT challenge:Accurate, low energy and connectivity-free navigation methods are urgentlyneeded in consumer devices and in special industry & security devices.New emergency call standards also require the altitude/floor information of thecaller.Barometric sensors together with inertial sensors and sensor fusion algorithmscould provide the needed functionality (activity & navigation).

Result:Testing & utilisation of the VTT’s patented MEMS barometric sensor that hasexcellent sensitivity (~0.5 Pa) and good absolute accuracy (~5 Pa), potentiallyallowing detection of altitude differences as small as 5 cm.Sensor fusion algorithm(s) that utilise the barometric sensor as well as“regular/existing” integrated smartphone sensors to detect user activity andsupport in navigation.

Benefits:The accuracy of the sensor is better than the current market leader (BoschBMP180) and on-par with the upcoming successor (Bosch BMP280).The sensor and the (sensor fusion) algorithm(s) together can provide competitiveedge for product manufacturers (wrist devices, smartphones) seeking to integratebetter activity detection and navigation functionality.

Contact persons:Jussi Polet, Henry Rimminen, Dan Bendas, Antti Iivari

Use case example:An end-user “exercise motivator”mobile application, that uses thesensor(s) and sensor fusionalgorithm(s) to display more detaileduser activity information in relation toaltitude information.

802/01/2015 8

Efficient data management and utilisation

9

An approach from data to informed decisionsIoT Challenge:

IoT solutions are typically used to optimise daily operation andmaintenance of a system but data collected and analysed by IoTsolutions can support strategic level decisions which determinesubstantial part of the life cycle costs and profitsThe approach is applicable to wide range of industrial branches

ResultThe prototype tool demonstrates concretely the approach how rawdata collected by sensors and manually can be analysed and utilisedwhen prioritising development targets, defining investment portfolioetc.The approach for data utilisation is well established and the TRL levelof the tool is 4.

Benefits:Customers are able to make informed and transparent decisions bythe structured approach.Currently commercial tools are mainly focused on data analysis inoperational level but tools for strategic level decision support are rare

Contact person:Susanna Kunttu

Use case example:Investment portfolio definitionbegin with selecting investmenttargets by analysing systemcondition, unavailability, productionbottlenecks, maintenance costsetc. Each investment proposal isthen uniformly and transparentlyevaluated to select most profitableinvestment portfolio.

10

Tools for Fast Data Discovery and Visualization

IoT Challenge:Much of the business intelligence data is stored in legacy systems and databasesThe data in legacy systems is often slow to integrate or export to applications otherthan its main functionThis challenge is likely to become more important as the number of data sourcesincrease (as is anticipated by the adoption of IoT)

Result:FastData project result is a proof-of-concept demonstration of a data pipeline tocombine existing energy consumption data (from smart energy meters in Otaniemiarea) with hourly electricity price information from Nordpool (Nordic electricity stock)This demonstrator utilizes semantic data integration framework S-APLOnline demo: http://wizard.erve.vtt.fi:10002/fastdata/

Benefits:Real-time integration and data discovery from legacy systems and databaseswithout the need for costly and custom-made ETL toolsReal-time information is needed to drive timely decisions to improve resourceefficiency, improve customer retention and customer experience (just to name a few)Information needs to be readily available (e.g. on online dashboards), not behindlegacy system interfaces and handcrafted Excel sheets

Contact person: Ville Antila

Example utilization process in3 steps:1. Connect legacy systems

and databases (real-time,semantic integration)

2. Discover new relationships,find correlations and hiddenvariables/factors

3. Renew business processesor business rules, findpotential new products

Hourly distribution electricity costof selected buildings in Otaniemi,Espoo

11

Online percentile estimation for statisticalcompression of monitoring data

IoT Challenge:The data growth due to increasing number of networked sensors ormeasurement agents. Variable and possibly very high data rate. Recoveringobserved history, trends or anomalies require saving of the past data.Supporting situation awareness require accurate real-time state information.IoT issue: Memory, CPU power and communication capacity are typicallylimited resources at the places where data is measured/collected.One potential customer segment is IoT based remote monitoring, e.g.remote monitoring of wind turbines, mobile base stations or other hard-to-reach systems. Another potential customer segment is network SLAmonitoring.

ResultThe result is a generic and tested C program library. It is an online algorithmfor estimation/computation of the percentiles of the observed empiricaldistribution of the data. It works with fixed memory and limited CPU power.Market closeness is 5 or 6 on scale 1…7. The result works in realapplications but it is not intended to be sold as such. It can be a part ofmany different IoT (and other) applications.

Benefits:Significant reduction in the amount of data (bytes) needed to be stored.Saved data will be automatically structured which makes it fast to recognizetrends or anomalies. Generic code can be tailored and applied to manysituations. It is a fast algorithm.

Contact person:Jorma Kilpi

Use case example: Windturbines monitor themselves andproduce a lot of data. Frommonitoring data the decision ofexpensive repair actions aremade. Data connection from windturbines to internet is usually slowand expensive. Processing at thewind turbine is limited.

Info

rmat

ion

High data rate.

Online statistical filtering ofdata with fixed memory andlimited computing resouces.

Lowdatarate.

12

Individually adjusted thermal indoor environmentIoT Challenge:

Currently building automation does not take in to account individualpreferences on temperature.

ResultIndividual’s preferences are used to adjust the temperature of the roomor space.The person is identified with common RFID badge or similar. Preferenceprofile is fetched from database, and room temperature and other factorsare adjusted accordingly. No sensors carried by user.In advanced case, person’s location in the room is used for localtemperature control.Based on sophisticated Human Thermal Model, which is VTT’s IPRProof-of-concept, TRL 5 (September 2014)

Benefits:Better occupant satisfaction and energy saving.Enables new service solutions for customer segments such as hospitals,hotels, offices, transportation.

Contact person:Pekka Tuomaala

Use case example:Building automation systemsdetects that Mary has arrivedat her office. Utilizing thisinformation, as well as spacetemperature level monitoring,a the solution optimizestemperature at Mary’s post– maximising Mary’s thermalsatisfaction and avoidingunnecessary energyconsumption.

13

SolarSon: Automated infrared coptersystem for photovoltaic solar plants

IoT Challenge:Once photovoltaic solar panels are installed on a large solar plant,maintenance becomes a big issue.Solar energy operation & maintenance (O&M) companies, solarcell manufacturers offering O&M services and large PV plantowners need efficient tools for detecting faults in the plants.IoT and industrial internet enable efficient solutions to the big plants.

ResultSolarSon IR UAV system detects faulty solar panels fast and afault map of the plant is created.IPR of the copter and cloud based data analysis system is created.Business roadmap is done.

Benefits:Efficient and cost-effective way to ensure sustained profitability oflarge photovoltaic systems.System is faster than handheld and rectractable pole IR methodsand more cost effective than ordinary helicopter/airplane methods.

Contact person:Pierre-Emmanuel Panouillot

Use case example: A 80 MW /2,4 km2 photovoltaic solar plantis inspected fast andautomatically and a map offaulty panels is created.Customer replaces faultypanels with new ones, repairscable connections and the plantmaintains its electricityproduction in full power.

1402/01/2015 14

Big data , roadmapping

15

Big Data Architecture SurveyIoT Challenge:

VTT should be able to answer the architectural questions, makesensible tool selections and focus our offering and research onBig DataPotentially all VTT customers interested in data analysis (NSN,F-Secure,…)Data volume, variety and velocity is increasing all the time –new tools are being developed to handle it.

ResultDocument giving a broad view on software components usedon different layers on Big Data analysis

Benefits:VTT is able to recommend the right Big Data softwarecomponents for the customer and has the knowledge to useapplicable Big Data tools in projects

Contact person:Arttu Lämsä, Ville Könönen

Use case example: Acustomer has wants to collectusage data from a mobileapplication. Using theknowledge on Big Dataarchitectures, VTT is able tocome up with a solution tostore, analyze and monitor thedata.

16

Bluetooth roadmap for IoTIoT Challenge:

IoT need low-power wireless hop from sensors to sensors and tomasternode or routing hubProprietary radio solutions do not give futureproof implementationInterfacing wirelessly with smartphone gives benefits of smartphoneevolution, easy routing and futurepoof implementation platform

ResultNew initiative for Bluetooth standard implements Mesh network overBT4.1. Current proposal is proprietary but open source.Initial evaluations of the proposed system are positive and providevery good backwards compatibilityTool for IoT projects to implement true internet of things over exsistingsmartphone base.

Benefits:Low cost IoT implementation for IoT projects and productsCompetition in smartphone space is scarce, since Bluetooth isdominating shortrange radio solution in smartphones, and whencompared with wifi much more power efficient.

Contact person:Mika S Sarén

Implementation example: Rolechanging BT MESH nodes inCSR poposal

1702/01/2015 17

Positioning, tracking and consumer behaviour

18

People Flow Monitoring with Radar Sensor NetworkIoT challenge:

IoT needs digital representation of a real worldFor example, people flow information is needed for dynamic operationof the automation systems in urban infrastructure.Current monitoring methods do not provide people tracking or do notfunction adequately in outdoor conditions (e.g. Kinect: problems in directsunlight or rain/for/smoke, low range)

Result:Radar is used for people tracking24 GHz radar with TX power of 10 mWEmbedded µC/FPGA controlRadar prototype and detection algorithm in TRL4Customer segments: lift vendors, building management system vendors

Benefits:Reliable people and object tracking with low cost sensors (bill-of-materials <100€)Long range (up to 20m), ability to cover large areas with a single sensorWorks indoors and outdoors, also in direct sunlight and rain

Contact person:Pekka Pursula

Use case examples:At a subway station crowds arebeing monitored using FlowRadarand guided by the use of adaptivelighting to use a correct number ofescalators (service level vs.energy savings)

19

People behaviour monitoring and classificationIoT Challenge:

Intelligent systems need to understand human needsCustomer segment: brick and mortar stores need to offer personalisedshopping experience to compete with online stores

ResultImplementation of people tracking by Kinect2Implementation of people tracking by stereo cameraImplementation of algorithms for 1) classifying behaviour of shoppers and2) predicting locations where shoppers will stop in near futureOffline tests of classification algorithms on real life data from Anttila;accuracy 60-80%, depending on data and task at handTechnology Readiness Level: 6

Benefits:Existing solutions are mainly used in labs; our system was used in real storesOur solution is less dependent on light and is less privacy-threatening thanvideo camera – based solutionsAllows more accurate and longer range tracking than previous version (> 8m.)Now we can offer better people tracking solution based on modern sensors

Contact person:Johannes Peltola

Use case example:• Shop managers get accurate

information regardingnumbers of customersstopping near certain standsvs. numbers of passers-by

• Shop customers can gettimely assistance when theystop near certain stands

20

Wireless, energy-autonomous shelf-label (iLabel)IoT Challenge:

Continuously changing prices cause a big amount of work in every retail-store.Especially big super-markets need a proper solution for this (S-chain, K-chain inFinland).Recording customer’s routes in a super-market gives valuable information for itsoperation.Data from and to the end of IoT chain.

ResultOur project is still on-going, but it will offer the challengin part of a toolset forsolving above described challenges.We will implement a prototype combining all the technologies for the actual label,a few wireless technologies and understanding of configuring the potentially huge(50 000 nodes) network.TRL 6-7

Benefits:Saving costs of big amount of manual work, data on customers behaviour forlayout design etc. Competitor (partner?) Marisense.Energy autonomous, tracing customers in a super-market.Competitors are battery powered, our utilises energy harvesting.Competitors have only on part of the label reconfigurable (they use stickers tocomplete the information given), we have all date configurable.Our solution is planned for huge networks (50 000 nodes).We include positioning of customers (trolleys, carts) in the concept.Our data transmission solution is quite novel, UWB and/or modulated light.

Contact person:Timo Lehikoinen

Use case example: Pricing of all goodsin Prismas.

21

Designing Attraction Points for Productive BusinessIoT Challenge:

How it is possible to measure reliably behaviour and actions of a consumerin shopping environments and understand, what are their true attractionpoints? This challenge is proposed by retail operators, manufacturers,shop fittings manufacturers and e.g. some advertising agencies.VTT’s People Tracker will (hopefully) developed further towards an easy-to-use, low cost sensor network type solution. This will enhanceopportunities to utilize eye movement tracking technologies and buildnovel, partially automated service concepts around it.

Result:The basic result is a proof of concept (prototype) of a system, whichproduces visualisation of consumers’ movements e.g. in a store and a heatmap of his attraction points. This data can be used by experts to analyse,what should be done to the setup in order to meet the requirements of thebusiness. (Maturity of the technology: TRL7)

Benefits:By getting information of customer’s attraction points the retailer canoptimize e.g. product placements or optimize locations of signage. VTT’ssolution helps to do decisions based on true behaviour of the customerinstead of guessing, what is interesting for the customer.

Contact person:Jari Kaikkonen.

Use case example: Petteri wants toimprove sales by rearranging some partsof his store. How he can reliably find out,what should be changed and evaluate theeffect of changes to the behaviour of hiscustomers? Petteri’s problem can besolved by using data gathered andvisualized with VTT’s system andanalysing the result by an expert.(Practically, this is a new, fact-based wayto design customers’ attraction points in ashopping environment.)

22

Ultra Wide-Band WSN platform with positioningIoT Challenge:

One low cost platform for high speed data transmission, low power operation, and accuratepositioningEasy standardized start-up for WSN and positioning applicationsIn industrial environment tolerance for noise is essential. Easy adaptability for differentapplications is required as wellThe most potential customer segment is machine industry

Result:Proof-of-concept demonstration for 3D positioning and user data transfer in mesh and startopologies, containing VTT developed software and positioning algorithm & some VTTdesigned HWThis has created interest and 1 customer project has started alreadyR&D is still needed: Completely VTT designed HW platform. improve features like reliability,range and throughput by optimizing SW

Benefits:Multipurpose platform for industrial WSNs and positioningThe UWB platform is noise tolerant and efficient data transmission. Yet advantages oftraditional WSNs are not sacrificed, nodes are small and low cost. There exists several WSNplatforms e.g. Zigbee based, also there are some UWB solutions but not combination like oursThere are no commercial UWB solutions on the market yet, according to our knowledge.All plans we know usually concentrate on positioning only, we combine positioning and datatransmission.I do not know any other institute or vendor having made MAC for IEEE 802.15.4 UWB.I do not know any other institute or vendor having made mesh for IEEE 802.15.4 UWB.MAC requires both start and mesh topologies; so our customers, too.

Contact person:Timo Lehikoinen.

Use case example: A robotic cranemanufacturer can use the platform tolocate end of a moving boom whilerapidly transfering sensor data from theboom to a server database

2302/01/2015 23

Security

24

MEMS CryptoIoT Challenge:

Data security is crucial for IoT.There is a risk that a successful attack which tampers with themeasurement or control data might paralyze parts of the operation.

ResultTwo pieces of MEMS cryptography modules have been built and theirembedded software has been finished.Fits directly to popular embedded platform (Beagle Bone Black)Modules show good entropy of generated secret.System level software development is ongoingDesign of a trust establishment protocol, which is secure and intuitivefor the person who installs the measurement/sensor node.Potential customers: Industrial internet / IOT vendors. Industrialmeasurement/automation providers, such as Metso.

Benefits:Tamper proof secure sensor node with easy initialization phaseCompetition is almost non-existent, since security of sensor networkshas been somewhat neglected

Contact person:Henry Rimminen

Use case example: Successfulattack which tampers with themeasurement or control data mightparalyze parts of the grid. Theremote readable measurementnodes are secured with MEMSassisted cryptography.

25

Combining network and physical system datafor added benefits to both

IoT Challenge:ICT systems in industrial sites are being compromised by attackersusing cyber-, social- or physical weapons

ResultDefinition of a shared context for all security services which canbe used to detect intrusions and deviations that are notindividually detectable, but as a groupResult type: IPRMaturity of Technology: TRL-4 (Research to prove feasibility)Customers: ICT and other areas using ICT

Benefits:Better detection of security threats in high-security systems and sitesCompetitive edge: VTT solution collection of data from separate(competing) systemsThe proposed solution improves cybersecurity through the use of bigdata and IoT paradigmsExample: SAFE security monitoring system (by Combitech) has thesame kind of features, but it is based on strong customisation

Contact person:Mirko Sailio

Use case example: Access froma specific console to a high-secure corporate informationsystem is temporarily restrictedfrom user A (e.g. until anotherform of authentication isperformed), based on the fact thataccording to the physical accesscontrol system, she is currentlylocated in another part of thefacility.

2602/01/2015 26

User interfaces

27

Enhanced Interactive Augmented Reality Experiencewith Dynamic Print and Smart Phone (DynamicAR)

IoT Challenge:Brand owners, consumer good and packaging manufacturers are looking for cost-effective,scalable methods for 1) sales promoting to differentiate their products; 2) productanticonterfeiting.

ResultA demo made for Android smart phone: an AR application using commercial temperatureresponsive inks printed on product (picture).First sales pitch with the demo coffee cups to a major brand owner (Nestle) and paper boardconverter (MetsäBoard) on Aug 9.A road map for developing ALVAR and ALVAR 3D Tracker created: Functionality for ALVARetc with free open-source OpenGL Game Engine integration to support rendering of third-party 3D models for eg commercial purposes was achieved. In the future, the current AR SDKutilized in this demo could be replaced with ALVAR.TRL 5-7

Benefits:The benefit to the customer (= brand owner): Advanced method to get more info with lessspace in product: unlock many hidden stories/identification layers using just one marker.Possibility to apply for antifounterfeiting.Competitive edge: cost-effective, scalable opportunity by combining functional prints andsmart phones.

Contact person:Eero Hurme

Use case example:Functional thermochromic markerprinted on paper sleeve, mountedon paper board coffee cup: ARdemo changing on smart phonescreen whether cold or hotcontents.

28

Transparent Ultrasonic Transducers (TUT)for advanced user interfacing

IoT Challenge:New user interfacing and interaction technologies are strongly andurgently needed to improve users’ experience towards immersiveenvironment, augmented reality, wearable devices and smart machinesetc.

Result18.09.2014: fully released TUT deice demonstrated on Si wafer; deviceson glass wafers are coming soon; devices will be finallised by end of Sep.Then devices can be tested by impedance analyser etc.VTT unique ipr; TRL 3-4

Benefits:This is new and disruptive technology for ultrasonic perception with lowerpower, more efficient and more robust;The transparent ultrasonic eye tracking is a unique solution withoutblocking the sight and provides powerful touchless input method usingsame type of transducers

Contact persons:Bin GuoJani Mäntyjärvi

Use case example: Proposedtransparent ultrasonictransducer can be freely placedon top of the display element onany display technology, and orin the line of sight on eyewear.They can be used in PCs, TVs,mobile phones, google glasses,wearable devices, smartmachines etc.

TECHNOLOGY FOR BUSINESS