Augmented and Mixed Reality Virtual and Mirror Reality Jan 2009.pdf Augmented and Mixed Reality

  • Published on
    04-Aug-2018

  • View
    212

  • Download
    0

Transcript

  • Augmented and Mixed Reality Virtual and Mirror Worlds

    Charles WoodwardCharles Woodward

    January 20, 2009

  • VTT TECHNICAL RESEARCH CENTRE OF FINLAND

    Introduction (1)Introduction (1)Virtual Reality

    CAVE SystemsE.g. Lumeportti at VTTBack projected screensBack projected screensPolarized data glassesMagnetic tracker, other

    PC applications3D CADComputer

    GamesOn-Line

    Virtual WorldsWorlds

  • VTT TECHNICAL RESEARCH CENTRE OF FINLAND

    Introduction (2)

    Augmented Reality (AR)Mixes virtual objects with view of real world

    Introduction (2)Related technologies

    Augmented VirtualityMixes virtual objects with view of real worldC.f. Virtual Reality (completely virtual worlds)Properties: real-time, interactive, 3DTracking + rendering + display

    Augmented Virtuality Mediated RealityDiminished Reality

    -> Mixed Reality (MR)Tracking + rendering + display > Mixed Reality (MR)

    Reality Augmented Reality Augmented Virtuality Virtual Reality

    Mixed Reality

  • VTT TECHNICAL RESEARCH CENTRE OF FINLAND

    Display DevicesDisplay Devices

  • VTT TECHNICAL RESEARCH CENTRE OF FINLAND

    Example Application

    ARCatalogueViewing with data glasses / web camera

    Example Application

    Viewing with data glasses / web cameraStereo 3D products appear from catalogueBased on marker detection from camera view

    Applications, e.g.B2B marketing by Lappset Group 3D viewing of isometric views by Pyry

    Also, camera phones, p

  • VTT TECHNICAL RESEARCH CENTRE OF FINLAND

    Entertainment, GamesEntertainment, Games

  • VTT TECHNICAL RESEARCH CENTRE OF FINLAND

    Interior DesignInterior Design

    Project AR SisustusProject AR-SisustusTekes TILADuration 2008-2010P tPartners: VividWorks, Floobs, UPCode, DeskArtes, Sensetrix, Kesko,

  • VTT TECHNICAL RESEARCH CENTRE OF FINLAND

    ArchitectureArchitecture

  • VTT TECHNICAL RESEARCH CENTRE OF FINLAND

    Mobile / OutdoorsMobile / Outdoors

    Google Earth on Earth

  • VTT TECHNICAL RESEARCH CENTRE OF FINLAND

    Production SitesProduction Sites

  • VTT TECHNICAL RESEARCH CENTRE OF FINLAND

    Augmented AssemblyAugmented Assembly

  • VTT TECHNICAL RESEARCH CENTRE OF FINLAND

    Mobile Augmented RealityMobile Augmented Reality

    one of the technologies toone of the technologies to

    most likely to alter industries fields of researchmost likely to alter industries, fields of research, and the way we live.

    - MITs annual review 10 Emerging Technologies 2007

    - Also, Gartners Top Ten Disruptive Technologies 2008-2012

  • VTT TECHNICAL RESEARCH CENTRE OF FINLAND

    Technology Enablers and DriversTechnology Enablers and DriversSmart mobile terminal

    Technology convergence to smart phonesTechnology convergence to smart phonesIncl. camera, 3D graphics, WLAN, WiMAX, 4GUp to accelerometer, compass, RFID, 3D displaysE g Nokia N95 -> 6210 (MARA) iPhoneE.g. Nokia N95 > 6210 (MARA), iPhone

    Minituriarised data glasses E L th h lE.g. Lumus see through glassesMyVu video glasses for iPodLaster EnhancedView AR l ?!AR contact lenses?!

  • VTT TECHNICAL RESEARCH CENTRE OF FINLAND

    Technology Enablers and DriversTechnology Enablers and DriversAR software technology

    Markerless trackingMarkerless trackingContent creation tools

    Game industry e gGame industry, e.g.Sony Eye Toy (gesture based AR)Eye of Judgment (marker-based AR)G t T k ( d i h )GestureTek (camera driven phone games)

    Commercial activitiesIntersense (USA)Metaio (Germany)Total Immersion (France)ARToolWare (New Zealand)

  • VTT TECHNICAL RESEARCH CENTRE OF FINLAND

    Virtual and Mirror WorldsVirtual and Mirror WorldsSecond Life, Habbo Hotel etc.

    Massively multi-user online worldsMassively multi user online worlds

    Google Earth User created content / geo taggingUser-created content / geo-tagging Incl. 3D buildings, photos, panorama, etc.

    fMicrosoftPhotoSynth3D reconstruction of the the world

    NokiaImage SpaceImage SpacePoint and Find

    Enablers for Mixed RealityEnablers for Mixed Reality Shared content, navigation, tracking

  • VTT TECHNICAL RESEARCH CENTRE OF FINLAND

    Mixed RealityMixed Reality Not just visualization

    Interface between digital and real worlds

    Applications, e.g.Google Earth On EarthSecond Life Real LifeInterface between digital and real worlds

    User-created Internet content, feedbackLife logging, physical object loggingInteroperability devices and applications

    Second Life Real Life4D BIM Construction siteDigital factory Real factory

    Interoperability, devices and applications

    Augmented with 3D models, images, signs, tags, instructions, messages, ...Digital World

    Virtuality

    Augmented Reality

    RealityA t d

    Augmented with photos, videos,

    Augmented Virtuality Mixed Reality

    R l W ldug e ted t p otos, deos,textures, messages, products, people, ...

    Real World

  • VTT TECHNICAL RESEARCH CENTRE OF FINLAND

    Mixed Reality Projects at VTTMixed Reality Projects at VTT

  • VTT TECHNICAL RESEARCH CENTRE OF FINLAND

    Project Mobile Mixed RealityProject Mobile Mixed RealityNational ICT-SHOK project

    Duration 2008-2010, budget 4,3 M

    Partners Nokia Sesca VTT HUT TUTPartners Nokia, Sesca, VTT, HUT, TUT

    Piloting in Ubiquitous Helsinki, Living Labs context

    Mixed Reality services, user created content at public spaces

    MissionMission

    Enable social ubiquitous media by linking global resources and local relevance often supplied directly by empowered users with visual discovery and interaction in the physical world and on-line, using mobile phones as gateway between physical and digital worldsg y y g

  • VTT TECHNICAL RESEARCH CENTRE OF FINLAND

    Project AR4BCProject AR4BCAugmented Reality for Building and Construction

    Industrial partners incl. Pyry, Tekla, Skanska, ...Industrial partners incl. Pyry, Tekla, Skanska, ... Tekes VAMOS programme, 2008 2010

    Augmented on site visualizationAugmented on-site visualizationComparing project plans (4D BIM) with actual situation on site

    Augmented site journaling Mobile feedback to BIM systemAttach images, tags etc. to components in BIM modelAugmented Virtuality

  • VTT TECHNICAL RESEARCH CENTRE OF FINLAND

    Project MR-ConferenceProject MR ConferenceMixed Reality Video Conference

    Teleconference btw real people and SL avatarsTeleconference btw real people and SL avatarsTekes TILA programme, partners VTT, TKK, Nokia, IBMOne year, starting October 2008

  • VTT TECHNICAL RESEARCH CENTRE OF FINLAND

    Real factoryKnowMan: Smart Factory Scheme Real factorymachinesproductspeople

    Digital information represented at factory floor,

    KnowMan: Smart Factory Scheme

    people

    Interoperation between

    p y ,for operation, training etc., using augmented reality

    Interoperation between digital and physical factory

    Intuitive visualization by Augmented Reality

    Feedback by natural HCI / Augmented Virtuality

    Digital factory3D models, layoutssimulations, processes

    Augmented Virtuality

    Feedback from real to plans, forecasts digital factory, incl. silent

    information, methods e.g. motion capture, photos, videos (augmented virtuality)

  • VTT TECHNICAL RESEARCH CENTRE OF FINLAND

    Thank You!

    Prof. Charles WoodwardVTT T h i l R h C t f Fi l dVTT Technical Research Centre of Finland

    Vuorimiehentie 3, Espoo, FinlandTel: +358 20 722 5629Tel: +358 20 722 5629

    charles.woodward@vtt.fihttp://www.vtt.fi/multimedia

Recommended

View more >