Embed Size (px)
Citation preview
Hi, we are
Jasia Stuart and
Sean Cooneylet us tell you about the
Sandbox
$_
Intro + Theory ~ 45 min
Make it work ~ 60 min
Overview and resources ~ 15 min
Questions
$_
Workshop Objectives
• Understand VR and different types of VR experiences
• Become familiar with using Google Cardboard
• First Steps building a VR experience in A-frame
• Next Steps planned
• Follow up session for sharing and debug in 2-weeks
$_
$_
New things!This is a Bootcamp-Toolkit in progress
please share your idea for making it great!
• Assemble your cardboard headset
• Try it!
$_
360 Image 3D Model Viewer
What can go wrong?
• Enable rotation in your settings
• Enable sensor permissions
• Nausea
• Try a different browser (Chrome)
$_
There are a few common issues
VR History
• Sword of Damocles (1968)
$_
https://assets.mspimages.in/wp-content/uploads/2019/04/damo.jpg
VR?AR?XR?MR?QR?RR?
• Virtual Reality
• 0 real world visibility
• immersive
$_
• Augmented Reality
• Real world + Digital elements
• "emerging" technology
• "Mixed" Reality
• Vauge marketing term
• Usually "pass-through" AR
VR Headsets on the market
• Vive,VivePro, Vive Focus
• ValveIndex
• OculusRift 1 & 2
• OculusQuest 1 & 2
• Windows VR head sets (HP, Asus, etc)
• Samsung Gear
• Daydream
• Google Cardboard
$_
3D @ Concordia$_
• Panoramas (immersive rather than 3D)
• Agisoft Metashape Pro – Sandbox Photogrammetry
• Geospatial data subject guide (Lidar data for model generation)
• Courses!• Design students -> Rihno, Sketchup• Engineering students -> Fusion360, AutoCAD, SolidWorks• Art & Video Game Students -> Blender, Maya
VR (gear) @ Concordia
• Milieux <- Graduate student focused research clusters (multidisciplinary)
• Technology Sandbox <- Everyone
• Visualization Space <- By request
• Other amazing options you let us know about ;)
$_
VR in Montreal$_
Phi Centre
VR Gaming Centers XR Meetups
VR Assets$_
Old sweet chestnut tree in Kew Garden, Scan acquired using RIEGL VZ400 (with
RGB camera) by Phil Wilkes (@kungphil) and Mathias Disney (@mdisney) from UCL
Geography and NCEO https://sketchfab.com/3d-models/old-sweet-chestnut-tree-in-kew-gardens-0c58b7ef6227415fbad87c6eb00efe93
VR Assets • Make 360 degree photos from most phones (pictures below from
textures.com)
• 360 degree cameras available for loan from the Sandbox
• 3D Models ( .obj and .gltf preferred, but file types can be converted)
• Photogrammetry, small scanners in the Sandbox
• DigiFab has one high resolution scanner
• Many online repositories – think about copyright
$_
VR Skills
• A-frame ( or Unity or Unreal or WebVR directly)
• 3D modeling and animation (Blender is powerful, but requireslarge time investment)
• webhosting (files must be served https)
• programming (javascript +DOM+HTML)
• interface/experience/game design skills
• note: your favorite first-person shooter was probably built by a big team. Start small and clever.
$_
Options for building VR experiences
$_
What Platforms?
How Complicated?
What Audience?
Features?
IF:Platforms = PC,MAC,WIN,AND,IOS
Complexity < AAA Game
A-Frame
Else:
UnityUnrealGodot
etc
Can A-Frame do Everything?
• Java-Script Libraries that extend A-Frame Capabilities
• 3D models with animation/textures
• APIs
• Thinking about interactivity- many interactivity limits are related to the headset
• Increasing browser support & features (permissions issues)
$_
“Not Yet” Advanced features:
$_
Hands-on section:Make a glitch.com account
(screen-share follow along)
Checklist:• manipulate primitives
• Upload an obj (GLTF)
• add textures
• plane and sky
• Use the inspector
• view on Cardboard
• bonus challenge
• introduce the docs
$_
Common problems• Glitch assets folder (bad) not compatible with folder-based file
types, external hosting recommended ( there are cross-origin problems here sometimes)
• Extra libraries - compatibility issues with newer versions of a-frame, each other
• Debugging is just super fun ( use the developer console (F12) and the inspector tool)
• Interactivity is complicated with cardboard
• Phone browser version/compatibility
$_
For future reference• A-Frame course on Udemy
• Every glitch project it a Git repo (version management)
• Develop locally
• VR locomotion
• Gaze based interaction
• Glitch projects are all git repos (version control + collaboration)
• Spatial audio
• AR
• 360 degree photos stitchable from most phones
• Photogrammetry
• Other hosting options
• https for everyone – https certificate
$_
What did we learn?-how to enjoy VR with cardboard
-what component make up different VR experiences
-what is a-frame and how to make a basic experience
-how to find or create different components of VR content (models, 360 degree video, JavaScript libraries, hosting options)
-Where to learn more about building in VR
$_
Debugging is hard!
Follow up• Bring us problems you encounter
• Share your projects!
• Share your favorite resources!
• Let us know what Concordia can do to help?
$_
Inspiration – beyond gaming
https://durrantlab.pitt.edu/pvr (protein VR - navigation a bit challenging on carboard)
https://vr.youtube.com/ (a lot of content, also creation tips for video work)
https://aframe.io/showcase/ (further A-Frame examples)
https://sketchfab.com/ccarlsson (3D scanning enthusiast - Urban, iPhone Pro)
https://sketchfab.com/kungphil (3D scanning enthusiast - nature, professional lidar)
https://hubs.mozilla.com/ (VR meetup spaces)
VR-Resources
https://concordia.udemy.com/course/learn-a-frame-and-get-ready-for-webvr/ (Very complete A-Frame course)
How to access Concordia’s Udemy Content: https://www.concordia.ca/next-gen/digital-strategy/resources/udemy.html
https://www.youtube.com/watch?v=ktjMCanKNLk&list=PL8MkBHej75fJD-HveDzm4xKrciC5VfYuV (YouTube Blender Tutorial series)
https://concordia.udemy.com/course/git-goihttps://concordia.udemy.com/course/git-going-fast/ng-fast/ (Udemy 1h git course)
https://concordia.udemy.com/course/blenderlowpoly/ (low poly Blender course on Udemy)
http://monstermash.zone/ (make balloon like GLTF animations, FAST)
https://www.tinkercad.com/ (basic modelling)
https://www.thingiverse.com/ (simple 3D models with a focus on printing)
https://letsencrypt.org/ (https certificates – medium complexity)
https://glitch.com (development environment, free hosting and https)
https://aframe.io (demo, documentation and community)
https://sketchfab.com/ (3D models, a variety of formats, some free some paid)
https://sketchfab.com/jasia.stuart/models (Lidar models I’ve posted directly - unedited)
https://www.textures.com/library (textures and normal maps – limited amount freely available)
https://www.w3schools.com/ (HTML, JavaScript)
https://www.blendswap.com/blends (3D models, starting in the blender format, easily converted)
Vocabulary
Platform - a group of technologies that are used as a base upon which other applications, processes or technologies are developed.
Virtual Reality (VR)- refers to computer-generated environments or realities that are designed to simulate a person’s physical presence in a specific environment that is designed to feel real.
Augmented Reality (AR)- Augmented reality combines real and computer-based scenes and images to deliver a unified but enhanced view of the world.
3D model- A 3D model is a mathematical representation of something three-dimensional.
Web hosting-The basic form of publication on the web is hosting. A server hosts a file if it stores the file on disk or generates the file from data that it stores, and that file did not (to the server's knowledge) originate elsewhere on the web.
Asset – Shorthand for anything that goes into a video game – characters, objects, sound effects, maps, environments, etc.
VR headset – A head-worn apparatus that completely covers the eyes for an immersive 3D experience. Also called "VR goggles,“.
Google cardboard – A 3D virtual reality headset constructed of cardboard, introduced in 2015. Designed by Google and made by third parties, Cardboard holds an Android smartphone and uses the Cardboard app or a third-party app to display a stereoscopic view.
Quick Response (QR) quick response code - A quick response (QR) code is a type of barcode that can be read easily by a digital device and which stores information as a series of pixels in a square-shaped grid. QR codes are frequently used to track information about products in a supply chain and often used in marketing and advertising campaigns.
Photogrammetry-The input to photogrammetry is photographs, and the output is typically a map, a drawing, a measurement, or a 3D model of some real-world object or scene.
Lidar-Lidar is an acronym for “light detection and ranging.” It is sometimes called “laser scanning” or “3D scanning.” The technology uses eye-safe laser beams to create a 3D representation of the surveyed environment.
API-API is the acronym for Application Programming Interface, which is a software intermediary that allows two applications to talk to each other
Technology Sandbox info and resources:
https://library.concordia.ca/technology/sandbox/
(Subscribe to our newsletter or join our weekly meetups TBD)
[email protected] [email protected]
$_
