I.H.L.A MEDIA Christopher Fuller, Nicholas Johns, Ashley
Kaufman, Brandon McCauley, Matthew Pachol, Christopher Suever
Slide 2
Wish to examine what it takes to create a seamless experience
between an individual and technology Through the use of interactive
mirrors, our objective is to get the observer to interact with a
pre-designed interface and allow them to have control over the
outcome that would create a memorable experience Applications for
our proposed design would be through its use in advertising and
entertainment purposes. PROBLEM STATEMENT
Slide 3
It is predicted that spending on digital ads will surpass the
combined total of ad spending on newspapers and magazines ads in
2015 One of the biggest problems with digital advertising is a
large varying demographic of customers Form of art that involves
the spectator in a way that allows the art to achieve its purpose
Immersive Environment: Real-time image processing and manipulation,
biometric feedback and be aesthetically pleasing. PROBLEM
BACKGROUND
Slide 4
Raspberry Pi Single board computer CPU, GPU, USB AND HDMI
Raspberry Pi camera module 5 mega-pixel for images 1080p, 30
frames/sec for video HD monitors LCD/LED monitors 720p or higher
resolution HDMI compatible MAJOR TECHNOLOGIES
Slide 5
HARDWARE SPECIFICATIONS Micro-USB Power Port: 700mA (3.5W) HDMI
2.0: Up to 18 Gbits/s USB 2.0: Up to 480 Mbits/s Ethernet
RJ45:10/100Mbits/s High Bit Rate SD Cards: 95 MB/s Raspberry Pi
Camera: 1080p Monitor Display: At least 720p
Slide 6
ARCHITECTURE OF SYSTEM
Slide 7
LEVEL 0 Module Raspberry Pi: Model B, Raspbian OS Inputs
Raspberry Pi Camera: 5 MP (images), 1080p (video), 15-pin ribbon
connection, > 15 Mbits/s Micro USB Power Port: 700 mA, 3.5 W, 5V
DC Outputs HDMI Video Output: 1080p, 30 fps, Up to 15 Gbits/s
FunctionalityAcquire and manipulate the camera input to produce HD
video output.
Slide 8
LEVEL 1 Module Camera Serial Interface Inputs Raspberry Pi
Camera: 5 MP (images), 1080p (video), 15-pin ribbon connection,
> 15 Mbits/s Power: > 250 mA OutputsRPi Camera Image: 5 MP
resolution FunctionalityServes as the connection port between the
Raspberry Pi and the Raspberry Pi camera to enable image
acquisition.
Slide 9
LEVEL 1 Module System on a Chip (SOC): Broadcom BCM2835, (CPU,
GPU, DSP, SDRAM, USB port) Inputs RPi Camera Image: 5 MP resolution
Power: 700 mA OutputsManipulated RPi Camera Image: 5 MP resolution
FunctionalityIntegrates all components of the RPi module into a
single chip. Serves as the medium between image acquisition and
video output to manipulate the RPi camera image. Module
High-Definition Multimedia Interface Inputs Manipulated RPi Camera
Image: 5 MP resolution Power: 700 mA OutputsVideo Output: 1080p, 30
fps, up to 15Gbits/s FunctionalityInterface for transferring the
manipulated RPi camera image data from the HDMI-capable RPi camera
to a compatible computer monitor in order to display the HD video
output.
Slide 10
LEVEL 2
Slide 11
Module Central Processing Unit: 700 MHz, ARM1176JZF-S core
Inputs RPi Camera Image: 5 MP resolution Power: 700 mA
OutputsManipulated RPi Camera Image: 5 MP resolution
FunctionalityResponsible for the pre-processing (resizing) of the
acquired image data as well as performing image edge detection and
contour finding. LEVEL 2 Module Graphics Processing Unit: Broadcom
VideoCore IV @ 250 MHz, OpenGL ES 2.0 (24 GFLOPS), 1080p30 h.264
high-profile decoder and encoder 1080p Inputs RPi Camera Image: 5
MP resolution Power: 700 mA OutputsManipulated RPi Camera Image: 5
MP resolution FunctionalityProvides openGL ES 2.0, hardware
accelerated openVG, and 1080p30 h.264 high profile decoder and
encoder. This controls the image data manipulation by use of
algorithms including Shaders, Particles, and Grey-Scott Reaction
Diffusion.
Slide 12
High-level open source toolkit C++, object oriented Allows for
direct calls to native system libraries MIT licensed: freedom of
use in commercial or non- commercial applications. Cross platform
C++ interface to graphics, audio, video, networking and access to
many libraries OPENFRAMEWORKS
Slide 13
Header file Blue print or empty structure with no
implementation detail Cpp file Definition of functions and program.
Setup() Allows for setting of program specifics prior to running
the program (setting the windows size, frame rate, etc.) Update()
Use for continuously updating the state of the program Draw()
Allows for the interaction of the system. STRUCTURE OF
OPENFRAMEWORKS
TaskDescriptionMembers Hardware Integration Make sure hardware
applications are compatible as well as work as a cohesive unit
Fuller, Johns, Kaufman, McCauley, Pachol, Suever Software
Integration Making sure the programming languages and image
modification algorithms are compatible. Fuller, Johns, Kaufman,
McCauley, Pachol, Suever Algorithm Design Create software
algorithms to modify a users image in various ways. Fuller, Johns,
Kaufman, McCauley, Pachol, Suever Algorithm Implementation Test to
determine whether the algorithms designed are functional and work
to display the output. Fuller, Johns, Kaufman, McCauley, Pachol,
Suever Software and Hardware Integration Ensure that the hardware
as well as software is compatible and work to display the output.
Fuller, Johns, Kaufman, McCauley, Pachol, Suever Completed
Prototype of SystemCreate a working prototype that combines all
prior tasks and works properly. Fuller, Johns, Kaufman, McCauley,
Pachol, Suever EXPECTED OUTCOMES
Slide 22
PROJECT PLAN
Slide 23
Integrating all technologies cohesively Designing multiple
innovative unique display options Creating the system to work in
real-time. Allowing the user with a free range of interactive
possibilities Create a system at a low cost. Develop the system
that has minimal power concerns. CHALLENGES AND UNCERTAINTIES
Slide 24
ActivityFailureCauseSolutions Power Loss System experiences an
external power loss. Over-heating of the system as well as the over
consumption of power due to a single component. Allow for the
system to be in an environment that allows for proper heating of
the system as well as monitor the systems power consumption.
Software Failure Code or software does not function properly. Code
has bugs or other failures within or the software used is not
compatible. Determine if the code is bug and confirm that the
software is functioning properly. Hardware Failure Hardware does
not work properly. Over-heating of the system or the connections
between the components are not ideal. Test connections between the
components to determine if they are connected. Also to monitor the
systems power consumption. Environmental Issues Lighting of the
environment causes an issue within the system. Too much or too
little lighting for the system. The space in which the system is in
is not large enough for proper image retrieval. Allow for the
system to be placed in an environment that is ideal for image
retrieval as well as image output. A well lit room as well as a
room that is large enough for image retrieval that does not
compromise the system. System over- heating System over-heats
causing a failure within the system. Power consumption of the
Raspberry Pi or other components is too high. Monitor the systems
power consumption. Image outputThe image output quality is not
ideal or does not work at all. The image manipulation does not
yield a output image that is ideal. Software, code or Raspberry Pi
does not work properly. Test the output of the system onto the
monitor and determine if its both in as close real time as possible
as well in the quality that is ideal. FAILURE ANALYSIS
Slide 25
Raspberry Pi Purchased from distributor HD Monitors Utilizing
monitors that we have in our possession Camera Raspberry Pi Camera
module purchased from distributor Openframeworks Obtained from
Openframework website Visual Studio Obtained from Dreamspark
website. COMPONENT PROCUREMENT PLANS
Slide 26
Digital interactive art is a growing art form that incorporates
science and technology. Immersive environment consists of
human-computer interface which promotes social engagement from
users. Complex algorithms combined with the level of interactivity
leads to memorable and unique aesthetics. Incorporates STEM aspects
into the market world. CREATIVE AND INNOVATIVE ASPECTS
Slide 27
Project is meant to be intuitive and aesthetically pleasing.
Multiple uses such as advertising, art or just fun entertainment.
Main goal: provide a memorable, unique and interactive experience
for the user. CONCLUSION