A Multipurpose Software Sensor Toolkit Architecture for ... · Dr. Armando Guevara Chief Executive Officer Wed 9.23.15 A Multipurpose Software Sensor Toolkit Architecture for UAS

Dr. Armando Guevara Chief Executive Officer

Wed 9.23.15

A Multipurpose Software Sensor Toolkit Architecture for UAS Modular and Scalable Applications

www.visualintellingenceinc.com COMPANY PROPRIETARY – NOT FOR PUBLIC DISTRIBUTION2

Introduction to Visual Intelligence (“VI”) and the iOne STKA®Overview of iOne® Technology Capabilities User perspectives and UAS 3D Solution: Micro Camera ArrayA proven technology: iOne Airborne Sensor System Solutions ARCA® Technology Software Foundation Conclusions

AGENDA


About Visual IntelligenceFounded in 2003 as a mapping services company

Restructured in 2007 to become a technology R&D company focused on developing a unique software and hardware sensor array architecture (branded iOne STKA®)

Based in Houston, Texas

Privately Owned and Funded

11 Employees– includes 7 engineers (software, hardware, electronics, optics) all with

PhD and/or MSc

Owns numerous array hardware and software patents that support its technology


he iOne Software Sensor Tool Kit Architecture (“the iOne STKA”)

The iOne STKA® is a patented software and hardware array architecture from which metric 2D/3D imaging sensors can be built

The platform integrates COTS components in an economical and efficient way (“iOne Sensors”)

iOne Sensors are designed to produce an output that is readily ingested by leading 3rd party software suites

The company has now embarked on using the iOne STKA to build micro array devices that can be used in smarter phones, PCs, tablets and UAS/drones for consumer and enterprise applications


iOne STKA Sensor Attributes

Software driven architectureAll electronic (no moving parts)Lego®‐like, scalable platform Array system integration with off‐the‐shelf components Economies of scale achieved thru the reusability of designs, arrays and components


iOne STKA® TechnologyPatents, Awards and Recognitions

Numerous Patents Awarded Worldwide USGS Sensor Type Certification in 2009 to validate first sensor prototypeFirst US Corp to receive the Geospatial World International Technology Innovation Award in Sensors 2013 2014 MAPPS Technology Innovation Award and Grand AwardVisual Intelligence named one of the ‐ 20 Most Promising GIS Solution Providers 2015 ‐ by CIO Review ‐ Maximizing Returns with Flexible Digital Sensor Solutions (Pages 15 and 50)


Overview of iOne Technology Capabilities

Visual Intelligence (“VI”) is a technology company that, has developed unique geospatial sensors for use in aircraft‐ the iOne Sensor System Solutions

VI’s sensors are based on a software architecture that allows for the co‐mounting and co‐registration (CoCo™) of multiple passive and/or active sensors into a single highly accurate system (e.g. EO, RGB, thermal, LiDAR, radar, etc.)

Supports stereo and 3D geospatial applications

VI looks to apply its technology in micro sensors that support UAS and 3D collection and analytics/modeling apps


Trends in Imaging Sensor/Camera Technology

Mobile devices exponentially growing and moving into 3D

Hexagon Smart Phones Microsoft iOne Sensors

2002‐ongoing 2002‐ongoing 2012‐ongoing

Cameras

000s 2003‐ongoing

DeviceWare2014 – emerging 3D

ADS Ultracam

DMC

More smarter imaging – 3D ‐ Smaller – Lower cost

MONOLITHIC SINGLE PURPOSE ‐ DSLRs

EXPENSIVE‐BIG‐HEAVY EXPENSIVE‐BIG‐HEAVY Collect More. Do More. For less.

9

www.visualintellingenceinc.com – Dr. Armando Guevara510 Bering Drive Suite 310 Houston Texas 77057 Tel 713‐917‐8300

Paradigm Shift from Monolithic Single Purpose SensorsTo one sensor architecture for many platforms

telligence Company Confidential

iOne STKA

UAS/UAV


Overview of VI Product LinesiOne Aerial Sensors and Software (Current Product Line)– Stereo, Oblique, and 3D Collection Capabilities– Seven systems built to date– About half cost of competitors for similar or better performance

3D Micro Camera Arrays (New Product Line)– Leverage aerial technologies to produce wide field, high resolution

real‐time 3D products

UAS/Drones Sensors (Proposed Product Line)– Miniaturized aerial sensors focused on niche 3D and spectral

applications with weight/cost sized for small to large drones


Current iOne Aerial Product Applications

iOne IMS

Interface to 3rd Party Production Applications have been Tested


ARCA® Technology FoundationARCA Array Software and hardware that combines sensors of multiple types into a compact array. Largest field of view thru smallest aperture.Array Retinal Camera Architecture US Patent # 8,334,903 B2 and 0ther patents.

Virtual Frame (Camera Image Fusion)Photogrammetric and image processing methods to fuse images into a single frame with high measurement accuracy. Resulting image behaves as if taken by a single camera/sensor.

Array Calibration for High Positional AccuracyMethod to achieve subpixel measurement accuracy from a virtual frame.


Micro Camera Array (“MCA”)


Micro Camera Array FeaturesMore accurate 3D models due to multiple cameras and photogrammetric based calibration methods

Ultrahigh resolution camera (50‐100 MP) due to virtual frame technology

Ultrahigh resolution extended thru super‐resolution methods (100‐200MP)

Capable of scanning large areas quickly due to wide field of view (100 degrees) and long distances (30‐50ft) with millimeter to centimeter level absolute position accuracy

Produces true digital zoom over a very wide zoom range Video mode for H.264 and H.265 compliance


Micro Camera CapabilitiesHigh‐measurement accuracy over long distance 3D depth maps for post‐exposure image correction and measurementHigh‐speed data captureSignificantly exceeds next generation cell/tablet camera resolution (50MP to 200MP+) Less cost than laser or structured sensorsResolution scalingPreempts increased accuracy & resolution needs for future hand‐held devicesPost‐exposure consumer image editing


Business Applications for the Micro Camera

Asset Management. Compliments aerial sensors for more complete point cloud models. Supports scanning of full facilities for asset management helping generate detailed Building Information Models (interior + exterior)

Large‐Scale Building Models. Fill business niche for 3D building interior collection for commercial real estate, insurance and emergency response applications

As‐Built CAD. Fills commercial large scale measurement requirements for producing as‐built CAD models

Augmented Reality. Ideal for producing content for Augmented Reality applications


Functional MCA Architecture


MCA Primary Image Modes

tual FrameMakes many cameras operate as a single camera to subpixel accuracy using Depth Map

epth MapInterior or Exterior10 cm accuracy at50 feet

Super Resolution• 1.5‐2 x

increase in physical resolution

Video• Full

roving & zoom at video rates

100+ DegreeFOV

H.265

H.264


Robotics / UAS / Drone navigationOil and GasHomeland SecurityReal EstateBIM, Interior Mapping, Close Range Photogrammetry.Infrastructure Monitoring/ManagementForestry, Agro, EnvironmentalAs‐built SurveysInsurance Claims (change detection)

3D Enterprise/Consumer Applications

• Laptop/PC “Visual Intelligence”• Social Media and Newscasts• AEC ‐ Infrastructure Construction• Emergency Response / Medical delivery• Law enforcement / Surveillance• Situational Awareness / Search• Gaming – Extended Reality• Hunting• Search and Rescue• Virtual Reality• Augmented Reality

nterprise examples: Consumer examples:


Potential Miniaturized ApplicationsDrones, UAV, Smarter Phone, Interior Maps


Broad Spot’s use of the iOne STKA is an example of putting aminiaturized sensor array to use in solutions that will do emarkable things in the field of eye care–all within our vision of gher collection, quality and accuracy for less cost. Broad Spot

maging Corporation will be the exclusive licensee of the ARCA atents for ophthalmology applications, and we are excited to be orking with them on this medical solution for the benefit of uman‐kind.”

Case Example: Broad Spot Imaging Corp


Case Example: Mini Oblique for UAS/Drones

Based on the iOne n‐Oblique airborne sensor, this micro sensor is being specifically designed for UAS/Drone payloads using the iOne STKA methods and architecture.Unique capability to gather 360o imaging covering nadir (ortho) and 4 cardinal directions (oblique).Target applications include insurance, real estate, infrastructure monitoring (e.g. Oil & Gas), change detection, 3D modeling (point clouds, CAD, as‐built, BIM), virtual, augmented and extended reality.


iOne UAS n‐Oblique

Pixel 7555 x 55455.4 mm lens = 114° x 85° FOVGSD @200ft AGL = 1.5cm @ nadirFrame size @ 200ft = 185m x 110 m


iOne UAS n‐Oblique

Ortho area

Pixel 4000 x 30005.4 mm lens = 60° x 45° FOVGSD @200ft AGL = 1.5cm @ nadirFrame size @ 200ft = 70m x 50 m

een represents stereo/ortho area° x 60°ue outside of green represents Oblique area


Existing Product Overview and Output Examples


Visual Intelligence IP/Product Evolution

Business operated as rvice provider utilizing

technology

1998‐2006

Technology Evolution enabled by iOne STKA

NEXT Future Possibilities


Traditional Large Area collection of High Resolution Nadir images.

Oblique Camera for 4 sided oblique and nadir images to model in 3 dimensions.

One Commercial Mapping Systems

iOne n‐Oblique

iOne Stereo

Oblique Infrastructure Mapping System – Used for Corridor Mapping for Power lines and Pipelines.

iOne IMS co‐registered with laser mapper to give multiple layers of accurate data.

iOne M+

Medium Format Sensor for smaller missions at a more economical

UAV Mountable

UAV Mountable

UAV Mountable

One Software Technology….Multiple Sensor Configurations


VI Products Address Wide Value Chain

p Imageryique Imageryctral Imageryed Imagery

p Imageryique Imageryctral Imageryed Imagery

• Elevation Models • Precision Images (Orthos)• Transport/Nav Maps• Vegetation Maps

• Elevation Models • Precision Images (Orthos)• Transport/Nav Maps• Vegetation Maps

Integrated Data

Management

PARTNERS• Oil & Gas• Insurance/ Real

Estate• Utilities inventories• Telecom• Energy• Architecture • Engineering• Construction (BIM)• Asset Mgt• Assessors• Social media• Entertainment• …and more.

PARTNERS• Oil & Gas• Insurance/ Real

Estate• Utilities inventories• Telecom• Energy• Architecture • Engineering• Construction (BIM)• Asset Mgt• Assessors• Social media• Entertainment• …and more.

M$ Product Value & Market Size B$$$$$

llect ImageryTraditionalProducts

Advanced 2D/3D Products

CloudData Mgt.

3D VerticalApplications

2 3 4 5

• 3D Point clouds• Oblique’s• With partners 3D models

• 3D Point clouds• Oblique’s• With partners 3D models

• 3D Database• 3D Applications• Integrated Information Data Models

• Web Viewers/ Distribution

• 3D Database• 3D Applications• Integrated Information Data Models

• Web Viewers/ Distributionpping Companies

vigation Companiesuranceal Government

pping Companiesvigation Companiesuranceal Government

• Local Government• Fed Gov (BLM, ACE)• On‐line Mapping• E911/First Responder

• Local Government• Fed Gov (BLM, ACE)• On‐line Mapping• E911/First Responder

• Insurance• Commercial Real Estate• Fed Government• Local Government

• Insurance• Commercial Real Estate• Fed Government• Local Government

VI VI VI

Partners


Automated color ortho generation


DSM Generation / “Depth Map”


Oblique Automated Generation


NIR MS 4 Band Automated Generation

1:1 Co registration of color and NIRAutomated MS‐Ortho Generation


Co‐Registered Forward and Backward Oblique


Advanced Radiometric AlgorithmsTest flown during an overcast day. Before & after radiometric corrections.

Extend sensor operation during “extreme” light or weather conditions


Selective Feature Extraction

Automatically locate feature and extract


Point Cloud Generation for 3D Modeling

Click


iOne STKA UAS Array Architecture

rray Retinal Camera Architecture

The ARCATM

Array Retinal Camera ArchitectureUS Patent # 7,893,957

Array Retinal Camera Architecture


Optimal maximal coverage and FOV thru the smallest aperture

Patented ARCA Provides Widest FOV CollectionArray behaves like a single sensor – a virtual image

Array Retinal Camera Architecture US Patent # 8,334,903 B2

Other Patents Apply

http://www.visualintelligenceinc.com/products/patents/

Collection and Functional Scalability – Highest metric performance

40


ARCA® is about GeometryThe ARCA geometry can be embodied in different form factors –arched or flat are two examples

Plate with angle adaptersPlate with angle adapters

=

Array Retinal Camera Architecture

41


Array Collection Scalability

Dual ARCA Array Largest swath / FOVUnique ability to build “pixel vacuum cleaners”


Other Patents Apply


42


Array Functional Scalability

Dual ARCA Array Co-Mounted and Co-Registered Sensor Fusion


Other Patents Apply



iOne UAS Sensor Solution Positioning

http://www.marketsandmarkets.com/Market‐Reports/unmanned‐aerial‐vehicles‐uav‐market‐662.html?gclid=CP6‐mPeNuLsCFe5j7Aod628AKA

Visual IntelligencePositioning


iOne UAV Sensor scalable for many apps

‐45‐40‐35‐30‐25‐20‐15‐10‐50

Weigh

t Pou

nds

Levels Based on Sensor Solution Compounded Size/Weight‐Level III‐ ‐Level II‐ ‐Level I‐

45


UAS Array Architecture

46


UAS Array Architecture

47


Array Modular Encapsulation for UAS Multipurpose Missions


Made possible by…

Planning, command and control, and navigation systems, simple sensor solution integration, with any UAS platform.

iOne “Small to large” UAV/UAS


Sensor Fusion ‐ CoCoTM

CoCo - Co mounting and Co registering of sensorsUS Patent # 7,725,258


ne STKA: Many 3D Sensor Applications Hosted in one Device‐Content eCosystem

iOne STKA and iOne Sense 3D


Conclusions and Next Steps

Visual Intelligence has developed the iOne STKA®, a patented software and hardware array architecture that can be applied to design and develop sensor platforms of all sizes.As the use of UAS/3D products continues to evolve, VI has embarked on developing a micro camera array based on its proven technology. Applications for the patented array include use on laptops, cell phones, UAS/Drones and other handheld devices.


Questions?

53


Documents

A Multipurpose Software Sensor Toolkit Architecture for ... · Dr. Armando Guevara Chief Executive Officer Wed 9.23.15 A Multipurpose Software Sensor Toolkit Architecture for UAS