Upload
fiatifta
View
135
Download
2
Embed Size (px)
Citation preview
4Quant
Video and Image Analytics with Machine Learning
4Quant
JOACHIM HAGGER
FIAT/IFTA World Conference 2016 Warsaw
4Quant
About 4Quant
In the field of big image analytics, we disrupt the way videos and images are
analyzed and interpreted by leveraging artificial intelligence and big data
analytics on vast amounts of images. This allows for significantly better utilization
and makes searching, finding anomalies, and tagging much more efficient.
Our office is located in Zurich, Switzerland. 4Quant was established as ETH/PSI
spin-off in 2015 and has a core team of 5 big imaging experts.
4Quant
Technology
By utilizing streaming Big Data analytics we can process high-resolution at
incredible fast rates using commodity hardware. We have tested our system on
high-speed camera systems producing 8GB/s of rich image data.
Scalable hardware and a flexible software platform enable algorithms beyond
the simple standard vision problems of face detection and pedestrian tracking and
allow us to use Deep Neural Networks to extract complicated information from new,
high-resolution imaging sources like 4K drone video streams.
https://en.wikipedia.org/wiki/Deep_Blue_versus_Garry_Kasparov
4Quant
Source: https://en.wikipedia.org/wiki/Watson_(computer)
4Quant
http://fortune.com/2015/10/16/how-tesla-autopilot-learns/
4Quant
https://research.facebook.com/publications/deepface-closing-the-gap-to-human-level-performance-in-face-verification/
4Quant
Example: Face Recognition with AI
● Start with random patterns and rules
● Each learning sample tweaks the rules so its prediction
matches the outcome (backpropagation)
Pixels Edges Object parts Object models
→ → →
4Quant
Demo
http://people.ee.ethz.ch/~maderk/viqae/viqae_prerendered2.html
4Quant
Region Segmentation
We can take single images or sequences
of images and classify each point into
various pretrained categories. The
following example shows road, tree,
cars, pedestrians as different colors
4Quant
Region Segmentation
These regions can then be analyzed and large deviations or unusual scenes can be
automatically searched for and identified
4Quant
Content Tagging
Beyond individual classes,
complex scenes can be
broken down into regions
described by captions.
These regions can then be
easily compared, filtered and
searched through.
4Quant
Content Tagging
We can take single images or
sequences of images and
classify each point into various
pretrained categories. The
following example shows road,
tree, cars, pedestrians as
different colors