PowerPoint Presentation
Bird Game App
Egidio Caprino
Filippo Del Frari
Carlo Mariangeli
Ermanno Moser
Nicola Perantoni
Gloria Zen
Trento, December 3rd, 2011
Project Page: http://code.google.com/p/happybirds
Migration Birds Assessment
one of the world's prime outposts for observing the spring
migration of birds
issue: project (lead by World Bank) of building a channel to
bring water from the Red Sea to the Dead Sea on bird migration
environmentalists accuses this would affect migration
phenomenon
proof supporting this claim is needed!over 500 million birds
cross Israel's airspace, heading south to warming weather in
Africa.
Every autumn, million of birds migrate toward Southern warm
areas of the world.
Human activities and climate/landscape changes are affecting
this natural phenomenon
Goal = to identify the routes and the species that are in
danger.
Case study: Israel
/
Bird Game App
Exploit crowdsourcing to collect information data on the flocks'
migratory phenomenon
Collection of image data with time + GPS location of Flocks of
Birds
Information about bird species + number of individuals can be
automatically extracted from image.
Information about routes can be reconstructed/inferred from
time+GPS discrete data.
Solution
Challenge
To build a funny + easy-to-use web game application to involve
as many users as possible
Extract significant data
/
Solution flowchart
Data uploading- image- GPS×tamp- user id- (user's
label)
SERVERImage processingdata+GPS+Time processing
Data Analysis
users' scores
= ?
= ?
birds/flocks data
image processing
users labeling
Estimation of- migration routes- birds population statistics
unlabeled images
/
Involving users
How to access to new users
Marketing our application within birdwatchers' community
Position information signs in strategic birdwatching
hotspots
Marketing the initiative within local environmental associations
(wwf, national parks, etc.)
Extend application to users with Smartphone + GPS camera
How to involve users
To build a geographical-time map for migrating birds that is a
reference for the community.
Users are allowed to look through images and data on this map
(e.g.)
Create a score system where user gets new points for each new
image loaded or labeled
Send reminders (e.g. from year to year) to users who already
participated and return in the areas of interest.
/
Smartphone
Download application
Users can download the Bird Game APP from Android Market or
Apple's App Store for free.
Register to service
with a simple registration form, user obtains a unique
identifier
Upload data (images & info)
user takes a photo of a bird and uploads it on the server. Photo
contains info about:- GPS position- timestamp- (eventually) user's
tag or comment
Interact with Server database
User can look through data on the server.Images are geo-tagged
so they can be found directly on Google Maps or OpenStreetMap.Users
can add new tags/labels to data.
/
Smartphone
Download application
Users can download the Bird Game APP from Android Market or
Apple's App Store for free.
Register to service
with a simple registration form, user obtains a unique
identifier
Upload data (images & info)
user takes a photo of a bird and uploads it on the server. Photo
contains info about:- GPS position- timestamp- (eventually) user's
tag or comment
Interact with Server database
User can look through data on the server.Images are geo-tagged
so they can be found directly on Google Maps or OpenStreetMap.Users
can add new tags/labels to data.
/
Smartphone
User can look through the data on the server
Query example:
show me pictures uploaded by user_id in the area around
GPS_coordinate position
User input example:
This bird sighted at this GPS_coordinate position is a
swallow
= ?
/
`Not only from Android, images with GPS position can be uploaded
from the website!
Image Analysis
What can we infer (automatically or semi-automatically) from
images?
/
Image Analysis
Flock's Cardinality = 8 individuals
Bird shape
Flock's V-Formation
What can we infer from Long-distance images?
Bird Species = ?
How can we infer this automatically?( opencv.willowgarage.com
image processing library )
Thres-holding
Blob detection
original image
binary image
results (birds localization)
/
Image Analysis
Easy cases
Challenges
well defined silhouettes
homogeneous background
overlapping
low contrast
heterogeneous background
(swallow flock)
/
Image Analysis
What can we infer from Short-distance images?
= ?
Info about sighted Species
where/when different species stops by
= ?
/
Mining data
/
Estimation of species migration routes
Estimation of risk species
1 5 10 15 20 25 30
Birds Hotspots
1 5 10 15 20 25 30
1 5 10 15 20 25 30
Example of data:storks sighting in the month of October
Conclusions
/
We developed a system to monitor birds migration phenomenon
We want to exploit crowdsourcing. Target users are
birdwatchers.
Through this system we want to create an open map migratory
birds, containing information about the presence of which bird
species + in which period of the year.
We show our demo implemented on a platform Android....
Solutions available at:
http://www.rhok.org/node/20752
http://code.google.com/p/happybirds/
