2004.11.02 - SLIDE 1IS 202 - FALL 2004 Lecture 19: Phone Project Introduction Prof. Ray Larson & Prof. Marc Davis UC Berkeley SIMS Tuesday and Thursday

2004.11.02 - SLIDE 1IS 202 - FALL 2004

Lecture 19: Phone Project Introduction

Prof. Ray Larson & Prof. Marc Davis

UC Berkeley SIMS

Tuesday and Thursday 10:30 am - 12:00 am

Fall 2004

SIMS 202:

Information Organization

and Retrieval

2004.11.02 - SLIDE 2IS 202 - FALL 2004

Lecture Contents

• Review– Metadata and Controlled Vocabularies

• Phone Project Introduction– Project Overview– Assignment 5– Phone and MMM-2 Tutorial– GPS Demo– Discussion

• Action Items for Next Time

2004.11.02 - SLIDE 3IS 202 - FALL 2004

Lecture Contents




2004.11.02 - SLIDE 4IS 202 - FALL 2004

Metadata

• Metadata is– “Data about Data” (database systems)– Information about Information

• First used (to the best we can discover) in 1978 (meta-data)

• Used for databases in (Meta-Data Base)– “a data base which itself contains the structural and

semantic data of other data bases”» Thomas R. Cousins & Wayne D. Dominick, “The

Management of Data Bases of Data Bases” ASIS Proceedings, 1978.

2004.11.02 - SLIDE 5IS 202 - FALL 2004

Metadata

• Structures and languages for the description of information resources and their elements (components or features)

• “Metadata is information on the organization of the data, the various data domains, and the relationship between them” (Baeza-Yates p. 142)

2004.11.02 - SLIDE 6IS 202 - FALL 2004

Dublin Core Elements

• Title

• Creator

• Subject

• Description

• Publisher

• Other Contributors

• Date

• Resource Type

• Format

• Resource Identifier

• Source

• Language

• Relation

• Coverage

• Rights Management

2004.11.02 - SLIDE 7IS 202 - FALL 2004

Mega-Metadata Standards

• METS - Metadata Encoding and Transmission Standard (http://www.loc.gov/standards/mets)– Developed by the Digital Library Federation as an

implementation strategy for preservation metadata– "XML document format for encoding metadata

necessary for both management of digital library objects within a repository and exchange of such objects between repositories (or between repositories and their users)”

– Provides a flexible mechanism for encoding descriptive, administrative, and structural metadata for a digital library object, and for expressing the complex links between these various forms of metadata

2004.11.02 - SLIDE 8IS 202 - FALL 2004

Controlled Vocabularies

• Vocabulary control is the attempt to provide a standardized and consistent set of terms (such as subject headings, names, classifications, etc.) with the intent of aiding the searcher in finding information

• That is, it is an attempt to provide a consistent set of descriptions for use in (or as) metadata

2004.11.02 - SLIDE 9IS 202 - FALL 2004

Lecture Contents




2004.11.02 - SLIDE 10IS 202 - FALL 2004

Phone Project Groups

• Group 1– Andrew Fiore, Callie Jones,

Kelly Bryant, Shufei Lei, Ken Langford

• Group 2– Jen King, Helen Kim, Andrea

Nelson, Bruce Rinehart, Kelly Snow

• Group 3– Steve Chan, LuLu Guo,

Melissa Chan, Kavita Mittal, Irina Lib

• Group 4– Benjamin Hill, Tim Dennis,

Morgan Ames. Sarah Poon, Michael Wooldridge

• Group 5– David Hong, Josh Chao, Andrew

Iskander, Catherine Newman, Rupa Patel, Jen Hastings

• Group 6– Jaime Parada, Judd Antin, Scott

Fisher, Chitra Madhwacharyula, Lila Manguy, Carrie Burgerner

• Group 7– Matthew Rothenberg, Mano

Marks, Colleen Whitney, Jinghua Luo, Christine Jones, Yun Jung

• Group 8– Christina Nigro, Paul Poling,

Sarai Mitnick, David Thaw, Sarita Yardi

2004.11.02 - SLIDE 11IS 202 - FALL 2004

What is the Problem?

• Today people cannot easily find, edit, share, and reuse media

• Computers don’t understand media content– Media is opaque and data rich– We lack structured representations

• Without content representation (metadata), manipulating digital media will remain like word-processing with bitmaps

2004.11.02 - SLIDE 12IS 202 - FALL 2004

Signal-to-Symbol Problems

• Semantic Gap– Gap between low-

level signal analysis and high-level semantic descriptions

– “Vertical off-white rectangular blob on blue background” does not equal “Campanile at UC Berkeley”

2004.11.02 - SLIDE 13IS 202 - FALL 2004

Signal-to-Symbol Problems

• Sensory Gap– Gap between how an object appears and what it is– Different images of same object can appear

dissimilar– Images of different objects can appear similar

2004.11.02 - SLIDE 14IS 202 - FALL 2004

M E T A D A T AMETADATA

Traditional Media Production Chain

PRE-PRODUCTION POST-PRODUCTIONPRODUCTION DISTRIBUTION

Metadata-Centric Production Chain

2004.11.02 - SLIDE 15IS 202 - FALL 2004

The Media Metadata Opportunity

• Vastly more media will be produced• Without ways to manage it (metadata

creation and use) we lose the advantages of digital media

• Most current approaches are insufficient and perhaps misguided

• Great opportunity for innovation and invention

• Need interdisciplinary approaches to the problem

2004.11.02 - SLIDE 16IS 202 - FALL 2004

Moore’s Law for Cameras2000

Kodak DC40

Nintendo GameBoy Camera

$400

$ 40

2002

Kodak DX4900

SiPix StyleCam Blink

2004.11.02 - SLIDE 17IS 202 - FALL 2004

Capture+Processing+Interaction+Network

2004.11.02 - SLIDE 18IS 202 - FALL 2004

Camera Phones as Platform

• Media capture (images, video, audio)

• Programmable processing using open standard operating systems, programming languages, and APIs

• Wireless networking• Personal information

management functions• Rich user interaction modalities• Time, location, and user

contextual metadata

2004.11.02 - SLIDE 19IS 202 - FALL 2004

Camera Phones as Platform

• In the first half of 2003, more camera phones were sold worldwide than digital cameras

• By 2008, the average camera phone is predicted to have 5 megapixel resolution

• Last month Casio and Samsung introduced 3.2 megapixel camera phones with optical zoom and photo flash

• There are more cell phone users in China than people in the United States (300 million)

• For 90% of the world their “computer” is their cell phone

2004.11.02 - SLIDE 20IS 202 - FALL 2004

Phone Project Overview

• In this project we will be creating, sharing, and reusing mobile media and metadata

• You and your Project Group will design application use scenarios and develop and refine metadata frameworks for your photos

• We will be using the Nokia 7610 mobile media phone and software developed by Garage Cinema Research

2004.11.02 - SLIDE 21IS 202 - FALL 2004

Phone Project Overview

• In the SIMS 202 Phone Project you and your Project Group will– Experience the actual process of information

organization and retrieval (especially as regards metadata creation and use)

– Work in small, focused teams performing a variety of tasks in image acquisition, description, and application design

– Develop an ongoing resource for SIMS (an annotated photo database) that can be used for internal research and teaching, as well as for external promotional and informational purposes

2004.11.02 - SLIDE 22IS 202 - FALL 2004

Phone Project Requirements

• Create engaging and useful application scenarios and photos for use by your team and the entire class– The photos you take and the applications you will

design to use them should be interesting and useful to you and your colleagues

• Create a shared, reusable resource of annotated photos– Design your metadata such that all photos are

accessible not only for the needs of your particular application, but also for the reusability of your photos and metadata by other applications

2004.11.02 - SLIDE 23IS 202 - FALL 2004

Phone Project Assignments

DATE ASSIGNED DUE

Tuesday, November 2Cameraphone Use Scenario –

Application Idea

Thursday, November 4

Tuesday, November 9 Photo Metadata DesignCameraphone Use Scenario –

Application Idea


Tuesday, November 16 Photo Metadata Design

Thursday, November 18 Metadata Revision

Tuesday, November 23 Photo Capture and Annotation Metadata Revision


Tuesday, November 30 Project Presentations Photo Capture and Annotation

Thursday, December 2

Tuesday, December 7 Project Presentations

2004.11.02 - SLIDE 24IS 202 - FALL 2004


• Cameraphone Use Scenario – Application Idea (Assignment 5)– You will brainstorm and storyboard an

application for a mobile media device that accesses a server and facilitates the creation, sharing, and reuse of media and metadata. You will develop user personas and scenarios of how the application works and how the user experiences it. The applications you will design should be interesting and useful to you and your colleagues.

2004.11.02 - SLIDE 25IS 202 - FALL 2004


• Photo Metadata Design (Assignment 6)– Having your application and the overall

project goals in mind, you will design a suitable metadata framework to use for annotating photos such that all photos would be accessible not only for the needs of your particular application, but also for the reusability of your photos and metadata by other applications.

2004.11.02 - SLIDE 26IS 202 - FALL 2004


• Photo Metadata Revision (Assignment 7) – You will consolidate your classification

scheme with one other team to develop a revised and unified metadata framework.

2004.11.02 - SLIDE 27IS 202 - FALL 2004


• Photo Capture and Annotation (Assignment 8) – With the goals of your application and the

overall goals of the class project in mind, each group member is required to take at least 10 photos (at least 5 relevant to your application idea and at least 5 photos of any thing else you wish to photograph), upload them, and annotate them with your revised metadata framework.

2004.11.02 - SLIDE 28IS 202 - FALL 2004


• Project Presentations (Assignment 9)– In a special class session, your group will

present your application ideas, metadata frameworks, and annotated photos to your fellow students. Each group will have 10 minutes to present their innovative work.

2004.11.02 - SLIDE 29IS 202 - FALL 2004

Phone Project Context Metadata

• In order to collect the data needed for these purposes, your use of the system will be logged in a number of anonymized ways:– Location

• Your GPS location will be logged whenever you take a picture with the cameraphone and are using the Bluetooth-enabled GPS device we will provide you. Your network CellID will be logged whenever you take a picture. This information may be correlated with various other sources of information (e.g., raw location data may be correlated with a Point of Interest database) to try to refine the location information (e.g., in which building the phone was used.)

– Presence• Your phone will broadcast its Bluetooth ID and be recorded

whenever another MMM-2 phone user takes a picture within 10 meters of your phone.

2004.11.02 - SLIDE 30IS 202 - FALL 2004

Phone Project Context Metadata

– Social Networking• The phone calls you make from the phones provided to you

will be logged. (The phone conversations will not be recorded, but a log will be kept of which numbers were called when and for how long.) The sharing activities done on the MMM-2 web site will be logged to determine with whom you shared your photos.

– Annotation• The captions and annotations you make of photos on the

phone and on the web will be logged.• You can hide your automatically sensed Bluetooth presence

information at any time by turning off Bluetooth on the phone. You can hide your automatically sensed GPS location at any time by turning off the Bluetooth-enabled GPS device we will provide you.

2004.11.02 - SLIDE 31IS 202 - FALL 2004

Confidentiality

• The contextual metadata, as well as any additional information provided by you or other students will be kept by Garage Cinema Research for an indefinite time

• This may include images of you or provided by you, as well as metadata about you and your photos or provided by you

• Your name and email address will be stored separately from the identifying information for your phone

• Your name, email address, and the complete phone numbers that you call will be kept in a password-protected file accessible only by the immediate members of the research team

2004.11.02 - SLIDE 32IS 202 - FALL 2004

Confidentiality

• No information will be collected about you while the equipment is not in use

• You can choose not to use the equipment• Only pictures that you choose will be added to

the Mobile Media Metadata system database • You will have the option to remove your images

or alter the associated metadata at any time• You may withdraw from participation in this

project at any time

2004.11.02 - SLIDE 33IS 202 - FALL 2004

Opt Out Options

• Selectively turn off GPS• Selectively turn off Bluetooth• Only pictures that you choose will be

added to the Mobile Media Metadata system database

• You will have the option to remove your photos or alter the associated metadata at any time

• Opt out of Phone Project and do alternate assignments

2004.11.02 - SLIDE 34IS 202 - FALL 2004

Responsibility for Equipment

• These phones, their voice and data services, and the GPS devices have been donated to Garage Cinema Research for the IS202 Phone Project.

• You are responsible for the free Nokia 7610 and GPS Bluetooth device you will be provided. If you damage or lose them, you will be responsible for replacing them.

• You are also responsible for using the phone in accord with the service agreement. Any calls made above the supplied plan may be billed to you.

2004.11.02 - SLIDE 35IS 202 - FALL 2004

Phone Plan

• The free supplied service plan is the AT&T Wireless (Cingular) GSM America Local Plan which includes: – 700 any time minutes per month– Unlimited nights and weekends starting at 9:00 pm– 1000 mobile-to-mobile minutes per month– Free nationwide long distance

• If you plan to travel outside of the plan calling area and use your phone, please let us know in advance and we may be able to upgrade your free service plan accordingly for the duration of your travel

2004.11.02 - SLIDE 36IS 202 - FALL 2004

Lecture Contents




2004.11.02 - SLIDE 37IS 202 - FALL 2004

Assignment 5: Process

• Brainstorm application ideas• Evaluate your ideas and agree on one to pursue• Come up with a persona and scenario for your

application idea• Write a description of your application idea

involving one persona and one scenario• Draw a storyboard with explanatory text• Document the results of your brainstorming• Create your group website

2004.11.02 - SLIDE 38IS 202 - FALL 2004

Assignment 5: Deliverables

• Brief description of the application idea you selected

• Persona description

• Scenario description

• Annotated storyboard

• Work distribution table

• List all brainstorming ideas and reasons for selecting or rejecting each

2004.11.02 - SLIDE 39IS 202 - FALL 2004

Assignment 5: Turning It In

• Submit an email to [email protected] with the following information (due November 9, before class):– Group name– URL of your group website– URL to description (application, persona,

scenario), storyboard, brainstorming results, work distribution table

– Time it took you to complete the assignment– Any comments on assignment (optional)

2004.11.02 - SLIDE 40IS 202 - FALL 2004

Lecture Contents




2004.11.02 - SLIDE 41IS 202 - FALL 2004

Lecture Contents




2004.11.02 - SLIDE 42IS 202 - FALL 2004

Lecture Contents




2004.11.02 - SLIDE 43IS 202 - FALL 2004

Lecture Contents




2004.11.02 - SLIDE 44IS 202 - FALL 2004

Homework (!)

• Read – “The Semantic Web” (Berners-Lee, Hendler,

Lassila)

– “RDF Primer” (Minola and Miller)• Section 6.2 – 6.7 are optional

• Assignment 5: Cameraphone Use Scenario– Due by Tuesday, November 9, 2004

Documents

2004.11.02 - SLIDE 1IS 202 - FALL 2004 Lecture 19: Phone Project Introduction Prof. Ray Larson & Prof. Marc Davis UC Berkeley SIMS Tuesday and Thursday