16
PaperComp 2010, September 26, 2010 Interactive Paper: Past, Present and Future Beat Signer and Moira C. Norrie Department of Computer Science Vrije Universiteit Brussel http://www.beatsigner.com

Interactive Paper: Past, Present and Future

Embed Size (px)

DESCRIPTION

Presentation given at PaperComp 2010, 1st International Workshop on Paper Computing, Copenhagen, Denmark, September 2010 ABSTRACT: Over the last few years, there has been a significant increase in the number of researchers dealing with the integration of paper and digital information or services. While recent technological developments enable new forms of paper-digital integration and interaction, some of the original research on interactive paper dates back almost twenty years. We give a brief overview of the most relevant past and current interactive paper developments. Then, based on our experience in developing a wide variety of interactive paper solutions over the last decade, as well as the results of other research groups, we outline future directions and challenges for the realisation of innovative interactive paper solutions. Further, we propose the definition of common data formats and interactive paper design patterns to ensure future cross-application and framework interoperability.

Citation preview

Page 1: Interactive Paper: Past, Present and Future

PaperComp 2010, September 26, 2010

Interactive Paper: Past, Present and Future

Beat Signer and Moira C. Norrie Department of Computer Science

Vrije Universiteit Brussel

http://www.beatsigner.com

Page 2: Interactive Paper: Past, Present and Future

PaperComp 2010, September 26, 2010 Beat Signer - Vrije Universiteit Brussel - [email protected]

Paper Computing in the Past

Reading Wheel, Ramelli, 1588

Punch Cards, since ca. 1725

Electro Junior Toy

Page 3: Interactive Paper: Past, Present and Future

PaperComp 2010, September 26, 2010 Beat Signer - Vrije Universiteit Brussel - [email protected]

Paper Computing in the Past ...

DigitalDesk, Wellner, 1991 Listen Reader, Back et al., 2000

Ariel, Mackay et al., 1995 Audio Notebook, Stifelman, 1993

Page 4: Interactive Paper: Past, Present and Future

PaperComp 2010, September 26, 2010 Beat Signer - Vrije Universiteit Brussel - [email protected]

Current Approaches

Amazon Kindle Anoto Digital Pen and Paper Technology

Augmented Paper Electronic Paper

Page 5: Interactive Paper: Past, Present and Future

PaperComp 2010, September 26, 2010 Beat Signer - Vrije Universiteit Brussel - [email protected]

Interactive Paper Frameworks

Tools offered by Anoto

SDK for PC applications and network applications

Forms Design Kit (FDK)

PaperToolkit

integration of interactive and batched input handling

Letras

distributed event processing pipeline

Page 6: Interactive Paper: Past, Present and Future

PaperComp 2010, September 26, 2010 Beat Signer - Vrije Universiteit Brussel - [email protected]

Interactive Paper Frameworks

iPaper

information-centric approach supports different

technologies, functionalities and applications

separation of authoring and programming

rapid prototyping (active components)

Livescribe's Smartpen SDK

application sharing and the user as a developer

...

Page 7: Interactive Paper: Past, Present and Future

PaperComp 2010, September 26, 2010 Beat Signer - Vrije Universiteit Brussel - [email protected]

Future Challenges and Directions

Future challenges for augmented and interactive

paper solutions include

software framework interoperability and scalability

automatic application deployment

hardware and material sciences

visual and interaction design

cross-media information management

deeper understanding of existing work practices

Page 8: Interactive Paper: Past, Present and Future

PaperComp 2010, September 26, 2010 Beat Signer - Vrije Universiteit Brussel - [email protected]

Input Device Independence

iPaper, Paper++ Project, 2001 iPaper, Paper++ Project, 2003

iPaper, EdFest Project, 2005 iPaper, The Lost Cosmonaut Project, 2004

Page 9: Interactive Paper: Past, Present and Future

PaperComp 2010, September 26, 2010 Beat Signer - Vrije Universiteit Brussel - [email protected]

Input Device Independence ...

Bähr et al., PaperComp 2010 Bonnard et al., PaperComp 2010

Portocarrero et al., PaperComp 2010 Suzuki et al., PaperComp 2010

Page 10: Interactive Paper: Past, Present and Future

PaperComp 2010, September 26, 2010 Beat Signer - Vrije Universiteit Brussel - [email protected]

Digital Ink Abstraction

Most frameworks and toolkits define their own

proprietary digital ink representation

existing standards (e.g. InkML) are often not used

is there a need for new common data formats?

Common data formats can help to

exchange data between applications and across

different interactive paper frameworks

realise mixed-media environments

Page 11: Interactive Paper: Past, Present and Future

PaperComp 2010, September 26, 2010 Beat Signer - Vrije Universiteit Brussel - [email protected]

Scalability and Application Deployment

Problem of existing augmented paper solutions

isolated applications

missing cross-application interaction

Interactive Paper 2.0

global and open architecture

unique resolving of interactive paper services based

on a global paper lookup service (PLS)

- automatic application deployment

service oriented architecture to enable cross-

application interaction and composition

Page 12: Interactive Paper: Past, Present and Future

PaperComp 2010, September 26, 2010 Beat Signer - Vrije Universiteit Brussel - [email protected]

Visual and Interaction Design

Visualisation of interactive

areas and functionality

• design patterns

Interaction design

• online versus offline

input processing

• lack of modal dialogues

• multimodal interaction

EdFest Project, 2004

EdFest Project, 2005

Findings might be applicable to traditional GUIs

e.g. cross-application widget interaction

Page 13: Interactive Paper: Past, Present and Future

PaperComp 2010, September 26, 2010 Beat Signer - Vrije Universiteit Brussel - [email protected]

Innovative Hardware and Materials

Mobile solutions for feed-

back on paper documents

• spatially aware pro-

jection of information

• digital pen with display

• voice feedback

• ...

Fusion of electronic paper

and interactive paper

• printed electronics

MouseLight, Song et al., 2010

PaperWorks Project, 2007

Page 14: Interactive Paper: Past, Present and Future

PaperComp 2010, September 26, 2010 Beat Signer - Vrije Universiteit Brussel - [email protected]

Paper-Digital Authoring and Publishing

Manual authoring

Content-driven publishing

• e.g. EdFest brochure

• integration with third-

party applications

• what about versioning?

Automatic link authoring

• e.g. Print-n-Link

Collaborative authoring

iPaper Manual Authoring Tool

Print-n-Link, 2006

Page 15: Interactive Paper: Past, Present and Future

PaperComp 2010, September 26, 2010 Beat Signer - Vrije Universiteit Brussel - [email protected]

Conclusions

Various approaches for interactive paper and

paper computing

are we missing a common abstraction layer in existing

architectures and do we need Interactive Paper 2.0?

It might be the right time to think about the

integration of existing solutions to share efforts

cross-disciplinary workshops

- e.g. CoPADD and PaperComp

Network of Excellence (NoE)?

Page 16: Interactive Paper: Past, Present and Future

PaperComp 2010, September 26, 2010 Beat Signer - Vrije Universiteit Brussel - [email protected]

Further Information

Fundamental Concepts for Interactive Paper

and Cross-Media Information Spaces, Beat

Signer, ISBN 978-3-8370-2713-6, May 2008

Interactive Paper: Past, Present and Future

http://vub.academia.edu/BeatSigner/Papers/216727/Intera

ctive_Paper_Past_Present_and_Future

Research papers about iPaper are available on

http://vub.academia.edu/BeatSigner

Presentation available on

http://www.slideshare.net/signer/