TriDim Lawsuit Over Cover Flow

8/9/2019 TriDim Lawsuit Over Cover Flow

http://slidepdf.com/reader/full/tridim-lawsuit-over-cover-flow 1/49

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

Steven T. Lowe, Esq. SBN [email protected] LeFan, Esq., SBN [email protected] & ASSOCIATES, P.C.11400 Olympic Blvd., Suite 640Los Angeles, CA 90064

Telephone: (310) 477-5811Facsimile: (310) 477-7672

Hao Ni ( pro hac vice to be submitted)[email protected] Wang ( pro hac vice to be submitted)[email protected] Neal Massand ( pro hac vice to be submitted)[email protected] NI, WANG & MASSAND, PLLC8140 Walnut Hill Lane, Suite 310Dallas, TX 75231Telephone: (972) 331-4600Facsimile: (972) 314-0900

Attorneys for Plainti ffTriDim I nnovations, LLC

IN THE UNITED STATES DISTRICT COURTFOR THE NORTHERN DISTRICT OF CALIFORNIA

TriDim Innovations, LLC,

Plaintiff,

v.

Apple, Inc.

Defendant.

Case No.

COMPLAINT FOR PATENTINFRINGMENT

JURY TRIAL DEMANDED

Case5:15-cv-00280-NC Document1 Filed01/20/15 Page1 of 8



1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

-2-

Plaintiff TriDim Innovations, LLC (“TriDim” or “Plaintiff ”) files this Complaint for

patent infringement against Defendant Apple Inc. (“Apple” or “Defendant”) alleging as follows:

PARTIES

1. Plaintiff TriDim is a Virginia limited liability company having a principal place of

business at 5105 Claybank Lane, Centerville, VA 20120.

2. On information and belief, Defendant Apple is a corporation organized and

existing under the laws of the State of California, with its principal place of business located at 1

Infinite Loop, Cupertino, CA 95014. On information and belief, Apple may be served via its

registered agent, CT Corporation System, 818 West Seventh St., 2nd Floor, Los Angeles, CA

90017.

JURISDICTION AND VENUE

3. This action arises under the patent laws of the United States, Title 35 of the United

States Code. This Court has subject matter jurisdiction pursuant to 28 U.S.C. §§ 1331 and

1338(a).

4. Venue is proper in this district under 28 U.S.C. §§ 1391(c) and 1400(b). On

information and belief, Apple has transacted business in this district, and has committed acts of

patent infringement in this district.

5. On information and belief, Apple is subject to this Court’s specific and genera

personal jurisdiction pursuant to due process and/or the California Long Arm Statute, due at leas

to its substantial business in this forum, including: (i) at least a portion of the infringements

alleged herein; and (ii) regularly doing or soliciting business, engaging in other persistent courses

of conduct, and/or deriving substantial revenue from goods and services provided to individuals

in California and in this Judicial District.




1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

-3-

COUNT I

INFRINGEMENT OF U.S. PATENT NO. 5,838,326

6.

TriDim is the owner by assignment of United States Patent No. 5,838,326 (“the

’326 Patent”) entitled “System for Moving Document Objects in a 3-D Workspace.” The ’326

Patent issued on November 17, 1998. A true and correct copy of the ’326 Patent is attached as

Exhibit A.

7. Upon information and belief, Apple has been and is now infringing the ’326 Patent

in the State of California, in this judicial district, and elsewhere in the United States, by, among

other things, directly or through intermediaries, making, using, importing, providing, supplying

distributing, selling, and/or offering for sale products that infringe one or more claims of the ’326

Patent. Apple products that infringe one or more claims of the ’326 Patent include, but are not

limited to, Apple’s products that (1) use the iOS7 and iOS8 operating systems and include the

Safari browser, (2) incorporate the “Cover Flow” user interface, and (3) include “Time Machine.”

Apple is directly infringing, literally infringing, and/or infringing the ’326 Patent under the

doctrine of equivalents. Apple is thus liable for infringement of the ’326 Patent pursuant to 35

U.S.C. § 271.

8. As a result of Apple’s infringement of the ’326 Patent, TriDim has suffered

monetary damages and is entitled to a money judgment in an amount adequate to compensate for

Apple’s infringement, but in no event less than a reasonable royalty for the use made of the

invention by Apple, together with interest and costs as fixed by the court,

and TriDim wil

continue to suffer damages in the future unless Apple’s infringing activities are enjoined by this

Court.




1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

-4-

9. Apple has induced and continues to induce infringement of the ’326 Patent by

intending that others uses, offer for sale, or sell in the United States, products and/or methods

covered by one or more claims of the ’326 Patent, including, but not limited to , Apple’s products

that (1) use the iOS7 and iOS8 operating systems and include the Safari browser, (2) incorporate

the “Cover Flow” user interface, and (3) include “Time Machine.” Apple provides these products

to others, such as customers, resellers and end-use consumers, who, in turn, use, offer for sale, or

sell in the United States Apple’s products that infringe one or more claims of the ’326 Patent.

10. Apple indirectly infringes the ’326 Patent by inducing infringement by others,

such as resellers, customers and end-use consumers, in accordance with 35 U.S.C. § 271(b) in this

District and elsewhere in the United States. Direct infringement is a result of the activities

performed by the resellers, customers and end-use consumers of Apple’s products that infringe

one or more claims of the ‘326 Patent.

11. Apple has known of the ’326 Patent at least as early as December 17, 2009 , when

Apple disclosed the ’326 Patent in an Information Disclosure Statement during the prosecution of

U.S. Patent No. 7,705,858. In fact, the ’326 Patent has been referenced as prior art in 23 patents

that were issued to Apple and relate to Apple’s “Cover Flow” user interface, including U.S

Patent Nos. 8,584,543; 8,587,528; and 8,736,557.

12. Apple additionally received notice of the ’326 Patent at least as of the date this

lawsuit was filed.

13. Apple’s affirmative acts of selling products that infringe one or more claims of the

‘326 Patent, causing such products to be manufactured and distributed, and providing instructions

for using such products, induce Apple’s resellers, customers and end-use consumers to use such

products in their normal and customary way to infringe one or more claims of the ’326 Patent.

Apple performs the acts that constituted infringement, and induce actual infringement, with the




1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

-5-

knowledge of the ’326 Patent and with the knowledge or willful blindness that the induced acts

constitute infringement.

14. Apple specifically intends for others, such as resellers, customers, and end-use

consumers, to directly infringe one or more claims of the ’326 Patent, or, alternativel y, has been

willfully blind to the possibility that its inducing acts would cause infringement. By way of

example, and not as a limitation, Apple induces such infringement by its affirmative action by,

among other things: (a) providing advertising on the benefits of using products that infringe one

or more claims of the ’326 Patent, including in marketing of the “Cover Flow” user interface, the

Safari browser and “Time Machine”; (b) providing instructions on how to use the “Cover Flow”

user interface, the Safari Browser, and “Time Machine” in Apple’s products; and (c) providing

hardware and software components required by the claims of the ’326 Patent.

15. Accordingly, a reasonable inference is that Apple specifically intends for others,

such as resellers, customers and end-use consumers, to directly infringe one or more claims of the

’326 Patent in the United States because Apple has knowledge of the ’326 Patent at least as of the

date this lawsuit was filed, or December 17, 2009, and Apple actually induces others, such as

resellers, customers and end-use consumers, to directly infringe the ’326 Patent by using, selling,

and/or distributing, within the United States, products that infringe one or more claims of the ’326

Patent.

16. As a result of Apple’s acts of inf ringement, TriDim has suffered and will continue

to suffer damages in an amount to be proved at trial.

COUNT II

INFRINGEMENT OF U.S. PATENT NO. 5,847,709

17. TriDim is the owner by assignment of United States Patent No. 5,847,709 (“the

’709 Patent”) entitled “3-D Document Workspace with Focus, Immediate and Tertiary Spaces .”




1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

-6-

The ’709 Patent issued on December 8, 1998. A true and correct copy of the ’709 Patent is

attached as Exhibit B.

18. Upon information and belief, Apple has been and is now infringing the ’709 Paten

in the State of California, in this judicial district, and elsewhere in the United States, by, among

other things, directly or through intermediaries, making, using, importing, providing, supplying

distributing, selling, and/or offering for sale products that infringe one or more claims of the ’709

Patent. Apple products that infringe one or more claims of the ’709 Patent include, but are not

limited to, Apple’s products that (1) use the iOS7 and iOS8 operating systems and include the

Safari browser, (2) incorporate the “Cover Flow” user interface, and (3) include “Time Machine.”

Apple is directly infringing, literally infringing, and/or infringing the ’709 Patent under the

doctrine of equivalents. Apple is thus liable for infringement of the ’709 Patent pursuant to 35

U.S.C. § 271.

19. Apple has known of the ’709 Patent at least as early as August 4, 2014 when

Apple disclosed the ’709 Patent in an Information Disclosure Statement during the prosecution of

U.S. Patent No. 8,893,046, which relates to Apple’s products. Additionally, Apple disclosed the

’709 Patent on August 5, 2014 in an Information Disclosure Statement during the prosecution of

U.S. Patent No. 8,910,072, which relates to Apple’s Safari products.

20. Apple additionally received notice of the ’709 Patent at least as of the date this

lawsuit was filed.

21. As a result of Apple’s acts of infringement, TriDim has suffered and will continue

to suffer damages in an amount to be proved at trial.

PRAYER FOR RELIEF

WHEREFORE, TriDim respectfully requests that this Court enter judgment in its favor and grant

the following relief:




1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

-7-

1. A judgment in favor of TriDim that Apple has infringed the ’326, and ’709

Patents;

2. A permanent injunction enjoining Apple and its officers, directors, agents servants

affiliates, employees, divisions, branches, subsidiaries, parents, and all others acting in

active

concert therewith from infringement of the ’326 and ’709 Patents, or such other equitable relief

the Court determines is warranted;

3. A judgment and order requiring Apple pay to TriDim its damages, costs, expenses

and prejudgment and post-judgment interest for Apple’s infringement of the ’326 and ’709

Patents as provided under 35 U.S.C. § 284, and an accounting of ongoing post-judgment

infringement;

4. Any and all other relief, at law or equity, to which TriDim may show itself to be

entitled.

DEMAND FOR JURY TRIAL

TriDim, under Rule 38 of the Federal Rules of Civil Procedure, requests a trial by jury of

any issues so triable by right.

DATED: January _ 20 _, 2015 /s/ Kris Le Fan Steven T. Lowe, Esq. SBN [email protected] LeFan, Esq., SBN [email protected] & ASSOCIATES, P.C.11400 Olympic Blvd., Suite 640Los Angeles, CA 90064Telephone: (310) 477-5811

Facsimile: (310) 477-7672

Hao Ni ( pro hac vice to be submitted)[email protected] Wang ( pro hac vice to be submitted)[email protected] Neal Massand ( pro hac vice to be submitted)[email protected] NI, WANG & MASSAND, PLLC8140 Walnut Hill Lane, Suite 310Dallas, TX 75231




1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

-8-

Telephone: (972) 331-4600Facsimile: (972) 314-0900

Attorneys for TriDimTriDim I nnovations, LLC




Exhibit A

Case5:15-cv-00280-NC Document1-1 Filed01/20/15 Page1 of 20



USOO5838326A

Ulllted States

Patent

[ 1 9 ] [ 1 1 ] P a t e n t N u m b e r : 5 , 8 3 8 , 3 2 6

Card e t a l . [ 4 5 ] Date o f

P a t e n t : N o v . 1 7 ,

1 9 9 8

[ 5 4 ]

SYSTEM FOR MOVING

DOCUMENT 5 , 5 5 5 , 3 5 4 9 / 1 9 9 6

S t r a s n i c k e t a l .

. . . . . . . . . . . . . . . . .

. .

345/355

X

OBJECTS

IN

A

- 1 ) WORKSPACE

5 , 6 0 2 , 5 6 4

2 / 1 9 9 7 I w a m u r a e t 2 1 1 .

5,608,850

3/1997

Robertson

. . . . . .. .

[75] Inventors:

Stuar t

K. Card, Los l t o s

H i l l s ;

gaglgtet a 1 ~ t ~ ~ ~ 1

~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~

, , 0 e r

son

e a

. . . . . . . . . . . . . . . . . .

‘gogk’lgse?ézi

both of 5,678,015

10/1997 Goh

. . . . . . . . . . . . . . . . . . . ..

345/355

g ’ 5,689,628 11/1997

Robertson

. . . . . . . . . . . . . . . . . . . . . . . . . .

345/355

X

R e d m o n d , W a s h .

P r i m a r y

Examiner—John

E .

B r e e n e

[ 7 3 ]

A s s i g n e e : X E I ‘ O X C o r p o r a t i o n , S t a m f o r d ,

C O I l I l . A t t o r n e y )

A g e n t ) o r F i r m — R i C h a r d

B _

Domingo

[ 2 1 ] A p p l . N o . : 7 2 1 , 3 0 2 [ 5 7 ]

ABSTRACT

_ A h r e e dimensional

document

Workspace f o r i n t e r a c t i n g

22 Fld. S

.26

1996

[ 1

1

6 e p ’

W i t h l a r g e numbers o f

document o b j e c t s . Adocument o b j e c t

[ 5 1 ]

I n t .

C l . 6

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

. . G06F

/00 may e

a

document

o r a

document

c o l l e c t i o n .

The document

[ 5 2 ] US. C l . , , , , , , , , , , _ _ 3 4 5 / 3 5 5 ; 3 4 5 / 3 5 8 ; 3 4 5 / 3 5 1 Workspace i s d i v i d e d h i e r a r c h i c a l l y i n t e r m s o f

i n t e r a c t i o n

[ 5 8 ]

Field of Search

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 345/326—358,

r a t e s ~ A

ocus Space

i s Where d i r e c t


With

a

3 4 5 / 9 7 6 ; 7 0 7 / 5 2 0 ,

5 1 4 ,

500

document

o r

document

c o l l e c t i o n

o c c u r s .

An immediate

m e m o r y

s p a c e i s

f o r p l a c i n g pages

o r

books t h a t a r e i n u s e ,

[ 5 6 ]

R e f e r e n c e s C i t e d

b u t n o t c u r r e n t l y

b e i n g i n t e r a c t e d

W i t h . A

e r t i a r y s p a c e i s

Where

many books and pages

t h a t

a r e

n o t

i n

u s e , b u t which

US'

PATENT DOCUMENTS

i t

i s

d e s i r a b l e t o

h a v e

r e a d y a c c e s s t o .

Moving

document

5 , 0 6 0 , 1 3 5

1 0 / 1 9 91 L e v i n e . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3 4 5 / 3 5 1 O b j e c t s

i n t h e

document Workspace i s

f a c i l i t a t e d

b y

t o u c h

5 , 2 9 5 , 2 4 3 3 / 1 9 9 4 R o b e r t s o n

e t a ] ,

3 4 5 / 3 5 5 d r o p a n d ? i c k

g e s t u r e s .

The

t o u c h - d r o p

g e s t u r e a d d r e s s e s

5 , 3 4 7 , 2 9 5

9 / 1 9 9 4

A g u l n i c k

e t

a l . 3 4 5 / 3 5 8

t h e

p r o b l e m

o f

o b s c u r i n g d i s t a n t ( h e n c e s m a l l e r ) d o c u m e n t

5 , 3 5 9 , 7 0 3 1 0 / 1 9 9 4 R o b e r t s o n e t

a 1

3 4 5 / 3 5 5

X

o b j e c t s by p r e s e n t i n g

a

v i s u a l l i n e i n d i c a t i n g

a

d e s t i n a t i o n

5 , 3 8 1 , 1 5 8 1 / 1 9 95 T a k a h a f a e t a 1 ~ 3 4 5 / 3 5 5 X

f o r a

m o v e d document o b j e c t . F l i c k

g e s t u r e s a r e used

t o

5 , 3 8 6 , 5 0 7 1 / 1 9 9 5

T e l g e t

a l ' 3 4 5 / 3 5 5 X quickly move ocument o b j e c t s Within

t h e

document Work

5 ’ 4 5 2 ’ 4 1 4

9 / 1 9 9 5 R o s e n f l a h l e t a 1 ‘ 3 4 5 / 3 5 5

X

s p a c e . A s e r

may

c h a n g e t h e i r vieW o f t h e

document

5,463,722 10/ 1995

Venolia

. . . . . . . . . . . . 345/355X k

d

d.ff f

h

k

574997330 3/1996

Lucas

e t a 1 ‘ 345/355

X

Wor

space

in or e r ~ t o

view

1

erent

portions 0 t

e Wor

5 , 5 0 0 , 9 3 5

3 / 1 9 9 6

Moran e t a 1 . 3 4 5 / 3 5 8 X Space

1 “

more

d e t a l l

5 , 5 0 9 , 1 1 4

4 / 1 9 9 6

Moran

e t

a l .

3 4 5 / 3 5 8

X

5 , 5 4 6 , 5 2 9

8 / 1 9 9 6 Bowers

e t

a l . . . . . . . . . . . . . . . . . . . . . . . 3 4 5 / 3 5 5

X

16 Claims, 11 Drawing Sheets

I

Tier Dbfz?rnént' I 1

“ A i r ‘ ’

2 0 6

[ 3 2 5 5 2 2 5 2 C o l l e c t i o n

2 0 3

\4

\d:

I l I

[ ' “ m - “ ' 3 5 3 5 1 5 1 5 6 1 : : : : : : : § § ; u ‘ n ; ; r [

:

C o l l e c t l o n

/—

b j e c t

:

“ e r

:

l : 2 0 5 I

I 2 0 5 C 2 0 5 b

D o c u m e n t\0 5 a

I

B o o k c a s e l O b j e c t

~

: :

2 2 0 i g ;

i

' z l l e é

I

i r --------------------------------------

- l ’

=

I

D o c u m e n t -

I

I

C o l l e c t i o n

l g g ? g g t g g

2 0 4 b D o c u m e n t :

O b j e c t 2043

I

2 0 1 l -

\

D e § l ' <

2 0 2




U.S. Patent N O V .

1 7 1 9 9 8

S h e e t 1

f

1 1

5 838 326

I N T E R N A L NETWORK

P R O § § 2 S S O R M E M O R Y C O N N E C T I O N

1 0 3

1 0 8

M

V

\

V

BUS 1 0 1

V V V W

CURSOR

K E Y B O A R D E S § B F § § G A E L

C O N T R O L

D I S P L A Y







U.S.

Patent

N o v . 1 7 1 9 9 8 S h e e t 3 0 f

1 1 5 838 326

a g e

2

f

\ g

2 2

e c e i v e

2 0 2 ?

a g e

2 3

P

2 4

k

\ \

i

I \ / / / / / .




U.S.

Patent

N o v .

1 7 1 9 9 8

S h e e t 4

f

1 1

5 838 326

\

\

g 5

/ / /






U.S.

Patent

N o v . 1 7 1 9 9 8 S h e e t

6 0 f

1 1

5 838 326

a ]

J l L

D o c u m e n t

O b j e c t

2 2

o o k c a s e




U.S.

Patent

N o v .

1 7 1 9 9 8

S h e e t 7

f

1 1

5 838 326

E 1

\

k

\

F I G




N o v .

1 7

1 9 9 8

S h e e t

8 0 f

1 1

. S . P a t e n t

5 8 3 8 3 2 6

E




U.S.

Patent

N o v . 1 7 1 9 9 8 S h e e t 9

f

1 1

5 838 326

5 1 ]

////

l

I L

_ _ _ _ _ _ _ _ _ : ‘

\\

F I G




U.S.

Patent N o v .

1 7 1 9 9 8 S h e e t

1 0 f

1 1

5 838 326

F I G




U.S.

Patent

N o v .

1 7 1 9 9 8

S h e e t 1 1

f

1 1

5 838 326

1 0 0 1

F I G . 1 0

1 1 0 1

\1102

2\_

1 2 K

1 2 0 2




5 , 8 3 8 , 3 2 6

1

SYSTEM

FOR MOVING

DOCUMENT

OBJECTS IN -D WORKSP CE

CROSS

REFERENCE

TO REL TED

PPLIC TION

T h e p r e s e n t a p p l i c a t i o n i s r e l a t e d t o

c o - p e n d i n g

US.

p a t e n t

a p p l i c a t i o n

S e r .

N o .

0 8 / 7 2 1 , 2 9 3 ,

e n t i t l e d “3D Docu

m e n t W o r k s p a c e W i t h

F o c u s ,

D e s kt o p , a n d B o o k c a s e

s p a c e s ” ? l e d

c o n c u r r e n t l y W i t h t h e p r e s e n t a p p l i c a t i o n .

FIELD

OF THE INVENTION

The

p r e s en t i n v e n t i o n i s

r e l a t e d

t o

t h e

? e l d

o f c o m p u t e r

u s e r i n t e r f a c e s , and i n p a r t i c u l a r , a u s e r

i n t e r f a c e

f o r d i s

p l a y i n g a n d

n a v i g a t i n g

t h r o u g h c o l l e c t i o n s o f r e l a t e d

d o c u

ments.

B CKGROUND

Access t o and u s e o f e l e c t r o n i c documents

i s

groWing a t

a

v e r y

e x p l o s i v e

p a c e .

To

f a c i l i t a t e

u s e

o f l a r g e c o l l e c t i o n s

o f

e l e c t r o n i c

d o c u m e n t s ,

neW t e c h n i q u e s f o r

q u e r y i n g a n d

v i s u a l i Z i n g

t h e

c o n t e n t o f s u c h

c o l l e c t i o n s

a r e b e i n g d e v e l

o p e d .

F o r

e x a m p l e , US. P a t .

N o .

5 ,

5 4 6 , 5 2 9

d e s c r i b e s a

t e c h n i q u e

f o r v i e W i n g t h e r e s u l t s

o f

a d a t a b a s e s e a r c h t h a t

h a s been m a ppe d

t o

a t r e e

s t r u c t u r e .

T h e t r e e s t r u c t u r e i s

v i s u a l l y

mapped a l o n g

a

s t a t i c r e f e r e n c e s u r f a c e

h a v i n g

s e p a r a t e

d e t a i l

and c o n t e x t

a r e a s .

One s o u r c e

o f

t h e groWth

o f a c c e s s t o e l e c t r o n i c

docu

m e n t s

i s

t h e I n t e r n e t , a n d i n p a r t i c u l a r , t h e f a c e t

o f

t h e

I n t e r n e t kn o Wn a s t h e

World-Wide-Web

r e f e r r e d t o

s i m p l y

a s t h e Web). The W e b

p r o v i d e s

a means f o r

making

m u l t i

media s t y l e d

documents

o v e r t h e I n t e r n e t . These documents

a r e

t e r m e d

We b

p a g e s

h e r e i n a f t e r

p a g e s ) .

P a g e s may

r e f e r

t o

and

p r o v i d e a c c e s s t o o t h e r

pages

on

t h e W eb.

Each page

has a s s o c i a t e d With i t an i d e n t i ? e r

termed

a

Un ifo rm

R e s o u r c e L o c a t o r U R L ) .

a g e

i s

a c c e s s e d

b y s p e c i f y i n g

i t ’ s URL. The c o n t e n t s

o f

a page i s s p e c i ? e d i n a document

f o r m a t t i n g

l a n g u a g e knoWn a s t h e H y p e r - T e x t Mark-Up

Language HTML).

e f e r e n c e t o a n o t h e r p a g e

on

t h e W e b

i s termed a l i n k . Links m a y b e s p e c i ? e d i n

e i t h e r

a b s o l u t e o r

r e l a t i v e t e r m s . Alink s p e c i ? e d i n

a b s o l u t e

t e r m s r e f e r s

t o

i t ’ s

e n t i r e URL.

i n k

speci?ed i n r e l a t i v e t e r m s assumes a

c e r t a i n p o r t i o n

o f

t h e

URL s

t h e same

a s

t h e

e x i s t i n g p a g e .

The

s p e c i ? c a t i o n i s t h u s

r e l a t i v e

t o

t h e URL f

t h e

page on

Which t i s

d e ? n e d .

T o access a n d vi eW a d o c u m e n t o n

t h e W eb,

a

Web

b r o W s e r i s

n e e d e d .

Web

r o W s e r

p r o v i d e s

s e a r c h ,

t r a v e r s a l

and vieWing

f u n c t i o n s

needed

t o a c c e s s

documents on t h e

Web. V a r i o u s

W e b

b r o W s e r s

e x i s t

f o r t h e

Web,

. g . N e t S c a p e

a v a i l a b l e

f r o m N e t S c a p e , I n c . o f M o u n t a i n V i e W , C a l i f o r n i a .

T r a v e r s i n g

t h r o u g h d o c u m e n t s

c o n t a i n e d

on t h e W e b i s

s i m i l a r t o f o l l o W i n g a p a t h

t h r o u g h

a n e t W o r k . S i n c e e a c h

p a g e m a y c o n t a i n l i n k s t o ma ny o t h e r p a g e s ,

t r a v e r s i n g

t h r o u g h t h e p a g e s i s a s i m p l e

m a t t e r

o f f o l l o W i n g t h e l i n k s .

Most We b b r o W s e r s p r o v i d e

c o n t r o l s f o r

g o i n g

b a c k W a r d s

a n d

f o r W a r d s i n t h e l i s t o f

l i n k s .

They

a l s o

m a i n t a i n

a h i s t o r y

l i s t o f t h e

l i n k s

t o e n a b l e

jumping

d i r e c t l y t o a s p e c i ? c

p r e v i o u s l y v i e W e d

p a g e .

M o s t p u b l i c l y

a v a i l a b l e

Web

roWsers

o p e r a t e

on a

com

p u t e r

c o n t r o l l e d d i s p l a y

s y s t e m h a v i n g a g r a p h i c a l u s e r

i n t e r f a c e

W i t h

m u l t i p l e

W i n d o W s .

T y p i c a l l y ,

s u c h Web

b r o W s e r s

o p e r a t e

s u c h

t h a t

a

W i n d o W

ma y d i s p l a y

o n l y o n e

p a g e

a t

a

t i m e .

M u l t i p l e

p a g e s a r e vieWed by o p e n i n g

10

1 5

25

35

45

55

2

p r o v i d e

r e n d e r i n g m e a n s f o r v i e W i n g a u d i o , v i d e o a n d

g r a p h i c a l p o r t i o n s o f

documents

a s

W e l l

a s a g r a p h i c a l u s e r

i n t e r f a c e f o r c o n t r o l l i n g

a c c e s s

t o d o c u m e n t s . The

g r a p h i c a l

u s e r

i n t e r f a c e i s t y p i c a l l y o n e

Which p r o v i d e s f o r v er t i c a l

a n d

h o r i Z o n t a l

s c r o l l i n g

v i a s c r o l l b a r s

a n d

p o i n t

a n d

c l i c k

manipulation

o f

a

c u r s o r

c o n t r o l

d e v i c e

t o

invoke broW ser

o p e r a t i o n s eg t o t r a v e r s e l i n k s .

C o l o r , u n d e r l i n i n g o r

r e v e r s e

v i d e o a r e t e c h n i q u e s

used

t o

i n d i c a t e t h e e x i s t e n c e o f

a link

on

a

page.

R e l a t e d m a t e r i a l s i n c l u d e :

D e c k s c a p e :

A n

E x p e r i m e n t a l Web B r o w s e r ,

Marc H .

Bro Wn

a n d R o b e r t

A . S h i l l n e r , DEC

S y s t e m s

R e s e a r c h

C e n t e r

R e p o r t 1 3 5 a , M a r .

1 ,

1 9 9 5 . T h e D e c k S c a p e Web

broWser

u t i l i Z e s

t h e

metaphor o f a deck

a s

a

c o l l e c t i o n

o f

Web

a g e s . Only

one Web

page o n

a

deck

i s v i s i b l e a t one

t i m e , a l t h o u g h

m u l t i p l e d e c k s may b e v i s i b l e .

D e c k S c a p e

i s

a l s o m u l t i - t h r e a d e d s o t h a t e a c h deck

m a y

be

“ a c t i v e ” ,

e . g .

doWnloading a g e s , a t

t h e

same t i m e .

A d e c k

m a y

b e c r e a t e d

based

o n

a t r a v e r s a l through

t h e Web r

a s

t h e r e s u l t

of an

o p e r a t i o n

s u c h

a s

“ e x p a n d a l l

t h e l i n k s

o n

t h i s

p a g e . ”

US. P a t . N o .

5 , 4 9 9 , 3 3 0

e n t i t l e d Document D i s p l a y S y s

t e m For

O r g a n i z i n g A n d D i s p l a y i n g Documents A s S c r e e n

O b j e c t s

O r g a n i z e d A l o n g S t r a n d

P a t h s . As

d e s c r i b e d i n

t h e

A b s t r a c t ,

t h i s r e f e r e n c e s

d i s c l o s e s

a s y s t e m f o r d i s p l a y i n g

documents i n a c o m p u t e r c o n t r o l l e d d i s p l a y d e v i c e . “The

s y s t e m d i s p l a y s

d o c u m e n t s e i t h e r

i n

a

c o m p l e t e l y

f r e e - f o r m ,

a

u s e r c o n t r o l l e d

con?guration

o r

a s s t r a n d s , such

t h a t

documents i n a

s t r a n d

f o l l o W a

s t r a n d

p a t h .

The s t r a n d

p a t h

i s a tWo dimensional l i n e through a

t h r e e

dimensional

d i s p l a y

s p a c e .

The documents

d i s p l a y e d

on t h e

s t r a n d

a r e

kn o W n

a s c h i l d

documents, and e a c h

s t r a n d a l s o

h a s

a p a r e n t

document. V a r i o u s c o n s t r a i n t s

de?ning

t h e s t r a n d

a r e

a s s o

c i a t e d

W i t h

t h e

p a r e n t d o c u m e n t , i n c l u d i n g a

s t r a n d

f u n c t i o n

d e ? n i n g

t h e

s t r a n d

p a t h ,

minimum

a n d

maximum

e p a r a t i o n

c o n s t r a i n t s d e ? n i n g

t h e d i s t a n c e

b e t W e e n t h e c h i l d d o c u

ments on t h e

s t r a n d ,

a n d

a n

o r i g i n c o n s t r a i n t

d e ? n i n g t h e

p o s i t i o n a l r e l a t i o n s hi p o f

t h e s t r a n d

p a t h t o

t h e

s c r e e n

o b j e c t

o f t h e

p a r e n t

d o c u m e n t . ”

A

‘ P i l e ’ M e t a p h o r f o r S u p p o r t i n g

C a s u a l O r g a n i z a t i o n o f

I n f o r m a t i o n ,

R i c h a r d

M a n d e r , G i t t a S a l o m a n , Y i n Y i n

Wong, C h i ’ 9 2

C o n f e r e n c e

P r o c e e d i n g s , CM

o n f e r e n c e

on Hu m a n F a c t o r s

i n

Computing S y s t e m s , p g s 6 2 7 — 6 3 4 ,

M a y

3 — 7 , 1 9 9 2 . T h i s a r t i c l e d e s c r i b e s t h e

d e s i g n

a n d

d e v e l

opment

o f a

d e s k t o p i n t e r f a c e

e l e m e n t

r e f e r r e d t o a s p i l e s .

P i l e s r e p r e s e n t s e t s

o f

r e l a t e d

d o c u m e n t s .

These p i l e s a r e

a n a l o g o u s t o

s t a c k s o f p a p e r o f t e n found

i n

a

p e r s o n s o f ? c e

o r Workspace. P i l e s We re observed

t o

have t h e

u s e f u l

prop

e r t i e s

o f

b e i n g

a l e s s r i g i d

c a t e g o r i Z a t i o n

s y s t e m a n d

t o

b e

s e l f - r e v e a l i n g a n d

b r o W s a b l e . T h e d e s c r i b e d d e s i g n

i n c l u d e s

d i r e c t

m a n i p u l a t i o n t e c h n i q u e s

a n d

s u p p o r t

f o r

b r o W s i n g ,

a u t o m a t i c p i l e c o n s t r u c t i o n a n d r e o r g a n i Z a t i o n .

R e p r e s e n t a t i o n

i n

V i r t u a l

S p a c e :

W i s u a l C o n v e n t i o n

i n t h e

G r a p h i c a l U s e r I n t e r f a c e ,

L o r e t t a S t a p l e s ,

Human a c t o r s i n

Computing Systems

INTERCHI’93

Conference

P r o c e e d i n g s , p g s 3 4 8 — 3 5 4 , A p r . 2 4 — 2 9 1 9 9 3 . T h i s a r t i c l e s

d e s c r i b e s

t h e

use o f t h r e e dimensional v i s u a l cues o f p e r

s p e c t i v e and l i g h t i n g , i n t h e

c o n t e x t

o f ? a t o r tWo

dimensional

Workspace.

T h e use of

transparency a s a

m e a n s

o f e n h a n c i n g

t h e W o r k s p a c e i s

a l s o

d e s c r i b e d . e s k t o p

“ l a n d s c a p e ” i s

p r o p o s e d

t h a t i s d i v i d e d by a h o r i Z o n l i n e

d e n o t i n g

tWo s e p a r a t e a r e a s : a n a c t i v e f o r e g r o u n d

s p a c e a n d

a

p a s s i v e

b a c k g r o u n d

s p a c e .

SUMM RY OF

THE

INVENTION




5 , 8 3 8 , 3 2 6

3

v i d u a l

document

o r a

document

c o l l e c t i o n . The

document

W o r k s p a c e

h a s

b e e n i m p l e m e n t e d f o r u s e

t o

d i s p l a y a n d

i n t e r a c t W i t h

d o c u m e n t s , t y p i c a l l y

Web

p a g e s ,

t h a t h a v e b e e n

doWnloaded from t h e World Wide Web. However, t h e docu

ment

Workspace s a l s o s u i t a b l e f o r

u s e

t o d i s p l a y documents

o r

document


o b t a i n e d

from o t h e r

s o u r c e s

eg

from a CD-ROM).

Document

c o l l e c t i o n s a r e t y p i c a l l y i n t h e

form o f

WebBoo k s o r

p i l e s .

WebBoo k s a r e document c o l

l e c t i o n s

t h a t a r e r e p r e s e n t e d

t o

a u s e r

u s i n g

a book m e t a p h o r .

A

i l e i s a

r e p r e s e n t a t i o n

o f a

document

c o l l e c t i o n t h a t

r e s e m b l e s

a

p i l e

o f

p a p e r

c o n t a i n e d

i n a

p a p e r t r a y . Apile

i s

c r e a t e d by moving o n e document o b j e c t on

t o a n o t h e r

d o c u m e n t o b j e c t .

T h e

d o c u m e n t

W o r k s p a c e i s

d i v i d e d h i e r a r c h i c a l l y

i n

t e r m s o f i n t e r a c t i o n

r a t e s . o c u s

s p a c e i s Where

d i r e c t


With a document

o b j e c t

o c c u r s . The

i n t e r a c t i o n s

o c c u r s

i n

a manner s u i t a b l e f o r t h e document o b j e c t i n t h e

f o c u s

s p a c e . The

f o c u s s p a c e i s g e n e r a l l y t h e c e n t e r o f t h e

d i s p l a y

a r e a

A n

i m m e d i a t e

memory s p a c e

i s

f o r

p l a c i n g

document

o b j e c t s

t h a t

a r e

i n

u s e ,

b u t

n o t c u r r e n t l y

b e i n g

i n t e r a c t e d W i t h . V i s u a l l y

i n

t h e d o c u m e n t W o r k s p a c e t h e

immediate memo r y

s p a c e i s d i v i d e d

i n t o

a n

“ a i r ”

s p a c e

and

a

“ d e s k ” . The d e s k i s

a

f a m i l i a r

metaphor f o r p l a c i n g

documents on

t h a t

a r e

n o t

c u r r e n t l y

b e i n g v i e W e d ,

b u t a r e i n

u s e . The “ a i r ” i s l o c a t e d

“ b e h i n d ”

t h e f o c u s s p a c e . The “ a i r ”

i s f u r t h e r d i v i d e d i n t o s u b a r e a s . Each o f t h e s u b a r e a s c o r

r e s p o n d s t o a d i s t a n c e b a c k i . e . i n t h e Z - d i r e c t io n ) i n W h i c h

t h e d o c u m e n t o b j e c t i s p o s i t i o n e d .

T h e

f u r t h e r b a c k , t h e

s m a l l e r

t h e

s i Z e o f t h e r e p r e s e n t a t i o n o f

t h e d o c u m e n t

o b j e c t .

A e r t i a r y s p a c e i s W h e r e many

document

o b j e c t s , eg

WebBooks

and

f r e q u e n t ly r e f e r e n c e d

documents

t h a t a r e n o t

c u r r e n t l y

i n

u s e may b e

p o s i t i o n e d .

The

t e r t i a r y

s p a c e i s

v i s u a l l y r e p r e s e n t e d a s a

b o o k s h e l f .

Moving d o c u m e n t o b j e c t s

i n

t h e d o c u m e n t W o r k s p a c e i s


by a

t o u c h a n d d r o p g e s t u r e . W hen

a document

o b j e c t i s t o u c h e d ,

and a

b u t t o n

on

t h e a s s o c i a t e d c u r s o r

c o n t r o l d e v i c e r e m a i n s d e p r e s s e d , a l i n e i s draWn

o i n d i c a t e

Where t h e o b j e c t

i s

t o b e

d r o p p e d .

T h i s h e l p s f a c i l i t a t e

a

d e t e r m i n a t i o n

o f

W h e r e

t h e document

o b j e c t i s

t o

b e p l a c e d .

Document

o b j e c t s may a l s o

b e

? i c k e d

t o t h e i m m e d i a t e

a n d

t e r t i a r y

a r e a s s o a s

t o p e r m i t r a p i d

movement

o f t h e docu

m e n t o b j e c t s .

BRIEF

DESCRIPTION

OF THE DRAWINGS

F I G .

1

i s

a

b l o c k d i a g r a m o f

a computer c o n t r o l l e d

d i s p l a y

s y s t e m as

may

b e u t i l i Z e d i n

t h e c u r r e n tl y p r e f e r r e d embodi

ment

o f

t h e

p r e s e n t i n v e n t i o n .

F I G .

2a i l l u s t r a t e s t h e d e f a u l t vieW

o f

t h e document

W o r k s p a c e

o f

t h e

c u r r e n t l y p r e f e r r e d

e m b o d i m e n t o f t h e

p r e s e n t

i n v e n t i o n .

F I G .

2b

i l l u s t r a t e s t h e

d e f a u l t

vieW

o f

t h e

document

Workspace

With

a

r e c e i v e d

page

a r e a .

F I G . 3 i s a n

i l l u s t r a t i o n

o f

a

vieW s hoWing t h e t e r t i a r y

s p a c e

i . e . t h e b o o k c a s e ) i n t h e f o c u s s p a c e

o f

t h e

d o c u m e n t

W o r k s p a c e .

FIGS. 4—5 i l l u s t r a t e a t o u c h d r o p g e s t u r e

a s m a y

be

p e r f o r m e d i n t h e d o c u m e n t W o r k s p a c e

o f

t h e

c u r r e n t l y

p r e f e r r e d e m b o d i m e n t o f

t h e


FIGS. 6—7

i l l u s t r a t e

t h e

c o n t e X t

s e n s i t i v e n a t u r e

o f

t h e

t o u c h d r o p

g e s t u r e a s

may

b e p e r f o r m e d

i n t h e

document

W o r k s p a c e

o f t h e c u r r e n t l y p r e f e r r e d

e m b o d i m e n t

o f t h e


10

1 5

20

25

30

35

40

45

50

55

60

4

FIGS.

10—12 i l l u s t r a t e t h e c r e a t i o n

o f p i l e s a s

m a y

b e

p e r f o r m e d

i n


W o r k s p a c e

o f t h e c u r r e n t l y


t h e


DETAILED

DESCRIPTION

OF THE

INVENTION

A

o m p u t e r

c o n t r o l l e d

d i s p l a y s y s t e m f o r d i s p l a y i n g a

t h r e e - d i m e n s i o n a l document Worksp ace

s

d i s c l o s e d . One o r

more documents o b j e c t s a r e p r e s e n t

i n

t h e document Work

s p a c e .

The p r e s e n t i n v e n t i o n p r o v i d e s f o r i n t e r a c t i o n W i t h

t h e

c o l l e c t i o n s , e . g . v i e W i n g , m o v i n g a n d s t o r i n g , W h i l e

b a l a n c i n g t h e n e c e s s a r y t r a d e o f f s o f r a p i d a c c e s s , number o f

c o l l e c t i o n s a n d

a s s o c i a t e d

d o c u m e n t s , and a v a i l a b l e s c r e e n

s p a c e .

T h e c u r r e nt l y p r e f e r r e d e m b o d i m e n t o f t h e p r e s e n t

i n v e n

t i o n i s i m p l e m e n t e d f o r

u s e

W i t h c o l l e c t i o n s

o f

p a g e s

i . e .

d o c u m e n t s )

o b t a i n e d

f r o m

t h e

p o r t i o n o f

t h e I n t e r n e t

knoWn

a s t h e

World Wide

Web h e r e i n af t e r t h e

W e b ) .

H o W e v e r ,

t

s h o u l d b e

n o t e d t h a t t h e p r e s e n t i n v e n t i o n

i s

n o t l i m i t e d t o

u s e

on

t h e

Web

and m a y be

u t i l i Z e d

i n any system Which

p r o v i d e s a c c e s s t o


o f d o c u m e n t s .

F o r e X a m p l e ,

t h e p r e s e n t i n v e n t i o n m a y b e u s e d i n a s y s t e m W h e r e i n

documents a r e o b t a i n e d through a CD ROM

e d i a .

The

f o l l o W i n g terms de?ned

h e r e i n

a r e

f a m i l i a r

t o u s e r s o f

t h e

W e b

a n d t a k e

on

t h e s e

f a m i l i a r m e a n i n g s :

World-Wide

W e b

o r Web: The p o r t i o n

o f


t h a t

i s

used

t o s t o r e

and

a c c e s s l i n k e d multi-media documents.

P a g e :

A ocument a c c e s s i b l e

on

t h e Web. A age m a y

have multi-media c o n t e n t a s Well a s r e l a t i v e and a b s o l u t e

l i n k s t o

o t h e r

p a g e s .

L i n k : An n d i c a t o r on a Web age Which r e f e r s t o a n o t h e r

W eb

p a g e

a n d Which c a n

t y p i c a l l y

b e r e t r i e v e d i n a p o i n t a n d

c l i c k f a s h i o n . The L i n k W i l l s p e c i f y t h e Uniform R e s o u r c e

L o c a t o r URL)

o f t h e

o t h e r

Web p a g e .

Web BroWser o r BroWser: o o l

Which

enables a user t o

t r a v e r s e

t h r o u g h

a n d

vieW documents r e s i d i n g

on t h e

Web.

O t h e r r e n d e r i n g

means a s s o c i a t e d

W i t h

t h e BroWser W i l l

p e r m i t l i s t e n i n g t o

a u d i o

p o r t i o n s o f a document

o r

v i e W i n g

v i d e o o r

image p o r t i o n s

o f a

d o c u m e n t .

WebBook: A

e p r e s e n t a t i o n o f

a n a g g r e g a t i o n

o f W eb

p a g e s Which p r o v i d e s

r a p i d

l o c a l

i n t e r a c t i o n . WebBooks

a r e


f u r t h e r

i n c o - p e n d i n g


S e r .

N o .

0 8 / 5 2 5 , 9 3 6 e n t i t l e d “ D i s p l a y

S y s t e m F o r

D i s p l a y i n g L i s t s

Of

L i n k e d

D o c u m e n t s ” ? l e d S e p .

8 , 1 9 9 5 , W h i c h i s

a s s i g n e d

t o

t h e

same a s s i g n e e

o f t h e

p r e s e n t a p p l i c a t i o n

a n d Which s

h e r e b y

i n c o r p o r a t e d

b y

r e f e r e n c e .

D o c u m e n t

O b j e c t o r O b j e c t : Any

r a p h i c a l


o f a n

e n t i t y ,

eg

a

page

o r

WebBook,

i n

t h e document

W o r k s p a c e .

The c o m p u t e r b a se d s y s t e m on Which t h e c u r r e n t l y

p r e

f e r r e d embodiment

o f t h e

p r e s e n t i n v e n t i o n

may b e i m p l e

mented s d e s c r i b e d W i t h r e f e r e n c e t o F I G . 1 .

The

computer

b a s e d

s y s t e m a n d a s s o c i a t e d

o p e r a t i n g

i n s t r u c t i o n s e . g .

s o f t W a r e ) e m b o d y c i r c u i t r y

u s e d

t o

i m p l e m e n t t h e

p r e s e n t

i n v e n t i o n . R e f e r r i n g t o F I G . 1 ,

t h e

c o m p u t e r

b a s e d sy s t e m

i s

c o m p r i s e d o f a p l u r a l i t y o f c o m p o n e n t s c o u p l e d v i a a b u s

1 0 1 .

The

b u s

1 0 1

may

c o n s i s t

o f a p l u r a l i t y o f p a r a l l e l

b u s e s

e . g . a d d r e s s, d a t a

a n d

s t a t u s

b u s e s )

a s W e l l a s a

h i e r a r c h y

o f

b u s e s eg

a

p r o c e s s o r

b u s , a

l o c a l b u s a n d a n I / O b u s ) . I n

a n y

e v e n t , t h e

c o m p u t e r s y s t e m i s

f u r t h e r

c o m p r i s e d

o f

a

p r o c e s s o r

1 0 2 f o r e x e c u t i n g

i n s t r u c t i o n s

p r o v i d e d v i a b u s

1 0 1 f r o m I n t e r n a l memory 1 0 3

n o t e

t h a t t h e I n t e r n a l




5 , 8 3 8 , 3 2 6

5

p a g e s ,

c o n v e r t i n g

eb

p a g e s i n t o a

s u i t a b l e f o r m a t

f o r

d i s p l a y

i n


W o r k s p a c e a n d

i n t e r p r e t i n g a n d

c a r r y i n g o u t

movement g e s t u r e s .

I n s t r u c t i o n s

f o r

p e r f o r m i n g

s u c h o p e r a t i o n s a r e r e t r i e v e d

from I n t e r n a l

m e m o ry

1 0 3 .

The

p r o c e s s o r 102 a n d I n t e r n a l m e m o ry 103 may e

d i s c r e t e

components o r

a s i n g l e

i n t e g r a t e d

d e v i c e

s u c h

a s

a n

Appli

c a t i o n

S p e c i ? c a t i o n

I n t e g r a t e d

C i r c u i t A S I C ) c h i p .

Also

c o u p l e d

t o

t h e bus

101

a r e a keyboard

104

f o r

e n t e r i n g

a l p h a n u m e r i c

i n p u t , e X t e r n a l s t o r a g e

1 0 5

f o r s t o r i n g

d a t a ,

a

c u r s o r

c o n t r o l d e v i c e

106

f o r

manipulating

a c u r s o r ,

a d i s p l a y 1 0 7 f o r

d i s p l a y i n g

v i s u a l o u t p u t e . g . t h e d o c u m e n t

W o r k s p a c e ) a n d a

n e t W o r k

c o n n e c t i o n 1 0 8 . The

k e y b o a r d

1 0 4

Would

t y p i c a l l y b e a s t a n d a r d

QWERTY e y b o a r d

b u t

may

a l s o

b e

a

t e l e p h o n e l i k e k e y p a d . The e X t e r n a l s t o r a g e

105 may

b e

?xed o r removable

m a g n e t i c

o r o p t i c a l d i s k

d r i v e . T h e

cursor

c o n t r o l device 106,

eg

a

m o u s e

o r

t r a c k b a l l ,

W i l l t y p i c a l l y

h a v e a b u t t o n

o r

s W i t c h

a s s o c i a t e d

W i t h

i t t o

Which t h e p e r f o r m a n c e o f

c e r t a i n f u n c t i o n s

c a n b e

p r o g r a m m e d . I n t h e

c u r r e n t l y

p r e f e r r e d

embodiment

s u c h

a

s W i t c h W i l l have a ? r s t u p p o s i t i o n and a second d o W n

p o s i t i o n

Which

a r e used

t o

s e l e c t

and

m o v e

d ocument

o b j e c t s W i t h i n

t h e document

W o r k s p a c e . The

n e t W o r k c o n

n e c t i o n 108

p r o v i d e s means f o r a t t a c h i n g t o a n e t W o r k , eg

a Local Area NetWor k L A N) c a r d o r

modem

c a r d

W i t h

a p p r o p r i a t e s o f t W a r e .

The

n e t W o r k u l t i m a t el y a t t a c he d t o i s

t h e I n t e r n e t , b u t i t may b e t h r o u g h

i n t e r m e d i a r y

n e t W o r k s

o r

On-Line s e r v i c e s s u c h a s America O n - L i n e , P r o d i g y TM r

CompuServ TM.

T h e c u r r e n t l y

p r e f e r r e d

e m b o d i m e n t

o f t h e p r e s e n t

i n v e n

t i o n

h a s been

implemented on

a

S i l i c o n

G r a p h i c s W o r k s t a

t i o n

W i t h g r a p h i c s f a c i l i t i e s a s d e s c r i b e d i n SGI G r a p h i c s

L i b r a r y P r o g r a m m i n g

G u i d e , S i l i c o n G r a p h i c s , I n c .

o f

M o u n t a i n V i e W , C a l i f .

The S i l i c o n

G r a p h i c s W o r k s t a t i o n

p r o v i d e s f o r

g e n e r a t i n g

s o f t W a r e

p r o g r a m s W h i c h m a n i p u

l a t e

g r a p h i c a l

o b j e c t s

i n a

t h r e e

d i m e n s i o n a l

s p a c e , s o

d e s c r i p t i o n o f p r o g r a m m i n g

t e c h n i q u e s f o r

r e n d e r i n g

g r a p h i c a l

o b j e c t s

i n

a t h r e e


s p a c e

i s n o t d eemed

n e c e s s a r y .

I t s h o u l d b e n o t e d t h a t i t W o u l d have been

a p p a r e n t

t o

one

o f s k i l l

i n t h e a r t t o

implement

t h e p r e s e n t

i n v e n t i o n

on o t h e r

s u i t a b l e c o m p u t e r

s y s t e m s p r o v i d i n g f u n c t i o n a l i t y

f o r

m a n i p u l a t i n g g r a p h i c a l

o b j e c t s i n a t h r e e d i m e n s i o n a l s p a c e .

S u c h

i m p l e m e n t a t i o n s W o u l d

n o t d e p a r t

f r o m

t h e s p i r i t a n d

s c o p e

o f

t h e


F i n a l l y ,

t h e

p r e s e n t

i n v e n t i o n i s implemented

on

a

c o m

p u t e r c o n t r o l l e d d i s p l a y s y s t e m h a v i n g a G r a p h i c a l

U s e r

I n t e r f a c e G U I ) . O p e r a t i o n s f o r

moving

p a g e s o r p a g e


i n

t h e

GUI

have

been

c r e a t e d

t h a t s u p p o r t

u s e

i n

t h e

Document

W o r k s p a c e .

Such o p e r a t i o n s

a r e

d e s c r i b e d

i n

g r e a t e r

d e t a i l

b e l o W . O t h e r o p e r a t i o n s

a r e invoked i n

a

s i m i l a r f a s h i o n and

perform

a s i m i l a r f u n c t i o n a s i n

k n o W n

GUIs.

For e X a m p l e , t h e a c t o f “ t o u c h i n g ” a document o r

document c o l l e c t i o n i s

a n a l o g o u s

t o “ s e l e c t i o n ” by p o i n t

and c l i c k o p e r a t i o n o f

a

c u r s o r c o n t r o l d e v i c e .

T h e

Document

W o r k s p a c e

The p u r p o s e

o f

t h e document Workspace i s

t o

a l l o W a

l a r g e n u m b e r o f

d o c u m e n t

o b j e c t s t o b e d i s p l a y e d t o g e t h e r

m i t i g a t i n g

t h e l i m i t a t i o n s o f t h e s m a l l

s c r e e n s p a c e )

i n

o r d e r

t o s u p p o r t i n f o r m a t i o n

i n t e n s i v e a c t i v i t i e s .

I n t e r a c t i o n W i t h

pages i s

s i m i l a r t o t h e f u n c t i o n a l i t y

o f

a Web r o W s e r . The

W o r k s p a c e

s e t s

u p e x p l i c i t l y t h e

c a p a c i t y

f o r s p e e d / a c c e s s

t i m e t r a d e o f f t o a l l o W t u n i n g

f o r s u c h

a c t i v i t i e s . The d e s i g n

aims

t o

p r o v i d e v e r y

r a p i d

a c c e s s

t o

a

s m a l l n u m b e r o f

p a g e s , s m o o t h l y i n t e g r a t e d

W i t h

s l o W e r a c c e s s t o a l a r g e

n u m b e r . P a g e s f o r

o n g o i n g

a c t i v i t i e s m i g r a t e i n t o

t h e

r a p i d

10

1 5

25

35

45

55

6

I t i s a l s o v e r y

u s e f u l

t h a t t h e document

W o r k s p a c e

i s t h r e e

d i m e n s i o n a l .

Th e v i s u a l cues

i n a

t h r e e

dimensional W o r k

s p a c e

e n a b l e t h e

p l a c e m e n t

o f

a g r e a t e r number

o f

docu

m e n t s i n

p o s i t i o n s

a n d o r i e n t a t i o n s Which a r e re a d i l y a c c e p t

a b l e

t o

t h e u s e r . F u r t h e r , t h e

t h r e e - d i m e n s i o n a l

n a t u r e o f t h e

W o r k s p a c e

p r o v i d e

f o r a

much

l a r g e r

W o r k s p a c e

s i n c e

i t

p e r m i t s p l a c e m e n t o f W o r k s p a c e o b j e c t s “ b e h i n d ” o r t h e “ t h e

s i d e ”

o f

t h e

u s e r . T h u s ,

b y

s i m p l y “ t u r n i n g

a

v i e W p o i n t ”

d i f f e r e n t p o r t i o n s o f t h e W o r k s p a c e a r e b r o u g h t i n t o v i e W .

T h e d o c u m e n t W o r k s p a c e o f t h e c u r r e n t l y

p r e f e r r e d

embodiment i s i l l u s t r a t e d W i t h

r e f e r e n c e

t o F I G . 2 a .

I t

s h o u l d b e

n o t e d

t h a t t h e

“ u s e r v i e W ” o f

t h e

W o r k s p a c e

i s t h e

p r i m a r y o r d e f a u l t v i e W . A s

t h e document

W o r k s p a c e

i s

t h r e e - d i m e n s i o n a l , t r a v e r s a l

t h r o u g h t h e W o r k s p a c e i s

p e r

m i t t e d

t o a c h i e v e

d i f f e r e n t v i e W s

o f

t h e W o r k s p a c e .

The

d o c u m e n t W o r k s p a c e i s a r r a n g e d

h i e r a r c h i c a l l y ,

b a s e d o n

i n t e r a c t i o n r a t e s ,

i n t o

t h r e e main l e v e l s :

a F o c u s

S p a c e f o r


o b j e c t s

i n a c t i v e u s e ) , I m m e d i a t e Memory

S p a c e

f o r

d o c u m e n t o b j e c t s

i n

u s e )

a n d T e r t i a r y S p a c e f o r

document

o b j e c t s

n o t

i n

u s e ) .

I t

s h o u l d

b e

n o t e d

t h a t

a t

e a c h

o f

t h e d i f f e r e n t l e v e l s , t h e amount

o f d i s p l a y

s p a c e

p e r

d o c u m e n t

o b j e c t

r o u g h l y c o r r e s p o n d s t o

t h e i n t e r a c t i o n

r a t e

W i t h

t h e document o b j e c t . T h i s W i l l become

a p p a r e n t

i n t h e

d e s c r i p t i o n

b e l o W .

The

Focus

Space i s Where a

document o b j e c t

t h a t a u s e r

i s d i r e c t l y

i n t e r a c t i n g W i t h

i s

s h o W n . I n o t h e r W o r d s , t h e

d o c u m e n t

o b j e c t i s i n a c t i v e u s e . I n t h e

c u r r e n t l y

p r e f e r r e d

embodiment, t h e

f o c u s

s p a c e

may

c o n t a i n a

p a g e ,

p i l e ,

W e bB o o k o r even

a


o f

t h e T e r t i a r y

S p a c e .

R e f e r r i n g t o

F I G .

2 a , a

document

o b j e c t

2 0 1 i s

i n

t h e

F o c u s

S p a c e .

I n

t h e c u r r e n t l y p r e f e r r e d e m b o d i m e n t d o c u m e n t

o b j e c t s a r e

vi eWed and i n t e r a c t e d

With i n a manner a s s o c i

a t e d W i t h t h e p a r t i c u l a r

o b j e c t .

S o f o r p a g e s d o W n l o a d e d

from

t h e World-Wide

W e b

i n an

HTML

o r m a t ,

t h e pages a r e

i n t e r a c t e d

W i t h u s i n g a

b r o W s e r

c a p a b l e o f

v i e W i n g

HTML

f o r m a t t e d

d o c u m e n t s .

With r e s p e c t t o document c o l l e c t i o n s ,

a

d ocument

c o l l e c t i o n may e v i e W e d a s a

p i l e

o f i n d i v i d u a l

Web pages

o r a s a

WebBook

r

v ie W e d i n

a l i n e a r organi

Z a t i o n u s i n g a Doc ument Lens

V i s u a l i z a t i o n . The

Doc ument

Workspace

p r o v i d e

a means f o r s e l e c t i n g t h e

manner

i n

Which a

p a g e

c o l l e c t i o n i s

v i e W e d , eg

s i n g a p u l l - d o W n

menu

When ie We d a s a

W e bB o o k , t h e

pages

a r e

o r g a n i Z e d i n

a

book

m e t a p h o r .

User

i n t e r f a c e c o n t r o l s

a r e p r o v i d e d Which

enable a user t o

t r a v e r s e

a page,

s c a l e

pages, t u r n pages,

p l a c e

bookmarks

a n d t o a u t o m a t i c a l l y s c a n

t h e WebBook.

The u s e r i n t e r f a c e f o r v i e W i n g

t h e p a g e s i n

t h e

W e bB o o k s

d e s c r i b e d

i n g r e a t e r

d e t a i l

i n

c o - p e n d i n g a n d commonly

a s s i g n e d US. p a t e n t a p p l i c a t i o n S e r . N o . 0 8 / 5 2 5 , 9 3 6

e n t i t l e d

“ D i s p l a y

S y s t e m F o r

D i s p l a y i n g

L i s t s

Of L i n k e d

D o c u m e n t s ” ? l e d

S e p .

8 ,

1 9 9 5 .

T h e D o c u m e n t

L ens

i s a n i n f o r m a t i o n v i s u a l i Z a t i o n t e c h

n i q u e

Which shoWs

a t h u m b n a i l r e p r e s e n t a t i o n o f e a c h

p a g e

o f a d ocument

a s

i f t h e y

Wer e

l a i d o u t i n s e q u e n t i a l

o r d e r

on

a

p l a n e . A

o o l , i . e . t h e l e n s , i s m o v e d o v e r t h e

document

p a g e s t o

b r i n g

t h e d e s i r e d p o r t io n s i n t o

f o c u s . F u r t h e r

d e t a i l

W i t h

r e s p e c t

t o

t h e v i e W i n g

o f m u l t i - p a g e

d o c u m e n t s

u s i n g

a Doc ument Lens

i s

d e s c r i b e d i n t h e a r t i c l e

by

R o b e r t s o n

a n d M a c k i n l a y e n t i t l e d “ T h e Document

L e n s ”

US T ’ 9 3 ,

CM C onference on

User I n t e r f a c e

SoftWare and

T e c h n o l o g y , p g s .

1 0 1 — 1 0 8 ,

1 9 9 3 .

T h e

I m m e d i a t e

Memory

S p a c e

i s W h e r e

d o c u m e n t

o b j e c t s

a r e

p o s i t i o n e d Wh e n t h e y

a r e i n

u s e , b u t n o t

c u r r e n t l y

i n t e r a c t ed W i t h . I n

F I G .

2 a ,

a

“ d e s k ” 2 0 2

a n d

t h e

“ a i r ”

203




5 , 8 3 8 , 3 2 6

7

s e v e r a l

p r e d e t e r m i n e d

Z - d i s t a n c e s

i n

t h e

3D p a c e . T h r e e 3 )

such

t i e r s a r e i l l u s t r a t e d i n

FIG.

2 a , t i e r s 204—206. The u s e r

c a n

move

document o b j e c t s

back

n s p a c e t h e f a r t h e r b a c k ,

t h e s m a l l e r t h e y become

a n d

t h e more document o b j e c t s t h a t

? t ) .

T h i s

i s

i l l u s t r a t e d b y n o t i n g

t h e

s i Z e d i f f e r e n c e s i n

t h e

v i s u a l r e p r e s e n t a t i o n s

o f

document


204a—b

a n d

document c o l l e c t i o n s 2 0 6 a — 2 0 6 b . To h e l p W i t h

o c c l u s i o n

p r o b l e m s ,

a c a m e r a o r

v i e w i n g ) p o s i t i o n i s

c h o s e n

s o t h a t

a t l e a s t one roW of

do cum e n t s

W i l l ? t

i n a

f a r t h e r - b a c k t i e r

W i t h o u t b e i n g

o c c l u d e d b y

n e a r e r

o b j e c t s .

Document

b j e c t s

i n

t h e

I m m e d i a t e Memory S p a c e c a n b e

moved

a r o u n d i n X

a n d

Y

i . e . l e f t / r i g h t

o r

u p / d o W n ) o r f o r W a r d a n d backWard

t h a t i s

i n Z )

u s i n g

a

s i m p l e g e s t u r e

l a n g u a g e

d e s c r i b e d

b e l o W . The

d e s k

202

may a l s o

c o n t a i n document

o b j e c t s ,

eg

ocument o b j e c t s 202a

and 2 0 2 b . When

h e

u s e r

moves

a r o u n d i n t h e Document

o r k s p a c e ,

t h e d e s k 2 0 2 ,

a n d

h e n c e

o b j e c t s on t h e d e s k may move. G e n e r a l l y , t h e most r e c e n t l y

u s e d

document

o b j e c t s

a r e p l a c e d

on t h e d e s k

2 0 2 .

I n t h e

c u r r e n t l y

p r e f e r r e d e m b o d i m e n t ,

t h e

I m m e d i a t e

Memory

Space

c a n

h o l d

a b o u t

30

document

o b j e c t s

W i t h o u t

o c c l u s i o n , a n d over

a

hun d re d i f o c c l u s i o n s

a r e

a l l o W e d .

E a c h

o f t h e

d o c u m e n t

o b j e c t s

i n

t h e I m m e d i a t e Memory

S p a c e i s

p r e s e n t e d “ f a c e - u p ” .

T h e

T e r t i a r y

S p a c e i s W h e r e

d o c u m e n t

o b j e c t s s u c h

a s

p a g e s a n d

WebBooks

may b e p o s i t i o n e d Wh en t h e y a r e n o t

i n u s e . F o r e x a m p l e , document

o b j e c t s

t h a t a r e u s e d f o r

r e f e r e n c e

p u r p o s e s

a r e p l a c e d

i n

t h e t e r t i a r y

s p a c e . R e f e r r i n g

t o F I G . 2 a ,

i n

t h e c u r r e n t l y

p r e f e r r e d

embodiment t h e

t e r t i a r y s p a c e i s

r e p r e s e n t e d a s a bookcase 2 2 0 . I n normal

v i e W , t h e

bookcase i s

s e e n a t a n a n g l e t o

minimiZe

t h e

amo u nt o f s c r e e n space t h a t i s consumed While a t t h e s a m e

t i m e d i s p l a y i n g

e n o u g h

i n f o r m a t i o n

t h a t

r e c e n t l y - u s e d

Web

Books o r

pages can be

r e c o g n i z e d . I f

t h e

u s e r

“ t o u c h e s ”

one

o f

t h e

WebBoo ks

o r

pages i n t h e

b o o k c a s e s ,

i t W i l l

a u t o

m a t i c a l l y

“ ? y ” t o t h e

f o c u s s p a c e

2 0 1 .

S i m u l t a n e o u s l y ,

a n y

WebBook r

page

t h e n

i n t h e

f o c u s s p a c e

2 0 2

W i l l

?y t o a

p o s i t i o n i n t h e I m m e d i a t e s p a c e 2 0 3 . T h e “ ? y i n g ” o f o b j e c t s

i s

a n

a n i m a t i o n

Which shoWs t h e

movement o f

o b j e c t s from

one spa ce t o a n o t h e r .

T h e d o c u m e n t W o r k s p a c e o f t h e c u r r e n t l y

p r e f e r r e d

embodiment i s

d e s i g n e d t o

p e r f o r m m u l t i p l e t a s k s

c o n c u r

r e n t l y . So f o r

e x a m p l e , o n e

document

o b j e c t

may b e i n t e r

a c t e d

W i t h

b y

t h e u s e r and

c o n c u r r e n t l y ,

a Web a c c e s s

r e q u e s t may b e p e r f o r m e d W i t h r e t r i e v e d Web p a g e s b e i n g

b r o u g h t i n t o t h e d o c u m e n t W o r k s p a c e f o r s u b s e q u e n t i n t e r

a c t i o n . F I G . 2b i l l u s t r a t e s

t h e

document W o r k s p a c e o f F I G .

2a

W i t h a

r e c e i v e d

page

s p a c e 2 1 0 .

The

r e c e i v e d

page

s p a c e

i s

a n a r e a

i n

t h e

document

Workspace

W h e r e i n

neWly

r e t r i e v e d

pages

a r e d i s p l a y e d . I n

FIG. 2 b , neW pages

211—214 h a v e b e e n r e c e i v e d .

The

neWly r e c e i v e d p a g e s may

be t h e r e s u l t o f

a c c e s s i n g

a

l i n k e d

page

on

a page b e i n g

i n t e r a c t e d With o r

t h e r e s u l t o f

a Web

e a r c h

r e q u e s t .

I n

o r d e r t o vieW t h e c o n t e n t s

o f

t h e t e r t i a r y s p a c e , i e t h e

b o o k c a s e ,

i t

s h o u l d b e p o s i t i o n e d i n t h e

f o c u s

s p a c e .

The

b o o k c a s e may

e e i t h e r

p r i v a t e o r p u b l i c .

A p r i v a t e

b o o k c a s e

i s

one

Where t h e c o n t e n t s

a r e

c r e a t e d and “oWned” b y t h e

“ o W n e r ”

o f t h e W o r k s p a c e . Apublic b o o k c a s e i s o n e t h a t h a s

c o n t e n t

t h a t

i s

c e n t r a l l y u p d a t e d

a n d m a i n t a i n e d . F o r

e x a m p l e , a p h o n e d i r e c t o r y may e

c e n t r a l l y

m a i n t a i n e d

a n d

s u b s e q u e n t l y

d i s t r i b u t e d

t o p u b l i c

b o o k c a s e s

o r s h e l v e s ) i n

u s e r W o r k s p a c e s .

T h e r e

m ay e v e n b e

s e p a r a t e p r i v a t e

a n d

p u b l i c

“ s h e l v e s ”

o n

t h e

b o o k c a s e

o r

e v e n

s e p a r a t e

p r i v a t e

a n d

p u b l i c

b o o k c a s e s ) .

T o u c h i n g t h e

b o o k c a s e

2 2 0

c a u s e s

t h e b o o k c a s e t o ?y t o t h e

f o c u s

s p a c e . T h i s i s i l l u s t r a t e d i n

10

1 5

25

35

45

55

8

d e s p i t e

t h e

movement

t h e d e s k r e m a i n s i n t h e

same p o s i t i o n

W i t h r e s p e c t

t o

t h e

f o c u s s p a c e

i . e .

d i r e c t l y

u n d e r n e a t h i t ) .

A l s o ,

t h e

d e s k a n d a n y p a g e s

on t h e

d e s k h a v e been r e s i Z e d

i n o r d e r t o m a i n t a i n

a

v i s u a l l y a c c e p t a b l e

s i e

p e r s p e c t i v e

W i t h r e s p e c t t o t h e neW v i e W . W h a t

c o n c e p t u a l l y

h a s

o c c u r r e d

i s

t h e

t h a t

u s e r vieW

h a s

been changed

t o

move

i n

f r o n t o f

t h e

b o o k c a s e ,

r a t h e r

t h a n

t h e

b o o k c a s e m o v i n g t h i s

i s

s u b s t a n t i a t e d by

t h e f a c t t h a t t h e

component o f t h e

i m m e d i a t e

s p a c e

2 0 3 t e r m e d “ a i r ” h a v i n g

t h e

? o a t i n g

d o c u

m e n t s i s n o l o n g e r v i s i b l e ) . S u b s e q u e n t l y t o u c h i n g a Web

Boo k o r

page

on t h e

bookcase

W i l l

cause

t h e u s e r vieW

t o ?y

b a c k t o t h e d e f a u l t

v i e W i n g

p o s i t i o n

a n d t h e “ t o u c h e d ”

WebBook r page

t o

?y t o t h e f o c u s s p a c e .

D o c u m e n t

O b j e c t s

ocument

o b j e c t i s a n y e n t i t y t h a t c a n b e m a n i p u l a t e d

i n


W o r k s p a c e . Adocument b j e c t c o n t a i n s t W o

b a s i c t y p e s

o f i n f o r m a t i o n ;

c o n t e n t i n f o r m a t i o n a n d d i s p l a y /

m a n i p u l a t i o n i n f o r m a t i o n .

The

c o n t e n t


r e f e r s t o

t h e t e x t a n d i m a g e d a t a f o r t h e u n d e r l y i n g d o c u m e n t .

The

d i s p l a y / m a n i p u l a t i o n


r e f e r s

t o

d a t a

d e ? n i n g

hoW

t h e

t e x t a n d

image d a t a

i s

t o

b e p r e s e n t e d t o

t h e

u s e r .

Some

e x a m p l e s :

f o r a Web page t h e d i s p l a y / m a n i p u l a t i o n in f o r m a t i o n

Would

b e

a

Web

b r o W s e r ;

f o r a document

c o l l e c t i o n

t h e


i n f o r

mation may e a

WebBook

r o W s e r .

HoW a

d o c u m e n t

o b j e c t i s

v i s u a l l y r e p r e s e n t e d d e p e n d s

on What t r e p r e s e n t s . n n d i v i d u a l do c ument o r Web page

W i l l b e r e p r e s e n t e d i n i t i a l l y b y t h e ? r s t p a g e o r b y t h e t o p

p a r t o f t h e Web p a g e .

While

s t i l l i n u s e , s u b s e q u e n t r e p r e

s e n t a t i o n s

W i l l s i m p l y b e Where t h e

document

Was When a s t

vieWed. For do c u ment c o l l e c t i o n s represented

a s

WebBooks t h e r e p r e s e n t a t i o n W i l l b e

t h e “ c o v e r ”

o f

t h e

b o o k .

Wh e n

n o t

i n

a c t i v e u s e , t h e

WebBook

W i l l

c l o s e ,

b u t

b e

bookmarked s o t h a t When e - o p e n e d i t W i l l a u t o m a t i c a l l y

open t o t h e l a s t page v i e W e d .

The

i n t e r n a l


o f a do c ument

o b j e c t

i s a s a

d a t a s t r u c t u r e

h a v i n g c o n t e n t

d a t a

r e p r e s e n t i n g

t h e

i n f o r m a t i o n , i e t e x t o r i m a g e ,

t h a t t h e


r e p r e s e n t s

a n d i n f o r m a t i o n f o r

i n d i c a t i n g

hoW t h e c o n t e n t

d a t a

W i l l

b e

p r o c e s s e d

f o r

r e n d e r i n g

a n d d i s p l a y .

T h e l a t e r

d a t a may b e a p ro gr am name t o b e

linked

t o o r a c t u a l

program

c o d e . D a t a

s t r u c t u r e s

f o r h a n d l i n g s u c h i n f o r m a t i o n

a r e

Well

k n o W n i n

t h e

a r t .

Moving D o c u m e n t

O b j e c t s I n

T h e D o c u m e n t W o r k s p a c e

The s i m p l e s t Way o f moving a d o c u m e n t o b j e c t i n t h e

document Workspace i s

t o

p o s i t i o n t h e

c u r s o r on

t h e

d e s i r e d

document

o b j e c t

a n d

c l i c k i n g t h e a s s o c i a t e d

s W i t c h on

t h e

c u r s o r c o n t r o l d e v i c e . T h i s

c a u s e s

t h e do c ument o b j e c t t o

move

t o t h e f o c u s s p a c e , and t o

move

t h e do c ument o b j e c t

p r e v i o u s l y

o c c u p y i n g t h e

f o c u s

s p a c e t o move t o t h e i m me

d i a t e

s p a c e

t h e

d e s k t o p ) . H o W e v e r ,

i t

i s o f t e n d e s i r a b l e t o

move


t o

l o c a t i o n s o t h e r t h a n t h e

f o c u s

s p a c e .

KnoWn t e c h n i q u e s f o r o p e r a t i n g i n a 2-D

W o r k s p a c e ,

eg

a

d r a g a n d

d r o p

o p e r a t i o n t o move

a n o b j e c t , do

n o t

Work

W e l l

i n

a 3-D W o r k s p a c e . One r e a s o n i s t h a t o b j e c t s

may

b e

s e p a r a t e d b y l a r g e

Z v a l u e s

a n d

W o u l d

r e q u i r e p a i n s t a k i n g

movement

o a d j u s t Z a l u e s W i t h i n a “ d r o p Z o n e ” . A s e con d

r e a s o n i s

t h a t

f o r e g r o u n d h e n c e l a r g e ) o b j e c t s o b s c u r e many

b a c k g r o u n d

h e n c e

s m a l l ) o b j e c t s s o t h e y a r e n o t

v i s i b l e .

S i m p l y

p i c k i n g

u p a n d

m o v i n g

a r o u n d

a

f o r e g r o u n d

o b j e c t

W o u l d t e n d t o o b s c u r e b a c k g r o u n d o b j e c t s .

To a d d r e s s t h e s e p r o b l e m s ,

a t o u c h

d r o p g e s t u r e

i s p r o




5 , 8 3 8 , 3 2 6

9

m e n t W i t h

a

l i n e , a n d t h e n d r o p p i n g t h e o b j e c t b y r e l e a s i n g

t h e c u r s o r c o n tr o l

b u t t o n

a t t h e

end

p o i n t

o f

t h e l i n e .

c o n s t r a i n t

o f

t h e t o u c h - d r o p g e s t u r e i s t h a t t h e e n d p o i n t

o f

t h e l i n e must b e on s o m e o t h e r document o b j e c t o r

a n o t h e r

v i s i b l e o b j e c t i n

t h e

W o r k s p a c e l i k e

t h e

b o o k c a s e

o f

t h e

d e s k ) .

O t h e r W i s e ,

n o

mo vement

o r o t h e r a c t i o n

i s

t a k e n

i . e .

a

n u l l

o p e r a t i o n ) . T h e ? n a l o p e r a t i o n o f

t h e

t o u c h d r o p

g e s t u r e i s c o n t e X t

s e n s i t i v e .

So i f t h e t o u c h e d o b j e c t i s a

WebBook a n d

t h e d r o p o b j e c t i s t h e b o o k c a s e , t h e

WebBook

i s

s t o r e d on

t h e bookcase.

The t o u c h

d r o p

g e s t u r e i s

i l l u s t r a t e d

i n

F I G S .

4 — 5 . R e f e r

r i n g t o F I G . 4 ,

page

202b on

t h e

d e s k i s t o u c h e d u s i n g a

c u r s o r c o n t r o l d e v i c e . While

t h e

s W i t c h

a s s o c i a t e d W i t h t h e

c u r s o r

c o n t r o l

d e v i c e r e m a i n s d e p r e s s e d i . e . i s i n t h e s e c o n d

d o W n p o s i t i o n ) ,

t h e c u r s o r

i s m o v e d and a l i n e 401 i s d r a W n .

N o t e

t h a t

i n t h e c u r r e n t l y

p r e f e r r e d

embodiment t h e

l i n e

a c t u a l l y t r a c e s th e m ov e m e n t

o f

t h e c u r s o r . HoWever i t

Would

b e

a p p a r e n t t o

o n e

i n t h e c u r r e n t l y p r e f e r r e d embodi

ment t o i n d i c a t e t h e

l i n e

u s i n g a W e l l

k n o W n

“ r u b b e r

b a n d i n g ”

t e c h n i q u e

b e t W e e n

t h e o r i g i n a l

s e l e c t i o n p o i n t

a n d

t h e

p o s i t i o n

o f t h e

c u r s o r . I n a n y e v e n t ,

t h e l i n e

401

t e r m i n a t e s a t t h e bookcase 2 2 0 . T e r m i n a t i o n

o c c u r s

by

r e l e a s i n g t h e s W i t c h a s s o c i a t e d

W i t h

t h e c u r s o r c o n t r o l

d e v i c e i . e . i s

i n

t h e ? r s t u p p o s i t i o n ) .

R e f e r r i n g

n o W o

F I G .

5 ,

t h e p a g e 202b h a s b e e n removed from

d e s k

202

a n d

h a s

been p l a c e d on bookcase

2 2 0 .

I t s h o u l d a l s o b e n o t e d t h a t t h e t o u c h d r o p g e s t u r e i s

c o n t e X t s e n s i t i v e . FIGS. 6—7 i l l u s t r a t e

placement o f a

page

on a b o o k c a s e .

R e f e r r i n g

t o F I G . 6 , p a g e 201

i s t o u c h e d

and

t o

b e d r o p p e d o n b o o k c a s e

2 2 0 . T h i s i s

i l l u s t r a t e d by t h e

e n d p o i n t o f

l i n e 6 0 1

t o u c h i n g

t h e

b o o k c a s e

2 2 0 .

T h e r e s u l t

i s i l l u s t r a t e d i n F I G . 7 W h e r e i n t h e page

201

s

removed

from

t h e f o c u s s p a c e a n d i s p l a c e d on b o o k c a s e

2 2 0 . The

a c t u a l

m ov e m e n t

o f

t h e

document

o b j e c t

201

t o

t h e

b o o k c a s e

220

i s

“ a n i m a t e d ”

s o

t h a t t h e document

o b j e c t

201

a p p e a r s t o ?y

t o t h e bookcase 220 W h e n t h e c u r s o r c o n tr o l b u t t o n i s

r e l e a s e d . T h i s a c t i o n i s c o n t e X t s e n s i t i v e s i n c e i t r e c o g n i Z e s

a n y

u n i q u e

r e q u i r e m e n t s o f t h e

d r o p

l o c a t i o n a n d p e r f o r m s

a n y a p p r o p r i a t e

a c t i o n s .

I n

t h i s

c a s e , t h e

u n i q u e

a c t i o n

concerns

p l a c i n g

t h e page on t h e b o o k c a s e .

So

t h e a p p r o

p r i a t e a c t i o n i s

t o

s c a l e

t h e page and

p l a c e

on

a n a v a i l a b l e

l o c a t i o n

on t h e bookcase. Another eXample

o f

c o n t e X t

s e n

s i t i v e o p e r a t i o n i s d i s c u s s e d b e l o W W i t h

r e s p e c t

t o p l a c i n g

one page on a n o t h e r

f o r

c r e a t i n g

a

p i l e

T h e t o u c h d r o p

g e s t u r e a l s o

h a s

t h e a d v a n t a g e

o f

n o t

r e q u i r i n g s c r e e n r e n d e r i ng o f

a

Workspace i n o r d e r t o m o v e

a document o b j e c t .

A n o t h e r

g e s t u r e

u s e d

f o r

moving

o b j e c t s

i s

t e r m e d “ ? i c k

i n g ” . I n “ ? i c k i n g ” a d o c u m e n t o b j e c t i s

moved

b y t o u c h i n g

t h e o b j e c t

a n d

“ ? i c k i n g ” i t

u s i n g

t h e c u r s o r c o n tr o l d e v i c e

i n

a d e s i r e d d i r e c t i o n . G e n e r a l l y What o c c u r s

i s

t h a t t h e o b j e c t

i s

touched

and W h i l e t h e s W i t c h on t h e c u r s o r c o n tr o l d e v i c e

r e m a i n s

d e p r e s s e d , t h e c u r s o r i s q u i c k l y m ov e d i n t h e

d e s i r e d d i r e c t i o n

a n d

t h e n r e l e a s e d . The o b j e c t W i l l t h e n

m o v e t o t h e

n e X t

immediate a r e a o r

t o

t h e t e r t i a r y a r e a ) i n

t h e

d i r e c t i o n

o f t h e “ ? i c k i n g ”

g e s t u r e .

I n t h e c u r r e n t l y

p r e f e r r e d

embodiment a

doWn?ick

m o v e s documents c l o s e r

t o

t h e

u s e r

s o t h e

d o c u m e n t o b j e c t g e t s l a r g e r ) , u p ? i c k s

m o v e

document

aWay

from

t h e u s e r s o

t h e document

o b j e c t

g e t s s m a l l e r ) , s i d e ? i c k s

move

document o b j e c t s t o t h e

bookcase o r

t o

o t h e r p o r t i o n s

o f

t h e immediate

a r e a s .

By

a d d i n g

s o m e

a n g l e

t o

t h e

u p ? i c k

g e s t u r e ,

d o c u m e n t

o b j e c t s

can

be p o s i t i o n e d

i n

a d i f f e r e n t X

h i r d

o f

t h e

n e X t f a r t h e r

t i e r . U p ? i c k i n g s e n d s documents

o

t h e Y p o s i t i o n

i n t h e n e X t

10

1 5

25

35

45

55

1 0

F l i c k i n g i s i l l u s t r a t e d i n F I G S . 8 — 9 . R e f e r r i n g t o F I G . 8 ,

p ag e

202a on desk 202 i s touched

u s i n g

a c u r s o r c o n t r o l

d e v i c e . While a b u t t o n a s s o c i a t e d With

t h e

c u r s o r c o n t r o l

d e v i c e r e m a i n s d e p r e s s e d a

r a p i d

m ov e m e n t o f t h e c u r s o r

c o n t r o l d e v i c e i n a n “upWard” d i r e c t i o n o c c u r s and t h e

b u t t o n

r e l e a s e d


b y

l i n e

8 0 1 ) .

T h e

r e s u l t

i s

i l l u s

t r a t e d

i n

F I G .

9 Where

t h e page 202a h a s been m ov e d

t o

t i e r

205

o f t h e

“ a i r ”

p o r t i o n o f t h e

i m m e d i a t e

s p a c e

i n

t h e

d o c u m e n t W o r k s p a c e .

I t s h o u l d

b e

n o t e d t h a t “ s c a l i n g ” o f document o b j e c t s a s

t h e y

a r e

moved

f r o m

f o r e g r o u n d t o

b a c k g r o u n d

p o s i t i o n s i n

t h e

d o c u m e n t


p e r f o r m e d

b y t h e r e n d e r i n g

s y s t e m

o f

t h e t h r e e - d i m e n s i o n a l c o m p u t e r c o n t r o l l e d d i s p l a y

s y s t e m. T h u s ,

no f u r t h e r

d i s c u s s i o n o f

h o W document

o b j e c t s a r e s c a l e d a s

t h e y

a r e mo ved t h r o u g h t h e document

W o r k s p a c e

i s

n o t deemed n e c e s s a r y .

D o c u m e n t C o l l e c t i o n s

I n t h e c u r r e n t l y p r e f e r r e d e m b o d i m e n t , c o l l e c t i o n s o f

documents

m a y b e i m p o r t e d o r t h e y c a n b e

c r e a t e d

dynami

c a l l y .

WebBo ok s

a r e

a n

eXample

o f c o l l e c t i o n s o f

documents

t h a t

a r e

i m p o r t e d .

ynamic

W ay o f c r e a t i ng

a c o l l e c t i o n

i s

t h r o u g h

“ p i l i n g ”

documents

on

t o p

o f e a c h

o t h e r t o

c r e a t e a

p i l e .

A p i l e

i s c r e a t e d

s i m p l y b y m o v i n g

o n e d o c u m e n t

o n t o

a n o t h e r

document u s i n g a t o u c h

d r o p

g e s t u r e . I t s h o u l d

b e

n o t e d t h a t

a

p i l e

m a y

be added t o

a n o t h e r

p i l e

t o

c r e a t e a n

e v e n b i g g e r

p i l e .

W h e n a p i l e i s

c r e a t e d

a

“ t r a y ” i s

p l a c e d

u n d e r t hem t o

i n d i c a t e

t h e i r

r e l a t i o n s h i p

a s a p i l e . T h e t r a y

a l s o

p r o v i d e s a c o n v e n i e n t

“ h a n d l e ”

f o r

s e l e c t i n g t h e

e n t i r e

p i l e .

T h e


a r e

p o s i t i o n e d

i n

t h e p i l e b y

h a v i n g e a c h n e W

page one quantum

f a r t h e r

i n r a d i u s

fro m

t h e c e n t e r

o f

t h e

p i l e i n

p o l a r c o o r d i n a t e s ) . T h e a n g l e f r o m

t h e

c e n t e r

i s chosen randomly

o r

i t m a y be c o n s t a n t

s o

t h a t

t h e

d o c u m e n t

o b j e c t s

a r e i n - l i n e . W h e n

t h e

a n g l e

f r o m t h e

c e n t e r

i s

c h o s e n r a n d o m l y , e a c h

p i l e

W i l l

h a v e

a d i s t i n c t

a p p e a r a n c e a n d e a c h document i n t h e p i l e W i l l b e v i s i b l e .

C r e a t i o n

o f p i l e s

W i t h

t h e a n g l e

f r o m

t h e c e n t e r c h o s e n

r a n d o m l y i s i l l u s t r a t e d i n F I G S . 1 0 — 1 2 . R e f e r r i n g t o F I G . 1 0 ,

o cument

1001

has a

c e n t e r

1002 Which i s l o c a t e d a t t h e

o r i g i n o f a p o l a r c o o r d i n a t e

s y s t e m i . e .

a t c o o r d i n a t e s 0 , 0 ) .

R e f e r r i n g

n o W t o F I G . 1 1 , a

document

1 1 0 1 h a s been p i l e d

on

t o p o f document 1 0 0 1 . The c e n t e r

1102 o f

document

1101

h a s

b e e n

p l a c e d a t c o o r d i n a t e s 0 , T h e a n g l e 0 i s

randomly

chosen and t h e r a d i u s X i s a c o n s t a n t . FIG. 12

i l l u s t r a t e s

a

t h i r d

document b e i n g p l a c e d o n t h e p i l e . R e f e r

r i n g

t o F I G .

1 2 , a

document

1201

h a v i n g

a c e n t e r 1202

i s

added t o t h e

p i l e . I n t h i s c a s e

t h e

c e n t e r 1202

i s

a t c o o r d i n a t e

4 ) ,

2 X ) ,

a g a i n

W h e r e

t h e

a n g l e

4 i s r a n d o m l y c h o s e n a n d t h e

r a d i u s

2X

d e t e r m i n e d

by

W h e n

t h e

document

W a s

added

t o

t h e

p i l e .

I t

s h o u l d

b e

n o t e d t h a t i n

t h e

p i l e

r e p r e s e n t a t i o n o f t h e

c u r r e n t l y

p r e f e r r e d e m b o d i m e n t , e a c h d o c u m e n t may b e

s e l e c t e d

a n d

b r o u g h t

t o t h e

t o p o f t h e

p i l e .

W h e n d o i n g t h i s ,

none

o f t h e o t h e r do cuments

become blocked from v i e W .

P i l e s m a y

b e g e n e r a t e d

a u t o m a t i c a l l y o r m a n u a l l y . I n

m a n u a l

c r e a t i o n , p i l e s a r e

s i m p l y

c r e a t e d b y c a u s i n g d o c u

m e n t s o r o t h e r p i l e s ) t o o v e r l a y

e a c h

o t h e r . I n a u t o m a t i c

c r e a t i o n , a p i l e m a y b e g e n e r a t e d by a t o o l i n t h e Document

Workspace Which l o o k s f o r

a n d

r e t r i e v e s d o c u m e n t s a c c o r d

i n g

t o some p r e d e t e r m i n e d

c r i t e r i a .

T h u s ,

a c o m p u t e r c o n t r o l l e d

d i s p l a y

s y s t e m f o r m o v i n g

document

o b j e c t s i n a t h r e e d i m e n s i o n a l

document

Work

s p a c e

i s

d i s c l o s e d .

While

t h e p r e s e n t i n v e n t i o n

i s

d e s c r i b e d

W i t h r e s p e c t

t o a

p r e f e r r e d

e m b o d i m e n t ,

i t Would b e

a p p a r e n t

t o

one

s k i l l e d

i n t h e

a r t

t o p r a c t i c e t h e p r e s e n t i n v e n t i o n

W i t h




5 , 8 3 8 , 3 2 6

1 1

We l a i m :

1 . o m p u t e r

c o n t r ol l e d d i s p l a y

s y s t e m f o r d i s p l a y i n g


i n a t h r e e - d i m e n s i o n a l

document

Work

s p a c e on a d i s p l a y , s a i d c o m p u t e r

c o n t r o l l ed d i s p l a y

s y s t e m

c o m p r i s i n g :

document

r e t r i e v a l

means

f o r r e t r i e v i n g

document

o b j e c t s ;

a

p o i n t e r

d e v i c e f o r p o i n t i n g a

c u r s o r a t

document o b j e c t s ,

s a i d p o i n t e r

d e v i c e

h a v i n g a

s W i t c h

W i t h a ? r s t up

p o s i t i o n a n d a s e c o n d doWn

p o s i t i o n ;

p o s i t i o n i n g

means f o r r e c e iv i n g u s e r

i n p u t

f o r p o s i t i o n i n g

document

o b j e c t s W i t h i n s a i d t h r e e - d i m e n s i o n a l d o c u

ment

Workspace s a i d


means

f u r t h e r

c o m

p r i s i n g :

means

f o r

d e t e c t i n g

t h a t s a i d c u r s o r

i s

p o i n t i n g a t a

s e l e c t e d

document

o b j e c t a n d

s a i d

s W i t c h

a s s o c i a t e d

W i t h s a i d p o i n t e r

d e v i c e

i s i n s a i d

s e c o n d doWn

p o s i t i o n ;

c i r c u i t r y

f o r

d e t e c t i n g

t h a t s a i d c u r s o r

i s

moved a n d

draWing a l i n e c o r r e s p o n d i n g t o t h e

mov ement

o f

s a i d c u r s o r ;

c i r c u i t r y f o r d e t e c t i n g t h a t

s a i d

c u r s o r

i s

p o i n t i n g

a t

a


document o b j e c t a n d s a i d s W i t c h

a s s o c i

a t e d

W i t h

s a i d

c u r s o r

i s i n s a i d

s e c o n d

up

p o s i t i o n ;

c i r c u i t r y f o r

p e r f o r m i n g

a c o n t e X t

s e n s i t i v e

o p e r a t i o n

b a s e d on

s a i d d e s t i n a t i o n document

o b j e c t ;

W o r k s p a c e

d i s p l a y c i r c u i t r y f o r g e n e r a t i n g d i s p l a y

i n f o r

m a t i o n f o r

d i s p l a y i n g s a i d t h r e e - d i m e n s i o n a l document

W o r k s p a c e a n d s a i d d o c u m e n t o b j e c t s , s a i d W o r k s p a c e

d i s p l a y c i r c u i t r y c o m p r i s i n g :


d i s p l a y i n g

a

f o c u s

s p a c e ,

s a i d f o c u s s p a c e

f o r d e t a i l d i s p l a y o f

a

document o b j e c t ;


d i s p l a y i n g

a n

i m m e d i a t e

s p a c e , s a i d

i m m e

d i a t e

s p a c e

f o r e p h e m e r a l p o s i t io n i n g o f d o c u m e n t

o b j e c t s t h a t

a r e

i n

u s e b u t

n o t i n f o c u s ; and


d i s p l a y i n g

a t e r t i a r y

s p a c e ,

s a i d t e r t i a r y

s p a c e f o r p o s i t i o n i n g

document

o b j e c t s

t h t

a r e n o t

i n u s e .

2 .

The

c o m p u t e r

c o n t r o l l e d

d i s p l a y s y s t e m a s r e c i t e d i n

c l a i m

1

W h e r e i n

s a i d


means

s f u r t h e r c o m p r i s e d

o f

? i c k

g e s t u r e i n t e r p r e t a t i o n means f o r d e t e c t i n g t h a t a ? i c k

g e s t u r e h a s

been p e r f o r m e d on

a

document

o b j e c t

a n d

r e - p o s i t i o n i n g s a i d document o b j e c t a t a p o s i t i o n c o r r e

s p o n d i n g t o

s a i d ? i c k g e s t u r e .

3 .

The

c o m p u t e r

c o n t r o l l e d


c l a i m 2

Wherein s a i d ? i c k g e s t u r e

i s

i n

a n

up d i r e c t i o n and

s a i d r e - p o s i t i o n i n g

o f

s a i d

d o c u m e n t

o b j e c t

i s

i n t o

s a i d

immediate s p a c e .

4 .

The

c o m p u t e r


s y s t e m

a s r e c i t e d

i n

c l a i m 2 Wherein s a i d ? i c k g e s t u r e i s i n a d oW n d i r e c t i o n and

s a i d r e - p o s i t i o n i n g o f s a i d

d o c u m e n t

o b j e c t i s i n t o s a i d

f o c u s

s p a c e .

5 .

The c o m p u t e r c o n t r o l l e d d i s p l a y

s y s t e m

a s r e c i t e d

i n

c l a i m 2 Wherein

s a i d ? i c k g e s t u r e i s

t o W a r d s

a document

o b j e c t r e p r e s e n t i n g

s a i d

t e r t i a r y s p a c e a n d

s a i d

r e - p o s i t i o n i n g

o f s a i d d o c u m e n t

o b j e c t s i s i n t o

s a i d

t e r t i a r y

s p a c e .

6 .

ethod

f o r moving

document

o b j e c t s

on

a

computer


s y s t e m f o r

d i s p l a y i n g d o c u m e n t o b j e c t s

on a t h r e e - d i m e n s i o n a l

document

Workspace s a i d

computer

c o n t r ol l e d d i s p l a y

s y s t e m h a v i n g

a

p o i n t e r

d e v i c e

f o r

c o n

t r o l l i n g a c u r s o r, s a i d p o i n t e r d e v i c e h a v i n g a s W i t c h c a p a b l e

o f b e i n g i n

a ? r s t up

p o s i t i o n

a n d a s e c o n d doWn p o s i t i o n ,

10

1 5

25

35

45

55

1 2

b d e t e c t i n g t h a t a u s e r

h a s

s e l e c t e d a

? r s t

document

o b j e c t

u s i n g

s a i d

p o i n t e r d e v i c e

a n d

t h a t

s a i d

s W i t c h

a s s o c i a t e d

W i t h s a i d p o i n t e r

d e v i c e i s

i n s a i d

s e c o n d

doWn p o s i t i o n ;

c d e t e c t i n g t h a t

s a i d

c u r s o r h a s b e e n m o v e d ;

d v i s i b l y

t r a c i n g

t h e

movement

o f

s a i d c u r s o r ;

e d e t e c t i n g t h a t

s a i d

c u r s o r p o i n t s t o

a

s e c o n d

document

o b j e c t

a n d t h a t

s a i d

s W i t c h a s s o c i a t e d

W i t h s a i d

p o i n t e r

d e v i c e

i s

i n

s a i d

s e c o n d up

p o s i t i o n ; a n d

f c a u s i n g a c o n t e X t d e p e n d e n t o p e r a t i o n t o b e

p e r f o r m e d

b a s e d on s a i d s e c o n d

document

o b j e c t .

7 . The method a s r e c i t e d i n

c l a i m

6 Wherein s a i d s t e p

o f

c a u s i n g

a c o n t e X t

d e p e n d e n t

o p e r a t i o n

t o b e p e r f o r m e d

b a s e d on

s a i d

s e c o n d

document o b j e c t i s f u r t h e r c o m p r i s e d

o f

t h e s t e p

o f

d e t e r m i n i n g t h a t s a i d s e c o n d d o c u m e n t

o b j e c t

i s a

b o o k c a s e a n d moving s a i d

? r s t

document

o b j e c t

t o s a i d

b o o k c a s e .

8 . The method a s r e c i t e d i n c l a i m 6 Wherein s a i d s t e p

o f

c a u s i n g a c o n t e X t d e p e n d e n t o p e r a t i o n t o b e b a s e d on

s a i d

s e c o n d d o c u m e n t o b j e c t

i s

f u r t h e r

c o m p r i s e d o f

t h e

s t e p

o f

d e t e r m i n i n g t h a t

s a i d

s e c o n d d o c u m e n t

o b j e c t

i s

a s e c o n d a r y

a r e a i n s a i d


document Workspace a n d

moving

s a i d document o b j e c t

t o s a i d s e c o n d a r y a r e a .

9 . The method a s r e c i t e d

i n c l a i m

6

Wherein

s a i d ? r s t

document o b j e c t i s a ? r s t document

a n d

s a i d s t e p o f

c a u s i n g

a

c o n t e x t

d e p e n d e n t

o p e r a t i o n t o b e

performed b a s e d on s a i d

s e c o n d

d o c u m e n t

o b j e c t

i s f u r t h e r c o m p r i s e d

o f

t h e s t e p

o f

d e t e r m i n i n g t h a t

s a i d

s e c o n d document

o b j e c t

i s a s e c o n d

document and s a i d c r e a t i n g a document c o l l e c t i o n c o m

p r i s e d o f

s a i d

? r s t document a n d

s a i d

s e c o n d d o c u m e n t .

1 0 . The method a s r e c i t e d

i n

c l a i m 9 Wherein s a i d

document

c o l l e c t i o n

i s a

p i l e .

1 1 .

The

method

a s r e c i t e d i n c l a i m

1 0

w h e r e i n

s a i d

s t e p

o f

c r e a t i n g

a document

c o l l e c t i o n

i s f u r t h e r c o m p r i s e d o f

t h e

s t e p s o f :


s a i d

s e c o n d

document

o b j e c t

a t a random

o r i e n t a t i o n W i t h

r e s p e c t t o

s a i d ? r s t d o c u m e n t ; a n d

d i s p l a y i n g

a t r a y

v i s u a l i Z a t i o n u n d e r s a i d ? r s t document

a n d s a i d s e c o n d d o c u m e n t .

1 2 . The method

a s r e c i t e d i n c l a i m 1 1 Wherein

s a i d

document

c o l l e c t i o n

i s p l a c e d a c c o r d i n g t o l o c a l p o l a r

c o o r d i n a t e

s y s t e m ,

a n d s a i d s t e p

o f

p o s i t i o n i n g s a i d

s e c o n d

document a t a

random

o r i e n t a t i o n With r e s p e c t t o s a i d ? r s t

d o c u m e n t

i s

f u r t h e r

c o m p r i s e d

o f t h e s t e p s o f :

d e t e r m i n i n g a

d i s t a n c e

c o o r d i n a t e f o r a

c e n t e r o f

s a i d

second

document

based

on

t h e n u m b e r o f documents i n

s a i d

p i l e ;

a n d

d e t e r m i n i n g a n a n g u l a r

c o o r d i n a t e

f o r s a i d c e n t e r o f s a i d

document a t random.

1 3 .

The method

a s r e c i t e d i n c l a i m 6 Wherein s a i d s t e p

o f

c a u s i n g a c o n t e X t d e p e n d e n t o p e r a t i o n t o

b e

p e r f o r m e d

b a s e d on

s a i d

s e c o n d document

o b j e c t

i s f u r t h e r c o m p r i s e d

o f

t h e s t e p

o f d e t e r m i n i n g t h a t

s a i d

s e c o n d d o c u m e n t o b j e c t

i s a n e X i s t i n g document c o l l e c t i o n a n d a d d i n g s a i d ? r s t

d o c u m e n t

o b j e c t

t o

s a i d

e X i s t i n g d o c u m e n t c o l l e c t i o n .

1 4 . o m p u t e r c o n t r ol l e d d i s p l a y

s y s t e m f o r

d i s p l a y i n g

document

o b j e c t s i n a


document

Work

s p a c e

on a d i s p l a y ,

s a i d c o m p u t e r c o n t r o l l e d d i s p l a y

s y s t e m


document r e c e i v i n g

means

f o r

r e c e i v i n g document

o b j e c t s ;


means

o r r e c e i v i n g u s e r i n p u t f o r p o s i t i o n i n g

document o b j e c t s W i t h i n s a i d t h r e e - d i m e n s i o n a l d o c u




5 8 3 8 3 2 6

1 3

1 4

W o r k s p a c e a n d

s a i d


s a i d

W o r k s p a c e a

s e l e c t i o n means

f o r

s e l e c t i n g

a document o b j e c t ; a n d

d i s p l a y

c i r c u i t r y c o m p r i s i n g : means f o r i n d i c a t i n g a d e s t i n a t i o n f o r a s e l e c t e d document


d i s p l a y i n g

a

f o c u s s p a c e s a i d f o c u s s p a c e

o b j e c t

f o r

d e t a i l

d i s p l a y o f

a

document

o b j e c t ;

1 6 . The

c o m p u t e r


s y s t e m a s

r e c i t e d i n

C i r c u i t r y f o r

d i s p l a y i n g a n i m m e d i a t e

S p a c e s a i d

imme-

5

c l a i m 1 5 W h e r e i n

s a i d s e l e c t i o n mea ns i s C O I I l p I ‘ l S G d

O f

d i a t e

s p a c e

f o r

e p h e m e r a l

p o s i t i o n i n g o f

document



a

c u r s o r

on

a

document

o b j e c t

a n d

o b j e c t s t h a t a r e i n u s e b u t n o t i n f o c u s ; and i n V O k i n g a S e l e c t O p e r a t i o n and

c i r c u i t r y

f o r d i s p l a y i n g a t e r t i a r y s p a c e

s a i d

t e r t i a r y

s a i d means

f o r

i n d i c a t i n g

a


f o r a

s e l e c t e d


document

o b j e c t s t h a t a r e

n o t

document

o r

document

c o l l e c t i o n i s c o m p r i s e d o f c i r

i n u s e .

1 0

c u i t r y f o r


s a i d

c u r s o r

at a

d e s i r e d

l o c a t i o n

1 5 . The c o m p u t e r

c o n t r o l l e d d i s p l a y s y s t e m

a s r e ci t e d i n

a n d

i n v o k i n g a

m o v e

o p e r a t i o n .

c l a i m 14 Wherein

s a i d p o s i t i o n i n g m e a n s

i s f u r t h e r c o m

p r is e d

o f :




Exhibit B




US005 847709A

United States Patent [ 1 9 ]

[ 1 1 ] P a t e n t

N u m b e r : 5 , 8 4 7 , 7 0 9

Card e t a l . [ 4 5 ]

Date

o f P a t e n t : * D e c . 8 ,

1 9 9 8

[ 5 4 ]

3-D DOCUMENT

WORKSPACE

WITH FOREIGN PATENT DOCUMENTS

[ 7 5 ]

FOCUS IMMEDIATE

AND

TERTI RY

SPACES

9322738 11/1993 WIPO . . . . . . . . . . . . . . . . . . . . . . . . . . G06F 15/62

OTHER PUBLICATIONS

B a l l a y ,

J . M . , “ D e s i g n i n g W o r k s p a c e T M : An

n t e r d i s c i p l i n a r y

E x p e r i e n c e , ” Human

F a c t o r s i n C o m p u t i n g S y s t e m s , CHI

’ 9 4 ,

C o n f e r e n c e P r o c e e d i n g s , p p . 1 0 — 1 5 .

M a n d e r , R . , S a l o m o n , G . , a n d W o n g , Y . Y . , “A

i l e ’

M e t a

p h o r f o r S u p p o r t i n g

C a s u a l

O r g a n i z a t i o n o f

I n f o r m a t i o n , ”

Human

a c t o r s i n

Computing y s t e m s , CHI ’ 9 2 C o n f e r e n c e

P r o c e e d i n g s , May 3 — 7 , 1 9 9 2 ,

p p .

6 2 7 — 6 3 4 .

S t a p l e s , L . ,

“ R e p r e s e n t a t i o n i n V i r t u a l S p a c e : V i s u a l

Con

v e n t i o n i n t h e G r a p h i c a l

U s e r

I n t e r f a c e , ” Human

a c t o r s

i n

C o m p u t i n g S y s t e m s , I n t e r c h i ’ 9 3

C o n f e r e n c e P r o c e e d i n g s ,

A p r . 2 4 — 2 9 , p p . 3 4 8 — 3 5 4 .

H o r n , R . E . ,

M a p p i n g H y p e r t e x t : A n a l y s i s ,

L i n k a g e , a n d

D i s p l a y

o f

Knowledge

o r

t h e

N e x t

G e n e r a t i o n

o f

On—Line

T e x t a n d G r a p h i c s , 1 9 8 9 ,

T h e

L e x i n g t o n

I n s t i t u t e ,

L e x i n g

t o n , MA.

P r i m a r y

Examiner—John

E .

B r e e n e

A t t o r n e y , A g e n t , o r Firm—Richard

B .

Domingo

[ 5 7 ]

ABSTRACT

A h r e e d i m e n s i o n a l

d o c u m e n t W o r k s p a c e f o r

i n t e r a c t i n g

W i t h l a r g e n u m b e r s o f d o c u m e n t o b j e c t s . Adocument

o b j e c t

may e a

document

o r a

document


document

W o r k s p a c e i s d i v i d e d

h i e r a r c h i c a l l y

i n t e r m s o f


r a t e s . A

o c u s s p a c e i s

Where d i r e c t


With a

document o r document

c o l l e c t i o n

o c c u r s . An

immediate

memory

s p a c e o r d e s k t o p

i s

f o r

p l a c i n g

p a g e s

o r

books

t h a t

a r e i n u s e , b u t n o t c u r r e n t l y b e i n g i n t e r a c t e d W i t h . A e r t i a r y

s p a c e o r

bookcase

i s Where many book s and pages t h a t a r e

n o t

i n

u s e , b u t Which t i s d e s i r a b l e t o have r e a d y a c c e s s t o .

Moving d o c u m e n t

o b j e c t s

i n

t h e

d o c u m e n t W o r k s p a c e i s


b y

t o u c h - d r o p a n d ? i c k g e s t u r e s .

T h e

t o u c h - d r o p

g e s t u r e

a d d r e s s e s t h e p r o b l e m o f o b s c u r i n g d i s t a n t h e n c e

s m a l l e r ) d o c u m e n t o b j e c t s b y p r e s e n t i n g a v i s u a l

l i n e i n d i

c a t i n g

a d e s t i n a t i o n f o r a

moved document

o b j e c t .

F l i c k

g e s t u r e s

a r e

u s e d t o q u i c k l y move


W i t h i n

t h e document W o r k s p a c e .

A s e r

may c h a n g e t h e i r vieW

o f

t h e document W o r k s p a c e i n

o r d e r t o vieW

i f f e r e n t p o r t i o n s

o f

t h e Workspace i n more d e t a i l .

1 2 C l a i m s ,

1 1

Drawing

S h e e t s

I n v e n t o r s :

S t u a r t K . C a r d , L o s A l t o s

H i l l s ,

C a l i f . ;

G e o r g e G . R o b e r t s o n , R e d m o n d ,

W a s h . ; W i l l i a m M.

Y o r k ,

L o s A l t o s ,

C a l i f .

A s s i g n e e :

X e r o x C o r p o r a t i o n , S t a m f o r d , C o n n .

N o t i c e : The t e r m

o f t h i s

p a t e n t s h a l l n o t e x t e n d

b e y o n d

t h e e x p i r a t i o n d a t e

o f P a t . N o .

5 , 8 3 8 , 3 2 6 .

A p p l . N o . : 7 2 1 , 2 9 3

F i l e d :

S e p .

2 6 ,

1 9 9 6

Int. Cl.6 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

G06F /00

US.

l . 345/355;

345/351;

345/329;

3 4 5 / 3 5 8 ; 3 4 5 / 9 7 6

Field o f

Search

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 345/326—358

3 4 5 / 9 7 6 ; 7 0 7 / 5 2 6 , 5 1 4 , 5 0 0 , 5 0 1 ,

5 1 3

R e f e r e n c e s C i t e d

U . S . PATENT DOCUMENTS

5 060 135 10/1991 Lev ine . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 345/351

5 , 1 4 0 , 6 7 7 8/1992 Fleming e t a l . 395/159

5 295 243 3/1994 Robertson e t a l . . . . . . . . . . . . . . . . . . . . 345/355

5 347 295

9/1994 Agulnick

e t

a l .

. . . . . . . . . . . . . . . . .

345/358

X

5 , 3 5 9 , 7 0 3 1 0 / 1 9 9 4 R o b e r t s o n e t a l . 3 4 5 / 3 5 5 X

5 381 158

1/1995

Takahara e t a l . 345/355 X

5 386 507 1/1995 Teig e t a l . 345/355 X

5 , 4 5 2 , 4 1 4

9 / 1 9 9 5

R o s e n d a h l

e t

a l .

3 4 5 / 3 5 5 X

5 463 722

10/1995

Venolia . . . . . . . . . . .

345/355 x

5 499 330

3/1996

Lucas e t

a l .

345/355

X

5 , 5 0 0 , 9 3 5 3 / 1 9 9 6 Moran e t a l . 3 4 5 / 3 5 8 X

5 , 5 0 9 , 1 1 4 4 / 1 9 9 6

Moran

e t a l . 3 4 5 / 3 5 8

X

5 , 5 4 6 , 5 2 9 8 / 1 9 9 6 Bowers e t

a l .

3 4 5 / 3 5 5

X

5 555 354

9/1996

S t r a s n i c k

e t

a l . 345/355 X

5 602 564 2/1997 Iwamura

e t

a l .

345/355

X

5 608 850

3/1997

Robertson . . . . . . .

345/355

X

5 634 095 5/1997 Wang t al. .. 345/326

5 , 6 7 0 , 9 8 4 9 / 1 9 9 7 R o b e r t s o n e t

a l .

3 4 5 / 3 5 5

X

5 678 015 10/1997 G011

.........................

345/355

5 689 628

11/1997 Robertson

. . . . . . . . . . . . . . . . . . . . . . . . .

345/355

X

W 9 ’

2 0 3

K

E

o c u m e n t

C o l l e c t l n n

lJOwmeM

C o l l e c t l o n I—

D o c u m e n t D o c u m e l l l

C n l l e c l l o n ’_ b j e c t

2 0 5 1 : 066mm _/

O b j e c t

T l e r

2 0 5

T l e r

C o l l e c t l o n

2 0 4 0

2 0 1

D o c u m e n t

0mm

2 0 4 3

\ Desk




U.S.

Patent D e c

s , 1 9 9 8

S h e e t

1 0 f 1 1 5 847 709

I N T E R N A L NETWORK

P R O Q E Z S S O R

M E M O R Y C O N N E C T I O N

1 0 3 1 0 8

V W V

BUS

1 0 1

V

V

V

CURSOR

K E Y B O A R D E S § B E R A E L C O N T R O L D I S P L A Y

1 0 4 1 0 5 D E 1 \ / ) | é 3 E 1 0 7

F I G .




U.S.

Patent D e c s

1 9 9 8

S h e e t

2 0 f 1 1 5,847,709

u

m

n

w m o x o o m

m

6 0 : 8

m

u

g g

1 .

m o wuo w

m

w o w

5 8 : 8 3 8 : 8

e w“ _ _ < _ _

l z m e b p n1 . 6 3

m mQ I




S h e e t

3

0 f 1 1S

P a t e n t

5 , 8 4 7 , 7 0 9

I

/ / / / / / / / / / / , .

D e c 8 ,

1 9 9 8

a m

E




U.S.

Patent D e c .

s 1 9 9 8 S h e e t 4 0 f 1 1 5 847 709

/

\

\

\\

\

\

/ / /




U.S.

Patent D e c s

1 9 9 8

S h e e t

5 0 f 1 1 5 847 709







D e c s

1 9 9 8 S h e e t

7

0 f 1 1

5 847 709

//

U S

P a t e n t




U.S.

Patent

D e c . s

1 9 9 8

S h e e t 8 0 f 1 1 5 847 709

E T J

x

\

\ \ \

F I G




US

P a t e n t

D e c 8

1 9 9 8

S h e e t

9

0 f 1 1

5 8 4 7 7 0 9

/

F I G




U.S.

Patent D e c

s 1 9 9 8 S h e e t

1 0

0 f

1 1 5 847 709

9 z

m

Q I




U.S.

Patent D e c

s 1 9 9 8

S h e e t 1 1

0 f

1 1 5 847 709

1 0 0 1

1002\ _

F I G . 1 0

1 1 0 1

_

\1102

1002\

1 2 K




5 , 8 4 7 , 7 0 9

1

3-D

DOCUMENTWORKSP CE

WITH

FOCUS,

IMMEDI TE

ND

TERTI RY

SP CES

CROSS

REFERENCE TO REL TED

PPLIC TION

T h e p r e s e n t


i s

r e l a t e d

t o

c o - p e n d i n g

US.

p a t e n t


S e r . N o .

0 8 / 7 2 1 , 3 0 2 ,

e n t i t l e d “ S y s t e m F o r

Moving Document O b j e c t s

I n

h r e e - D i m e n s i o n a l Docu

m e n t W o r k s p a c e ” ? l e d c o n c u r r e n t l y W i t h t h e p r e s e n t a p p l i

c a t i o n .

1 .

F i e l d

o f t h e I n v e n t i o n

The

p r e s en t i n v e n t i o n i s

r e l a t e d t o t h e

? e l d

o f c o m p u t e r

u s e r i n t e r f a c e s , and i n p a r t i c u l a r ,

a

u s e r

i n t e r f a c e

f o r

d i s

p l a y i n g a n d n a v i g a t i n g t h r o u g h c o l l e c t i o n s o f r e l a t e d

d o c u

ments.

2 . B a c k g r o u n d

Access

t o

and u s e o f e l e c t r o n i c documents i s groWing a t

a v e r y e x p l o s i v e

p a c e .

To

f a c i l i t a t e

u s e

o f

l a r g e


o f e l e c t r o n i c

d o c u m e n t s , n eW

t e c h n i q u e s f o r

q u e r y i n g a n d

v i s u a l i Z i n g t h e

c o n t e n t o f

s u c h c o l l e c t i o n s

a r e b e i n g

d e v e l

o p e d .

F o r e x a m p l e , US. P a t .

N o . 5 , 5 4 6 , 5 2 9 ,

d e s c r i b e s a

t e c h n i q u e

f o r

v i e W i n g t h e r e s u l t s

o f

a

d a t a b a s e s e a r c h t h a t

h a s been m a ppe d

t o

a t r e e

s t r u c t u r e .

T h e t r e e s t r u c t u r e

i s

v i s u a l l y

mapped a l o n g

a

s t a t i c r e f e r e n c e s u r f a c e

h a v i n g

s e p a r a t e

d e t a i l

and

c o n t e x t a r e a s .

One

s o u r c e

o f

t h e

groWth o f a c c e s s

t o

e l e c t r o n i c

d oc u

m e n t s i s t h e I n t e r n e t , a n d i n p a r t i c u l a r , t h e f a c e t

o f

t h e

I n t e r n e t knoWn a s t h e World-Wide

W e b

r e f e r r e d

t o

s i m p l y

a s t h e Web). The W e b

p r o v i d e s

a

means

f o r making

m u l t i

media s t y l e d

documents

o v e r

t h e

I n t e r n e t . These

documents

a r e

t e r m e d

We b

p a g e s

h e r e i n a f t e r

p a g e s ) .

P a g e s may

r e f e r

t o

and

p r o v i d e a c c e s s t o o t h e r

pages

on

t h e W eb.

Each page

has a s s o c i a t e d With i t an i d e n t i ? e r termed a

Uniform

R e s o u r c e L o c a t o r U R L ) . a g e i s

a c c e s s e d

b y s p e c i f y i n g

i t ’ s

URL.

The

c o n t e n t s

o f

a page i s s p e c i ? e d i n a do cumen t

f o r m a t t i n g

l a n g u a g e

knoWn

a s

t h e

H y p e r - T e x t Mark-Up

Language HTML). e f e r e n c e

t o a n o t h e r p a g e

on

t h e W e b

i s termed a l i n k . Links m a y b e s p e c i ? e d i n e i t h e r a b s o l u t e o r

r e l a t i v e t e r m s . Alink

s p e c i ? e d

i n

a b s o l u t e

t e r m s r e f e r s

t o

i t ’ s

e n t i r e URL.

i n k

speci?ed i n r e l a t i v e

t e r m s

assumes a

c e r t a i n p o r t i o n

o f

t h e URL

s

t h e same

a s

t h e ex i s t i n g p a g e .

The

s p e c i ? c a t i o n i s t h u s

r e l a t i v e

t o

t h e URL f t h e page

on

Which t i s

d e ? n e d .

T o access an d v i eW a d o c u m e n t o n

t h e W eb,

a Web

b r o W s e r i s

n e e d e d .

Web

r o W s e r

p r o v i d e s

s e a r c h ,

t r a v e r s a l

and vieWing

f u n c t i o n s needed t o a c c e s s

documents on t h e

Web. V a r i o u s W e b b r o W s e r s

e x i s t

f o r t h e Web, . g . N e t S c a p e

a v a i l a b l e f r o m N e t S c a p e , I n c .

o f


T r a v e r s i n g

t h r o u g h d o c u m e n t s c o n t a i n e d on t h e W e b i s

s i m i l a r t o f o l l o W i n g a p a t h

t h r o u g h

a n e t W o r k . S i n c e e a c h

p a g e m a y c o n t a i n l i n k s t o ma n y

o t h e r

p a g e s ,

t r a v e r s i n g

t h r o u g h t h e p a g e s i s a s i m p l e

m a t t e r

o f f o l l o W i n g t h e l i n k s .

Most We b b r o W s e r s p r o v i d e

c o n t r o l s f o r

g o i n g

b a c k W a r d s

a n d

f o r W a r d s i n

t h e

l i s t o f

l i n k s .

They

a l s o

m a i n t a i n a h i s t o r y

l i s t o f t h e

l i n k s

t o e n a b l e

jumping

d i r e c t l y t o a s p e c i ? c

p r e v i o u s l y

v i e W e d

p a g e .

M o s t p u b l i c l y

a v a i l a b l e

Web roWsers

o p e r a t e

on a com

p u t e r


s y s t e m h a v i n g a g r a p h i c a l u s e r

i n t e r f a c e

W i t h

m u l t i p l e

W i n d o W s .

T y p i c a l l y ,

s u c h Web

b r o W s e r s

o p e r a t e

s u c h

t h a t

a

W i n d o W

m a y d i s p l a y

o n l y o n e

p a g e

a t

a

t i m e .

M u l t i p l e

p a g e s a r e vieWed by o p e n i n g

10

1 5

20

25

30

35

40

45

55

60

2

p r o v i d e

r e n d e r i n g m e a n s f o r v i e W i n g a u d i o , v i d e o a n d

g r a p h i c a l p o r t i o n s o f

documents

a s

W e l l

a s a g r a p h i c a l u s e r

i n t e r f a c e f o r c o n t r o l l i n g

a c c e s s

t o d o c u m e n t s . The

g r a p h i c a l

u s e r

i n t e r f a c e i s t y p i c a l l y o n e

Which p r o v i d e s f o r v er t i c a l

a n d

h o r i Z o n t a l

s c r o l l i n g

v i a s c r o l l b a r s

a n d

p o i n t

a n d

c l i c k

manipulation

o f

a

c u r s o r

c o n t r o l

d e v i c e

t o

invoke broWse r

o p e r a t i o n s eg t o t r a v e r s e l i n k s .

C o l o r , u n d e r l i n i n g o r

r e v e r s e

v i d e o a r e t e c h n i q u e s

used

t o

i n d i c a t e t h e e x i s t e n c e o f

a link on a

page.

R e l a t e d m a t e r i a l s i n c l u d e :

D e c k s c a p e : A n E x p e r i m e n t a l Web B r o W s e r , Marc H .

BroWn

a n d R o b e r t

A . S h i l l n e r , DEC

S y s t e m s

R e s e a r c h

C e n t e r

R e p o r t

1 3 5 a ,

M a r . 1 , 1 9 9 5 . T h e D e c k S c a p e Web

broWser

u t i l i Z e s

t h e

metaphor o f a deck

a s

a

c o l l e c t i o n

o f

Web

a g e s . Only

one Web page

o n

a

deck

i s v i s i b l e a t one

t i m e , a l t h o u g h

m u l t i p l e d e c k s may b e v i s i b l e .

D e c k S c a p e

i s

a l s o m u l t i t h r e a d e d s o t h a t e a c h deck

m a y

be

“ a c t i v e ” ,

e . g .

doWnloading a g e s , a t

t h e

sa me t i m e .

A d e c k

m a y

b e

c r e a t e d

based

o n a t r a v e r s a l through

t h e

Web

r

a s

t h e r e s u l t

of

an

o p e r a t i o n s u c h a s

“ e x p a n d

a l l

t h e l i n k s o n

t h i s p a g e . ”

US.

P a t .

N o .

5 , 4 9 9 , 3 3 0

e n t i t l e d

Document

D i s p l a y S y s

tem F o r O r g a n i Z i n g A n d D i s p l a y i n g Documents

As S c r e e n

O b j e c t s O r g a n i Z e d A l o n g S t r a n d

P a t h s .

As d e s c r i b e d i n t h e

A b s t r a c t , t h i s

r e f e r e n c e s

d i s c l o s e s

a s y s t e m f o r

d i s p l a y i n g

documents

i n a

c o m p u t e r

c o n t r o l l e d d i s p l a y d e v i c e .

“The

s y s t e m

d i s p l a y s d o c u m e n t s e i t h e r i n a

c o m p l e t e l y f r e e - f o r m ,

a

u s e r c o n t r o l l e d

con?guration

o r

a s s t r a n d s ,

such t h a t

documents i n

a

s t r a n d

f o l l o W a

s t r a n d p a t h . The s t r a n d

p a t h

i s

a

tWo

dimensional

l i n e

through a t h r e e dimensional

d i s p l a y

s p a c e .

The

documents d i s p l a y e d on t h e s t r a n d a r e

k n o W n

a s c h i l d

documents, and e a c h

s t r a n d

a l s o h a s a

p a r e n t

document.

V a r i o u s

c o n s t r a i n t s de?ning

t h e s t r a n d

a r e

a s s o

c i a t e d

W i t h

t h e

p a r e n t

d o c u m e n t ,

i n c l u d i n g

a s t r a n d

f u n c t i o n

d e ? n i n g t h e

s t r a n d

p a t h , minimum a n d maximum s e p a r a t i o n

c o n s t r a i n t s d e ? n i n g t h e d i s t a n c e

b e t W e e n

t h e c h i l d

d o c u

ments on t h e s t r a n d , a n d

a n

o r i g i n c o n s t r a i n t d e ? n i n g t h e

p o s i t i o n a l

r e l a t i o n s h i p o f

t h e s t r a n d p a t h

t o

t h e s c r e e n o b j e c t

o f t h e p a r e n t d o c u m e n t . ”

P i l e ’ M e t a p h o r

f o r

S u p p o r t i n g C a s u a l O r g a n i Z a t i o n o f

I n f o r m a t i o n , R i c h a r d M a n d e r , G i t t a S a l o m a n , Y i n Y i n

Wong, C h i

’ 9 2 C o n f e r e n c e

P r o c e e d i n g s ,

CM o n f e r e n c e

on

H u m a n F a c t o r s

i n

Computing S y s t e m s , p g s

6 2 7 — 6 3 4 ,

M ay 3 — 7 , 1 9 9 2 . T hi s

a r t i c l e

d e s c r i b e s t h e d e s i g n

a n d

d e v e l

opment

o f a

d e s k t o p i n t e r f a c e

e l e m e n t

r e f e r r e d t o a s p i l e s .

P i l e s r e p r e s e n t

s e t s o f r e l a t e d d o c u m e n t s . These

p i l e s a r e

a n a l o g o u s t o

s t a c k s o f p a p e r o f t e n found

i n

a p e r s o n s o f ? c e

o r

Workspace. P i l e s

We re

observed t o have t h e

u s e f u l

prop

e r t i e s o f b e i n g a l e s s r i g i d c a t e g o r i Z a t i o n s y s t e m a n d t o b e

s e l f - r e v e a l i n g a n d

b r o W s a b l e . T h e d e s c r i b e d d e s i g n

i n c l u d e s

d i r e c t m a n i p u l a t i o n

t e c h n i q u e s

a n d

s u p p o r t

f o r b r o W s i n g ,

a u t o m a t i c p i l e c o n s t r u c t i o n a n d

r e o r g a n i Z a t i o n .

R e p r e s e n t a t i o n

i n V i r t u a l S p a c e : V i s u a l

C o n v e n t i o n i n

t h e

G r a p h i c a l U s e r

I n t e r f a c e ,

L o r e t t a S t a p l e s , Hu m a n

F a c t o r s

i n

Computing Systems

INTERCHI’93

Conference

P r o c e e d i n g s ,

p g s

3 4 8 — 3 5 4 , A p r . 2 4 — 2 9 1 9 9 3 . T h i s a r t i c l e s

d e s c r i b e s t h e

use o f

t h r e e

dimensional v i s u a l cues o f p e r

s p e c t i v e and l i g h t i n g , i n t h e

c o n t e x t

o f ? a t o r tWo

dimensional

Workspace.

T h e use of transparency

a s a

m e a n s

o f e n h a n c i n g

t h e W o r k s p a c e i s

a l s o

d e s c r i b e d . e s k t o p

“ l a n d s c a p e ” i s

p r o p o s e d

t h a t i s d i v i d e d by a h o r i Z o n l i n e

d e n o t i n g tWo s e p a r a t e

a r e a s :

a n

a c t i v e

f o r e g r o u n d

s p a c e

a n d

a p a s s i v e b a c k g r o u n d s p a c e .




5 , 8 4 7 , 7 0 9

3

document

o b j e c t

i s a

g r a p h i c a l r e p r e s e n t a t i o n o f

a n i n d i

v i d u a l d o c u m e n t o r

a

d o c u m e n t


d o c u m e n t

W o r k s p a c e

h a s

b e e n i m p l e m e n t e d

f o r u s e t o d i s p l a y

a n d

i n t e r a c t W i t h d o c u m e n t s , t y p i c a l l y

Web

p a g e s ,

t h a t h a v e

b e e n

doWnloaded from t h e World

Wide Web.

HoWever, t h e docu

ment

Workspace

s

a l s o s u i t a b l e f o r

u s e

t o

d i s p l a y documents

o r d o c u m e n t


o b t a i n e d fro m o t h e r s o u r c e s e g

f r om a

CD-ROM). Docum e n t c o l l e c t i o n s

a r e

t y p i c a l l y i n t h e

fo rm

o f

W e b B o o k s o r

p i l e s .

W e b B o o k s a r e d o c u m e n t c o l

l e c t i o n s

t h a t

a r e

r e p r e s e n t e d t o

a

u s e r u s i n g

a

b o o k m e t a p h o r .

A

i l e

i s

a


o f a

document

c o l l e c t i o n t h a t

r e s e m b l e s a p i l e

o f

p a p e r

c o n t a i n e d

i n a p a p e r t r a y . Apile i s

c r e a t e d

by

moving

o n e document

o b j e c t

on

t o a n o t h e r

d o c u m e n t

o b j e c t .

T h e d o c u m e n t W o r k s p a c e i s

d i v i d e d

h i e r a r c h i c a l l y i n

t e r m s o f i n t e r a c t i o n r a t e s . o c u s s p a c e

i s

Where d i r e c t

i n t e r a c t i o n With a d o c u m e n t

o b j e c t

o c c u r s . The i n t e r a c t i o n s

o c c u r s i n a m a n n e r s u i t a b l e f o r t h e d o c u m e n t o b j e c t i n t h e

f o c u s s p a c e .

The

f o c u s

s p a c e i s g e n e r a l l y t h e c e n t e r o f t h e

d i s p l a y

a r e a

A n

i m m e d i a t e m e m o r y

s p a c e

i s

f o r

p l a c i n g


t h a t a r e

i n

u s e ,

b u t n o t c u r r e n t ly b e i n g

i n t e r a c t e d W i t h . V i s u a l l y i n

t h e

d o c u m e n t W o r k s p a c e

t h e

immediate m e m o r y s p a c e i s

d i v i d e d

i n t o

a n

“ a i r ”

s p a c e

and

a “ d e s k ” .

The d e s k i s

a f a m i l i a r metaphor f o r p l a c i n g

d o c u m e n t s o n t h a t

a r e n o t c u r r e n t l y

b e i n g v i e W e d ,

b u t a r e i n

u s e . The “ a i r ” i s l o c a t e d

“ b e h i n d ”

t h e f o c u s s p a c e . The “ a i r ”

i s f u r t h e r d i v i d e d i n t o s u b a r e a s . Each o f t h e s u b a r e a s c o r

r e s p o n d s

t o

a d i s t a n c e b a c k i . e . i n t h e Z - d i r e c t i o n ) i n

W h i c h

t h e d o c u m e n t o b j e c t

i s

p o s i t i o n e d . T h e f u r t h e r b a c k , t h e

s m a l l e r

t h e

s i Z e o f t h e


o f


o b j e c t .

A

e r t i a r y s p a c e i s W h e r e m a n y

document

o b j e c t s , eg

W ebB o o k s

and

f r e q ue n t l y r e f e r e n c e d

d o c u m e n t s

t h a t

a r e

n o t

c u r r e n t l y

i n

u s e

m a y

b e p o s i t i o n e d .

T h e

t e r t i a r y

s p a c e i s

v i s u a l l y

r e p r e s e n t e d

a s

a

b o o k s h e l f .

Moving d o c u m e n t o b j e c t s

i n


W o r k s p a c e

i s


by

a t o u c h a n d d r o p g e s t u r e . W h e n a

document

o b j e c t i s t o u c h e d ,

and a

b u t t o n

o n

t h e a s s o c i a t e d

c u r s o r

c o n t r o l d e v i c e r e m a i n s d e p r e s s e d , a

l i n e

i s dr aWn

t o

i n d i c a t e

Where t h e o b j e c t i s t o b e d r o p p e d . T h i s h e l p s f a c i l i t a t e

a

d e t e r m i n a t i o n

o f W h e r e t h e document

o b j e c t i s

t o

b e p l a c e d .

Docum e n t

o b j e c t s m a y a l s o

b e

? i c k e d

t o t h e i m m e d i a t e

a n d

t e r t i a r y

a r e a s s o

a s t o p e r m i t r a p i d m o v e m e n t o f t h e d o c u

m e n t o b j e c t s .

BRIEF DESCRIPTION OF

THE

DRAWING

F I G .

1

i s

a

b l o c k d i a g r a m

o f a computer c o n t r o l l e d

d i s p l a y

s y s t e m a s

m a y

b e u t i l i Z e d i n

t h e c u r re n t l y p r e f e r r e d embodi

ment

o f

t h e

p r e s e n t

i n v e n t i o n .

F I G . 2a i l l u s t r a t e s t h e d e f a u l t vieW

o f

t h e

document

W o r k s p a c e


e m b o d i m e n t o f

t h e


F I G .

2b

i l l u s t r a t e s

t h e d e f a u l t

vieW o f

t h e document

Wor k s p ace

With a r e c e i v e d

page

a r e a .

F I G .

3

i s a n i l l u s t r a t i o n o f a vieW

shoWing

t h e

t e r t i a r y

s p a c e i . e .

t h e

b o o k c a s e ) i n

t h e

f o c u s s p a c e o f

t h e

d o c u m e n t

W o r k s p a c e .

FIGS.

4—5

i l l u s t r a t e a

t o u c h d r o p

g e s t u r e

a s m a y be

p e r f o r m e d

i n

t h e d o c u m e n t W o r k s p a c e

o f

t h e

c u r r e n t l y

p r e f e r r e d

e m b o d i m e n t

o f

t h e

p r e s e n t

i n v e n t i o n .

FIGS.

6—7 i l l u s t r a t e t h e

c o n t e X t

s e n s i t i v e n a t u r e

o f

t h e

t o u c h d r o p

g e s t u r e a s

m a y

b e p e r f o r m e d

i n t h e

document

W o r k s p a c e


e m b o d i m e n t

o f t h e


10

1 5

25

35

45

55

4

FIGS.

10—12 i l l u s t r a t e t h e c r e a t i o n

o f p i l e s a s

m a y

b e

p e r f o r m e d

i n


W o r k s p a c e

o f t h e c u r r e n t l y


t h e


DETAILED

DESCRIPTION

OF THE

INVENTION

A

o m p u t e r c o n t r o l l e d d i s p l a y

s y s t e m

f o r d i s p l a y i n g a

t h r e e d i m e n s i o n a l

document Workspace

i s d i s c l o s e d . One

o r

m o r e d o c u m e n t s o b j e c t s a r e

p r e s e n t

i n t h e

d o c u m e n t W o r k

s p a c e .

The

p r e s e n t i n v e n t i o n p r o v i d e s f o r i n t e r a c t i o n W i t h

t h e c o l l e c t i o n s ,

e . g .

v i e W i n g , m o v i n g a n d s t o r i n g ,

W h i l e

b a l a n c i n g t h e n e c e s s a r y t r a d e o f f s o f

r a p i d

a c c e s s ,

number

o f


a n d

a s s o c i a t e d

d o c u m e n t s ,

and a v a i l a b l e s c r e e n

s p a c e .

T h e c u r r e n t l y

p r e f e r r e d

e m b o d i m e n t o f

t h e p r e s e n t

i n v e n

t i o n

i s

i m p l e m e n t e d f o r

u s e W i t h c o l l e c t i o n s o f

p a g e s

i . e .

d o c u m e n t s ) o b t a i n e d

f r o m t h e

p o r t i o n o f


k n oWn

a s t h e

World

Wide W e b h e r e i n a f t e r t h e

W e b ) .

H o W e v e r , t

s h o u l d b e

n o t e d t h a t t h e p r e s e n t i n v e n t i o n

i s

n o t

l i m i t e d

t o

u s e

on t h e

Web

and

m a y

be

u t i l i Z e d i n

any system

Which

p r o v i d e s a c c e s s t o


o f d o c u m e n t s . F o r e x a m p l e ,

t h e p r e s e n t i n v e n t i o n m a y

b e

u s e d i n

a

s y s t e m W h e r e i n

d o c u m e n t s

a r e o b t a i n e d through a CD ROM e d i a .

The f o l l o W i n g

terms d e? ne d

h e r e i n

a r e

f a m i l i a r

t o u s e r s

o f

t h e W e b a n d

t a k e

on

t h e s e

f a m i l i a r m e a n i n g s :

W o r l d - W i d e

Web

r

Web

The p o r t i o n o f t h e I n t e r n e t t h a t i s used t o

s t o r e and a c c e s s

l i n k e d m u l t i - m e d i a d o c u m e n t s .

P a g e

A ocument a c c e s s i b l e on t h e Web. A age m a y

have

multi-media c o n t e n t a s Well

a s

r e l a t i v e a n d

a b s o l u t e

l i n k s t o

o t h e r

p a g e s .

L i n k

An

n d i c a t o r

o n

a

Web

age

Which

r e f e r s

t o

a n o t h e r

Web

page

a n d Which c a n t y p i c a l l y b e r e t r i e v e d

i n a

p o i n t a n d

c l i c k

f a s h i o n . The L i n k W i l l s p e c i f y

t h e

Uniform

R e s o u r c e

L o c a t o r URL) o f t h e

o t h e r

W e b p a g e .

Web BroW s e r o r BroW s e r

o o l

Which

e n a b l e s a

u s e r

t o t r a v e r s e through and

vieW

documents r e s i d i n g on t h e Web.

O t h e r r e n d e r i n g

m e a n s

a s s o c i a t e d

W i t h

t h e B r o W s e r W i l l p e r m i t l i s t e n i n g t o a u d i o

p o r t i o n s o f a document o r

v i e W i n g v i d e o o r image

p o r t i o n s

of

a d o c u m e n t .

W e bB o o k

A e p r e s e n t a t i o n

o f

a n a g g r e g a t i o n

o f W e b

p a g e s Which

p r o v i d e s

r a p i d

l o c a l i n t e r a c t i o n .

WebBooks

a r e


f u r t h e r

i n

c o - p e n d i n g a p p l i c a t i o n

S e r .

N o . 0 8 / 5 2 5 , 9 3 6

e n t i t l e d

“ D i s p l a y

S y s t e m

F o r D i s p l a y i n g

L i s t s

Of

L i n k e d

Documents” ? l e d S e p . 8 , 1 9 9 5 , Which s a s s i g n e d

t o

t h e same

a s s i g n e e o f t h e p r e s e n t a p p l i c a t i o n a n d W h i c h i s h e r e b y

i n c o r p o r a t e d b y r e f e r e n c e .

Document O b j e c t o r

O b j e c t

A n y g r a p h i c a l r e p r e s e n t a t i o n o f a n e n t i t y , eg

p a g e

o r

WebBook, i n t h e d o c u m e n t W o r k s p a c e .

The

c o m p u t e r b a s e d s y s t e m on Which t h e c u r r e n t l y

p r e

f e r r e d embodiment

o f t h e


m a y b e i m p l e

mented i s d e s c r i b e d W i t h r e f e r e n c e t o F I G . 1 .

The

computer

b a s e d

s y s t e m a n d a s s o c i a t e d

o p e r a t i n g

i n s t r u c t i o n s e . g .

s o f t W a r e ) e m b o d y c i r c u i t r y

u s e d

t o

i m p l e m e n t t h e

p r e s e n t

i n v e n t i o n . R e f e r r i n g t o F I G . 1 ,

t h e

c o m p u t e r

b a s e d s y s t e m

i s

c o m p r i s e d o f a p l u r a l i t y o f c o m p o n e n t s c o u p l e d v i a a b u s

1 0 1 .

The

b u s

1 0 1 m a y

c o n s i s t o f

a p l u r a l it y

o f

p a r a l l e l

b u s e s

e . g . a d d r e s s , d a t a a n d s t a t u s

b u s e s )

a s W e l l a s a

h i e r a r c h y

o f

b u s e s e g

a

p r o c e s s o r

b u s , a

l o c a l b u s a n d a n I / O b u s ) . I n




5 , 8 4 7 , 7 0 9

5

memory 103

i s

t y p i c a l l y a

c o m b i n a t i o n o f Random

Access

a n d

Read O n l y

M e m o r i e s ) .

The p r o c e s s o r

1 0 2

W i l l

b e u s e d

t o

p e r f o r m

v a r i o u s o p e r a t i o ns

i n s u p p o r t

o f o b t a i n i n g Web

p a g e s ,

c o n v e r t i n g

eb

p a g e s i n t o a

s u i t a b l e f o r m a t

f o r

d i s p l a y

i n

t h e

d o c u m e n t W o r k s p a c e a n d

i n t e r p r e t i n g

a n d

c a r r y i n g o u t

movement

e s t u r e s .

I n s t r u c t i o n s

f o r

p e r f o r m i n g

s u c h o p e r a t i o n s a r e r e t r i e v e d from I n t e r n a l memory 1 0 3 .

The

r o c e s s o r

102

a n d

I n t e r n a l

memory

103 may

e

d i s c r e t e

components o r a

s i n g l e

i n t e g r a t e d d e v i c e s u c h a s

a n

Appli

c a t i o n

S p e c i ? c a t i o n

I n t e g r a t e d

C i r c u i t A S I C ) c h i p .

Also c o u p l e d t o

t h e

bus 101 a r e a keyboard 104 f o r

e n t e r i n g

a l p h a n u m e r i c i n p u t , e X t e r n a l

s t o r a g e

1 0 5 f o r s t o r i n g

d a t a , a c u r s o r c o n t r o l d e v i c e 106 f o r manipulating a

c u r s o r ,

a d i s p l a y 1 0 7 f o r

d i s p l a y i n g

v i s u a l o u t p u t e . g . t h e

d o c u m e n t

W o r k s p a c e ) a n d a n e t W o r k c o n n e c t i o n 1 0 8 .

The

k e y b o a r d

1 0 4

Would

t y p i c a l l y b e a s t a n d a r d QWERTY

e y b o a r d

b u t

may a l s o b e

a

t e l e p h o n e l i k e k e y p a d . The e X t e r n a l

s t o r a g e

105

may b e ?xed o r removable m a g n e t i c

o r o p t i c a l

d i s k

d r i v e .

T h e cursor c o n t r o l device 106, eg

a

mouse o r

t r a c k b a l l ,

W i l l t y p i c a l l y

h a v e

a

b u t t o n o r s W i t c h a s s o c i a t e d

W i t h i t t o Which t h e

p e r f o r m a n c e o f

c e r t a i n f u n c t i o n s

c a n b e

p r o g r a m m e d . I n t h e

c u r r e n t l y

p r e f e r r e d

embodiment

s u c h

a

s W i t c h W i l l have a ? r s t u p p o s i t i o n and a second doWn

p o s i t i o n

Which

a r e used t o s e l e c t and

move

document

o b j e c t s W i t h i n

t h e

document W o r k s p a c e . The n e t W o r k c o n

n e c t i o n 108

p r o v i d e s means f o r a t t a c h i n g t o a n e t W o r k ,

eg

a

Local Area

NetWork

LAN)

c a r d

o r modem

c a r d

W i t h

a p p r o p r i a t e s o f t W a r e . The

n e t W o r k

u l t i m a t e l y a t t a c h e d t o i s

t h e I n t e r n e t , b u t

i t

may

b e

t h r o u g h

i n t e r m e d i a r y n e t W o r k s

o r

On-Line s e r v i c e s s u c h

a s

America O n - Li n e , P r o d i g y

TM

r

CompuServ TM.

T h e c u r r e nt l y p r e f e r r e d e m b o d i m e n t o f

t h e p r e s e n t

i n v e n

t i o n

h a s

b e e n

i m p l e m e n t e d

on

a

S i l i c o n G r a p h i c s W o r k s t a

t i o n

W i t h

g r a p h i c s

f a c i l i t i e s

a s

d e s c r i b e d

i n

SGI G r a p h i c s

L i b r a r y P r o g r a m m i n g G u i d e , S i l i c o n G r a p h i c s , I n c . o f


The S i l i c o n

G r a p h i c s W o r k s t a t i o n

p r o v i d e s f o r g e n e r a t i n g s o f t W a r e

p r o g r a m s

W h i c h m a n i p u

l a t e g r a p h i c a l o b j e c t s i n a t h r e e d i m e n s i o n a l s p a c e , s o

d e s c r i p t i o n o f p r o g r a m m i n g t e c h n i q u e s

f o r

r e n d e r i n g

g r a p h i c a l o b j e c t s i n a

t h r e e


s p a c e i s n o t deemed

n e c e s s a r y .

I t

s h o u l d b e

n o t e d

t h a t

i t Would

have

been a p p a r e n t

t o

one

o f

s k i l l i n t h e a r t t o

implement

h e p r e s e n t i n v e n t i o n on o t h e r

s u i t a b l e c o m p u t e r s y s t e m s

p r o v i d i n g

f u n c t i o n a l i t y f o r

m a n i p u l a t i n g g r a p h i c a l o b j e c t s i n a

t h r e e

d i m e n s i o n a l s p a c e .

S u c h i m p l e m e n t a t i o n s W o u l d n o t d e p a r t f r o m t h e s p i r i t a n d

s c o p e

o f

t h e

p r e s e n t

i n v e n t i o n .

F i n a l l y ,

t h e


i s

impl emented on

a

com

p u t e r

c o n t r o l l e d

d i s p l a y

s y s t e m

h a v i n g

a

G r a p h i c a l

U s e r

I n t e r f a c e G U I ) . O p e r a t i o n s f o r moving p a g e s

o r

p a g e


i n

t h e GUI

have

been c r e a t e d t h a t s u p p o r t

u s e

i n

t h e

Document

o r k s p a c e . Such o p e r a t i o n s a r e

d e s c r i b e d

i n

g r e a t e r

d e t a i l b e l o W .

O t h e r o p e r a t i o n s

a r e invoked i n a

s i m i l a r f a s h i o n

and perform

a s i m i l a r

f u n c t i o n a s i n knoWn

GUIs. F or

e X a m p l e ,

t h e

a c t o f

“ t o u c h i n g ”

a document o r

document c o l l e c t i o n i s

a n a l o g o u s

t o “ s e l e c t i o n ” by p o i n t

and c l i c k o p e r a t i o n of

a


d e v i c e .

T h e Document

W o r k s p a c e

The p u r p o s e o f t h e document Workspace i s

t o

a l l o W

a

l a r g e

n u m b e r o f

d o c u m e n t

o b j e c t s

t o b e

d i s p l a y e d t o g e t h e r

m i t i g a t i n g t h e l i m i t a t i o n s

o f

t h e

s m a l l

s c r e e n s p a c e )

i n

o r d e r

t o

s u p p o r t i n f o r m a t i o n i n t e n s i v e

a c t i v i t i e s .

I n t e r a c t i o n

W i t h

pages i s

s i m i l a r t o t h e f u nc t i o n a l i t y

o f a Web r o W s e r .

The

W o r k s p a c e

s e t s

u p e x p l i c i t l y

t h e

c a p a c i t y f o r s p e e d / a c c e s s

10

1 5

25

35

45

55

6

n u m b e r .

P a g e s

f o r

o n g o i n g

a c t i v i t i e s m i g r a t e i n t o

t h e r a p i d

a c c e s s a n d

m a n i p u l a t i o n

r e g i o n i . e . t h e f o c u s r e g i o n

d e s c r i b e d b e l o W ) . I n

t h i s W a y ,

r e p e a t e d

r e f e r e n c e d u e t o

l o c a l i t y

o f

r e f e r e n c e s t a t i s t i c s c a n r e s u l t i n f a s t e r i n t e r a c t i o n .

I t

i s a l s o

v e r y u s e f u l t h a t

t h e

document o r k s p a c e

i s t h r e e

d i m e n s i o n a l . T he

v i s u a l

cues

i n a t h r e e dimensional

Work

s p a c e e n a b l e t h e p l a c e m e n t o f

a g r e a t e r

number o f docu

m e n t s i n

p o s i t i o n s

a n d

o r i e n t a t i o n s Which

r e

r e a d i l y a c c e p t

a b l e

t o t h e u s e r . F u r t h e r , t h e t h r e e - d i m e n s i o n a l n a t u r e o f

t h e

W o r k s p a c e

p r o v i d e

f o r a

much

l a r g e r W o r k s p a c e s i n c e i t

p e r m i t s p l a c e m e n t o f

W o r k s p a c e o b j e c t s “ b e h i n d ” o r

t h e

“ t h e

s i d e ”

o f

t h e

u s e r .

T h u s , b y

s i m p l y “ t u r n i n g

a

v i e W p o i n t ”

d i f f e r e n t

p o r t i o n s o f t h e

W o r k s p a c e a r e b r o u g h t i n t o v i e W .

T h e d o c u m e n t W o r k s p a c e o f t h e

c u r r e n t l y

p r e f e r r e d

embodiment i s i l l u s t r a t e d W i t h

r e f e r e n c e

t o F I G . 2 a . I t

s h o u l d

b e

n o t e d t h a t

t h e

“ u s e r

v i e W ” o f

t h e

W o r k s p a c e

i s

t h e

p r i m a r y o r d e f a u l t

v i e W .

A s

t h e

document W o r k s p a c e

i s

t h r e e - d i m e n s i o n a l , t r a v e r s a l t h r o u g h t h e W o r k s p a c e i s

p e r

m i t t e d t o a c h i e v e d i f f e r e n t v i e W s o f

t h e

W o r k s p a c e . The

d o c u m e n t


a r r a n g e d

h i e r a r c h i c a l l y ,

b a s e d o n

i n t e r a c t i o n r a t e s , i n t o t h r e e main

l e v e l s :

a F o c u s S p a c e f o r

t h e d o c u m e n t o b j e c t s i n a c t i v e u s e ) , I m m e d i a t e Memory

S p a c e f o r d o c u m e n t o b j e c t s i n

u s e )

a n d T e r t i a r y S p a c e f o r

document o b j e c t s n o t

i n

u s e ) .

I t

s h o u l d b e n o t e d t h a t a t e a c h

o f

t h e

d i f f e r e n t l e v e l s ,

t h e amount

o f d i s p l a y

s p a c e

p e r

d o c u m e n t o b j e c t r o u g h l y c o r r e s p o n d s t o t h e i n t e r a c t i o n

r a t e

W i t h

t h e document b j e c t . T h i s W i l l become a p p a r e n t i n t h e

d e s c r i p t i o n b e l o W .

The Focus

Space

i s Where

a

document o b j e c t t h a t

a

u s e r

i s d i r e c t l y

i n t e r a c t i n g W i t h

i s s h o W n . I n

o t h e r W o r d s , t h e

d o c u m e n t

o b j e c t i s i n

a c t i v e

u s e . I n


p r e f e r r e d

embodiment,

t h e f o c u s s p a c e

may

c o n t a i n

a

p a g e ,

p i l e ,

WebBook o r

e v e n

a r e p r e s e n t a t i o n o f

t h e

T e r t i a r y S p a c e .

R e f e r r i n g

t o

F I G .

2 a ,

a

document

o b j e c t

2 0 1

s

i n

t h e

F o c u s

S p a c e .

I n

t h e c u r r e n t l y p r e f e r r e d e m b o d i m e n t

d o c u m e n t

o b j e c t s

a r e vieWed and i n t e r a c t e d

With

i n a manner

a s s o c i

a t e d W i t h t h e p a r t i c u l a r o b j e c t . So f o r

p a g e s

d o W n l o a d e d

from t h e World-Wide

Web i n an

HTML o r m a t ,

t h e

pages a r e

i n t e r a c t e d

W i t h u s i n g a b r o W s e r c a p a b l e o f v i e W i n g HTML

f o r m a t t e d

d o c u m e n t s . With

r e s p e c t

t o document c o l l e c t i o n s ,

a document

c o l l e c t i o n

may e vieWed a s a

p i l e

o f i n d i v i d u a l

Web pages o r

a s

a WebBook r vieWed i n a l i n e a r organi

Z a t i o n u s i n g a Document Lens V i s u a l i Z a t i o n .

The

Document

Workspace p r o v i d e a

means

f o r

s e l e c t i n g

t h e

manner i n

Which a

p a g e

c o l l e c t i o n i s

v i e W e d , eg s i n g

a

p u l l - d o W n

menu

When ieWed a s a

WebBook,

t h e

pages

a r e o r g a n i Z e d i n

a

book

m e t a p h o r .

User i n t e r f a c e

c o n t r o l s

a r e

p r o v i d e d

Which

enable

a user t o t r a v e r s e a page, s c a l e pages, t u r n pages,

p l a c e bookmarks a n d t o a u t o m a t i c a l l y s c a n

t h e

WebBook.

The u s e r i n t e r f a c e f o r v i e W i n g t h e p a g e s i n t h e WebBook s

d e s c r i b e d i n g r e a t e r d e t a i l i n c o - p e n d i n g a n d commonly

a s s i g n e d

US. p a t e n t


S e r . N o .

0 8 / 5 2 5 , 9 3 6

e n t i t l e d

“ D i s p l a y S y s t e m F o r

D i s p l a y i n g

L i s t s Of L i n k e d

D o c u m e n t s ” ? l e d S e p t . 8 , 1 9 9 5 .

The

Document Lens

s a n i n f o r m a t i o n

v i s u a l i Z a t i o n

t e c h

n i q u e

Which

shoWs a t h u m b n a i l r e p r e s e n t a t i o n o f e a c h

p a g e

o f a

document

a s

i f t h e y

Were

l a i d o u t

i n s e q u e n t i a l o r d e r on

a p l a n e . A o o l , i e t h e l e n s , i s moved o v e r t h e document

p a g e s t o b r i n g t h e d e s i r e d p o r t i o ns

i n t o

f o c u s . F u r t h e r d e t a i l

W i t h r e s p e c t t o t h e v i e W i n g

o f mu l t i - p a g e

d o c u m e n t s

u s i n g

a

Document

Lens

i s

d e s c r i b e d

i n

t h e

a r t i c l e

by R o b e r t s o n

a n d

M a c k i n l a y e n t i t l e d

“ T h e

Document L e n s ” U S T

’ 9 3 ,

CM Conference on User

I n t e r f a c e

SoftWare and




5 , 8 4 7 , 7 0 9

7

i n t e r a c t e d W i t h . I n

F I G .

2 a ,

a “ d e s k ” 202 a n d

t h e

“ a i r ” 203

b e h i n d

t h e

f o c u s s p a c e c o m p r i s e

t h e

I m m e d i a t e Memory

S p a c e .

The

“ a i r ”

2 0 3 c o m p o n e n t

o f

t h e I m m e d i a t e Memory

S p a c e h a s

s e v e r a l

t i e r s .

Document o b j e c t s

a r e a r r a n g e d

a t

s e v e r a l p r e d e t e r m i n e d Z - d i s t a n c e s

i n

t h e 3D s p a c e .

T h r e e

3 )

such

t i e r s

a r e i l l u s t r a t e d i n FIG.

2 a ,

t i e r s

204—206.

The u s e r

c a n move document o b j e c t s

back

i n s p a c e t h e f a r t h e r b a c k ,

t h e s m a l l e r t h e y become a n d t h e more document o b j e c t s t h a t

? t ) .

T h i s

i s

i l l u s t r a t e d b y n o t i n g

t h e

s i Z e d i f f e r e n c e s i n

t h e

v i s u a l

r e p r e s e n t a t i o n s

o f document c o l l e c t i o n s

204a—b a n d

document c o l l e c t i o n s

2 0 6 a — 2 0 6 b . To

h e l p W i t h o c c l u s i o n

p r o b l e m s ,

a c a m e r a o r

v i e w i n g )

p o s i t i o n

i s c h o s e n

s o

t h a t

a l e a s t one

roW

of

documents

W i l l ? t i n a f a r t h e r - b a c k t i e r

W i t h o u t

b e i n g o c c l u d e d b y

n e a r e r

o b j e c t s . Document o b j e c t s

i n

t h e I m m e d i a t e Memory S p a c e c a n b e

moved

a r o u n d

i n

X

a n d Y

i . e .

l e f t / r i g h t

o r

u p / d o W n ) o r

f o r W a r d

a n d backWard

t h a t i s i n Z ) u s i n g a s i m p l e g e s t u r e l a n g u a g e d e s c r i b e d

b e l o W .

The d e s k 202 may a l s o c o n t a i n document o b j e c t s ,

eg

ocument o b j e c t s 202 a

and 2 0 2 b . When h e u s e r

moves

a r o u n d

i n

t h e

Document

o r k s p a c e ,

t h e

d e s k

2 0 2 ,

a n d

h e n c e

o b j e c t s

on t h e

d e s k

may

move. G e n e r a l l y ,

t h e

most r e c e n t l y

u s e d

document

o b j e c t s

a r e p l a c e d on

t h e d e s k

2 0 2 .

I n t h e

c u r r e n t l y

p r e f e r r e d

e m b o d i m e n t , t h e I m m e d i a t e Memory

Space c a n

h o l d

a b o u t 30 document o b j e c t s W i t h o u t

o c c l u s i o n ,

an d over

a

hundred i f o c c l u s i o n s

a r e

a l l o W e d .

E a c h o f t h e d o c u m e n t o b j e c t s i n t h e I m m e d i a t e Memory

S p a c e

i s p r e s e n t e d “ f a c e - u p ” .

T h e

T e r t i a r y

S p a c e i s

W h e r e d o c u m e n t

o b j e c t s s u c h

a s

p a g e s a n d

WebBooks

may b e p o s i t i o n e d When t h e y a r e n o t

i n u s e . F o r

e x a m p l e ,

document

o b j e c t s

t h a t

a r e u s e d f o r

r e f e r e n c e p u r p o s e s a r e p l a c e d

i n

t h e t e r t i a r y s p a c e . R e f e r r i n g

t o F I G .

2 a ,

i n t h e c u r r e n t l y p r e f e r r e d embodiment t h e

t e r t i a r y s p a c e i s r e p r e s e n t e d a s a

b o o k c a s e

2 2 0 . I n n o r m a l

v i e W ,

t h e bookcase

i s

s e e n

a t

a n a n g l e

t o

minimiZe t h e

amount

o f

s c r e e n space t h a t i s

consumed

While

a t t h e s ame

t i m e

d i s p l a y i n g

e n o u g h i n f o r m a t i o n t h a t

r e c e n t l y - u s e d

Web

Boo k s

o r pages can be r e c o g n i Z e d . I f t h e u s e r “touches” one

o f

t h e

WebBooks o r

pages

i n

t h e

b o o k c a s e s , i t W i l l a u t o

m a t i c a l l y “ ? y ” t o t h e

f o c u s s p a c e

2 0 1 .

S i m u l t a n e o u s l y ,

a n y

WebBook

r

page

t h e n

i n t h e f o c u s s p a c e 202 W i l l ?y t o a

p o s i t i o n i n

t h e I m m e d i a t e

s p a c e 2 0 3 . T h e “ ? y i n g ” o f o b j e c t s

i s

a n

a n i m a t i o n

Which

shoWs

t h e

movement o f o b j e c t s from

one

space

t o a n o t h e r .

T h e d o c u m e n t W o r k s p a c e o f

t h e


embodiment i s

d e s i g n e d

t o p e r f o r m m u l t i p l e t a s k s c o n c u r

r e n t l y . So

f o r e x a m p l e ,

o n e

document o b j e c t may b e i n t e r

a c t e d W i t h b y t h e u s e r and

c o n c u r r e n t l y ,

a Web a c c e s s

r e q u e s t

may

b e p e r f o r m e d W i t h

r e t r i e v e d

Web p a g e s b e i n g

b r o u g h t

i n t o

t h e d o c u m e n t W o r k s p a c e f o r s u b s e q u e n t i n t e r

a c t i o n . F I G . 2b i l l u s t r a t e s t h e document W o r k s p a c e

o f

F I G .

2a W i t h a

r e c e i v e d

page

s p a c e 2 1 0 .

The

r e c e i v e d

page s p a c e

i s a n

a r e a

i n

t h e document Workspace W h e r e i n neWly

r e t r i e v e d

pages a r e d i s p l a y e d . I n FIG. 2 b ,

neW

pages

211—214

h a v e

b e e n r e c e i v e d . The

neWly

r e c e i v e d

p a g e s may

be

t h e

r e s u l t

o f a c c e s s i n g

a

l i n k e d

page on a page b e i n g

i n t e r a c t e d With o r t h e r e s u l t

o f

a Web e a r c h r e q u e s t .

I n o r d e r t o vieW t h e c o n t e n t s o f t h e t e r t i a r y s p a c e , i e t h e

b o o k c a s e ,

i t

s h o u l d b e p o s i t i o n e d i n t h e f o c u s

s p a c e .

The

b o o k c a s e

may

e

e i t h e r

p r i v a t e o r

p u b l i c .

A p r i v a t e

b o o k c a s e

i s

one Where t h e c o n t e n t s a r e

c r e a t e d

and

“oWned”

b y t h e

“ o W n e r ”

o f

t h e

W o r k s p a c e .

Apublic b o o k c a s e i s o n e t h a t h a s

c o n t e n t

t h a t

i s

c e n t r a l l y

u p d a t e d a n d

m a i n t a i n e d .

F o r

e x a m p l e , a p h o n e d i r e c t o r y may b e

c e n t r a l l y

m a i n t a i n e d

a n d

s u b s e q u e n t l y

d i s t r i b u t e d

t o

p u b l i c b o o k c a s e s o r

s h e l v e s )

i n

10

1 5

25

35

45

55

8

t h e

b o o k c a s e t o

?y

t o

t h e

f o c u s

s p a c e .

T h i s

i s i l l u s t r a t e d

i n

F I G .

3 . R e f e r r i n g t o

F I G .

3 ,

t h e b o o k c a s e 220 noW

o c c u p i e s

t h e f o c u s s p a c e s o t h a t t h e c o n t e n t s o f t h e

bookcase

220 can

b e vieWed i n

c l o s e r

d e t a i l . I t s h o u l d a l s o b e n o t e d t h a t

d e s p i t e t h e movement t h e d e s k r e m a i n s i n t h e

same p o s i t i o n

W i t h

r e s p e c t

t o

t h e

f o c u s s p a c e i . e .

d i r e c t l y

u n d e r n e a t h

i t ) .

A l s o ,

t h e

d e s k a n d a n y p a g e s

on t h e

d e s k h a v e been r e s i Z e d

i n o r d e r t o m a i n t a i n a

v i s u a l l y

a c c e p t a b l e s i e p e r s p e c t i v e

W i t h

r e s p e c t t o

t h e

neW

v i e W . What c o n c e p t u a l l y

h a s

o c c u r r e d i s

t h e t h a t u s e r vieW

h a s

been cha nged t o move i n

f r o n t

o f

t h e

b o o k c a s e ,

r a t h e r

t h a n

t h e b o o k c a s e

m o v i n g t h i s

i s

s u b s t a n t i a t e d by t h e

f a c t t h a t

t h e component o f t h e

i m m e d i a t e

s p a c e 2 0 3

t e r m e d “ a i r ”

h a v i n g t h e

? o a t i n g

d o c u

m e n t s i s n o l o n g e r v i s i b l e ) . S u b s e q u e n t l y

t o u c h i n g

a

Web

Boo k o r page on t h e bookcase W i l l cause t h e u s e r vieW t o ?y

b a c k t o t h e

d e f a u l t

v i e W i n g

p o s i t i o n

a n d t h e “ t o u c h e d ”

WebBook r

page

t o ?y t o t h e f o c u s

s p a c e .

D o c u m e n t O b j e c t s

ocument

o b j e c t i s

a n y

e n t i t y t h a t c a n

b e

m a n i p u l a t e d

i n

t h e

d o c u m e n t

W o r k s p a c e .

Adocument

o b j e c t

c o n t a i n s

t W o

b a s i c

t y p e s o f i n f o r m a t i on ; c o n t e n t


a n d d i s p l a y /

m a n i p u l a t i o n i n f o r m a t i o n . The

c o n t e n t i n f o r m a t i o n r e f e r s

t o

t h e

t e x t a n d i m a g e d a t a f o r

t h e u n d e r l y i n g d o c u m e n t . The


i n f o r m a t i o n r e f e r s

t o

d a t a d e ? n i n g

hoW t h e t e x t

a n d

image d a t a i s t o

b e

p r e s e n t e d t o t h e u s e r .

Some e x a m p l e s :

f o r

a

Web page t h e d i s p l a y / m a n i p u l a t i o n


Would b e

a

Web b r o W s e r ;

f o r

a document

c o l l e c t i o n t h e d i s p l a y / m a n i p u l a t i o n

i n f o r

mation

may

e

a WebBook r o W s e r .

HoW

a

d o c u m e n t o b j e c t i s v i s u a l l y r e p r e s e n t e d d e p e n d s

on What t

r e p r e s e n t s . n

n d i v i d u a l document o r Web page

W i l l b e r e p r e s e n t e d i n i t i a l l y b y t h e

? r s t p a g e

o r b y t h e t o p

p a r t

o f

t h e

Web

p a g e . While

s t i l l

i n

u s e ,

s u b s e q u e n t

r e p r e

s e n t a t i o n s W i l l

s i m p l y

b e Where t h e document Was When a s t

vieWed.

For

document

c o l l e c t i o n s represented

a s

WebBooks t h e r e p r e s e n t a t i o n

W i l l

b e

t h e

“ c o v e r ”

o f

t h e

b o o k .

W h en n o t i n a c t i v e u s e , t h e WebBook W i l l

c l o s e , b u t

b e

bookmarked s o

t h a t When r e - o p e n e d i t W i l l a u t o m a t i c a l l y

open t o t h e l a s t page v i e W e d .

T he i n t e r n a l


o f a document

o b j e c t

i s a s a

d a t a s t r u c t u r e h a v i n g c o n t e n t d a t a

r e p r e s e n t i n g

t h e

i n f o r m a t i o n , i e t e x t o r i m a g e , t h a t t h e document o b j e c t

r e p r e s e n t s a n d

i n f o r m a t i o n f o r

i n d i c a t i n g

hoW t h e

c o n t e n t

d a t a W i l l b e

p r o c e s s e d

f o r

r e n d e r i n g a n d d i s p l a y .

T h e

l a t e r

d a t a may

b e a

program name

t o b e

linked t o

o r a c t u a l

program c o d e .

D a t a

s t r u c t u r e s f o r h a n d l i n g s u c h i n f o r m a t i o n

a r e

Well

k noW n

i n t h e

a r t .

Moving D o c u m e n t O b j e c t s I n T h e D o c u m e n t W o r k s p a c e

The

s i m p l e s t

Way o f moving a

d o c u m e n t

o b j e c t i n t h e

document Workspace

i s

t o p o s i t i o n

t h e

c u r s o r on

t h e

d e s i r e d


a n d

c l i c k i n g

t h e

a s s o c i a t e d s W i t c h

on

t h e

c u r s o r c o n t r o l d e v i c e . T h i s c a u s e s t h e document

o b j e c t

t o

move t o t h e f o c u s s p a c e , and t o move t h e document o b j e c t

p r e v i o u s l y o c c u p y i n g t h e f o c u s s p a c e t o move t o t h e

imme

d i a t e s p a c e t h e

d e s k t o p ) . H o W e v e r ,

i t i s

o f t e n

d e s i r a b l e t o

move

document

o b j e c t s t o l o c a t i o n s o t h e r

t h a n t h e

f o c u s

s p a c e .

KnoWn t e c h n i q u e s f o r

o p e r a t i n g i n

a

2-D

W o r k s p a c e ,

eg

d r a g a n d d r o p

o p e r a t i o n t o move a n o b j e c t , do n o t

Work

W e l l

i n a 3-D W o r k s p a c e .

One r e a s o n i s

t h a t

o b j e c t s

may

b e s e p a r a t e d b y l a r g e

Z v a l u e s

a n d

W o u l d

r e q u i r e

p a i n s t a k i n g

movement

t o

a d j u s t

Z

v a l u e s W i t h i n

a

“ d r o p

Z o n e ” . e c o n d

r e a s o n

i s t h a t f o r e g r o u n d h e n c e

l a r g e )

o b j e c t s o b s c u r e many

b a c k g r o u n d h e n c e

s m a l l ) o b j e c t s s o




5 , 8 4 7 , 7 0 9

9

To a d d r e s s

t h e s e

p r o b l e m s , a t o u c h d r o p g e s t u r e i s p r o

v i d e d . B a s i c a l l y , a

t o u c h d r o p g e s t u r e i s

o n e

Where

a n o b j e c t

i s “ t o u c h e d ” ,

eg by p o s i t i o n i n g

a

c u r s o r

o v e r

i t

and

d e p r e s s i n g

a

c u r s o r

c o n t r o l b u t t o n ,

t r a c i n g t h e c u r s o r move

m e n t W i t h

a l i n e , a n d

t h e n d r o p p i n g

t h e o b j e c t b y r e l e a s i n g

t h e

c u r s o r c o n t r o l b u t t o n

a t

t h e

end

p o i n t o f

t h e

l i n e .

c o n s t r a i n t o f t h e t o u c h - d r o p

g e s t u r e

i s t h a t t h e e n d p o i n t o f

t h e l i n e must

b e

o n some o t h e r

document

o b j e c t o r

a n o t h e r

v i s i b l e

o b j e c t i n t h e

W o r k s p a c e l i k e

t h e

b o o k c a s e o f

t h e

d e s k ) . O t h e r W i s e , n o movement o r o t h e r a c t i o n i s t a k e n i . e .

a n u l l o p e r a t i o n ) . T h e ? n a l o p e r a t i o n

o f

t h e t o u c h d r o p

g e s t u r e i s

c o n t e X t

s e n s i t i v e . So i f t h e

t o u c h e d

o b j e c t

i s

a

WebBook a n d t h e

d r o p

o b j e c t i s t h e

b o o k c a s e ,

t h e W e b B o ok

i s s t o r e d o n

t h e bookcase.

The

t o u c h d r o p g e s t u r e i s i l l u s t r a t e d i n F I G S .

4 — 5 . R e f e r

r i n g t o F I G . 4 , page

202b

o n t h e d e s k i s

t o u c h e d

u s i n g a

c u r s o r

c o n t r o l d e v i c e . While t h e s W i t c h a s s o c i a t e d W i t h t h e


d e v i c e r e m a i n s d e p r e s s e d

i . e .

i s i n

t h e

s e c o n d

d o W n p o s i t i o n ) , t h e c u r s o r i s

move d

and a l i n e 401 i s d r a W n .

N o t e

t h a t i n

t h e

c u r r e n t l y

p r e f e r r e d

embodiment

t h e

l i n e

a c t u a l l y t r a c e s t h e

movement o f

t h e c u r s o r . HoWever i t

Would b e a p p a r e n t t o o n e i n t h e c u r r e n t l y

p r e f e r r e d

embodi

ment

t o

i n d i c a t e t h e

l i n e u s i n g a W e l l k n o W n “ r u b b e r

b a n d i n g ”

t e c h n i q u e b e t W e e n t h e o r i g i n a l

s e l e c t i o n

p o i n t a n d

t h e p o s i t i o n o f t h e c u r s o r . I n a n y

e v e n t ,

t h e l i n e 401

t e r m i n a t e s a t t h e bookcase

2 2 0 .

T e r m i n a t i o n

o c c u r s

by

r e l e a s i n g

t h e

s W i t c h

a s s o c i a t e d W i t h t h e c u r s o r

c o n t r o l

d e v i c e i . e . i s i n t h e ? r s t u p p o s i t i o n ) . R e f e r r i n g n o W o

F I G .

5 ,

t h e p a g e 202b h a s b e e n removed

from d e s k

202

a n d

h a s

been

p l a c e d o n

bookcase 2 2 0 .

I t

s h o u l d

a l s o b e

n o t e d

t h a t

t h e t o u c h

d r o p g e s t u r e i s

c o n t e X t s e n s i t i v e .

FIGS.

6—7 i l l u s t r a t e placement o f a

page

on

a b o o k c a s e . R e f e r r i ng t o F I G .

6 , p a g e 201

i s t o u c h e d a n d

t o

b e

d r o p p e d o n b o o k c a s e

2 2 0 . T h i s

i s


by

t h e

e n d p o i n t

o f

l i n e 6 0 1

t o u c h i n g

t h e

b o o k c a s e 2 2 0 . T h e

r e s u l t

i s

i l l u s t r a t e d i n F I G .

7 W h e r e i n

t h e page

201

s

removed

from

t h e

f o c u s s p a c e a n d i s p l a c e d o n b o o k c a s e

2 2 0 .

T h e a c t u a l

movement o f t h e

page

201 t o t h e

bookcase

220 i s “ a n i

mated” s o t h a t t h e

page 201 a p p e a r s t o

?y

t o

t h e

bookcase

220

W h e n

t h e c u r s o r c o n t r o l b u t t o n i s

r e l e a s e d . T h i s

a c t i o n

i s c o n t e x t

s e n s i t i v e s i n c e i t r e c o g n i Z e s a n y u n i q u e

r e q u i r e

m e n t s o f

t h e d r o p

l o c a t i o n a n d

p e r f o r m s a n y

a p p r o p r i a t e

a c t i o n s . I n t h i s

c a s e , t h e

u n i q u e a c t i o n

c o n c e r n s

p l a c i n g

t h e

page

on

t h e

b o o k c a s e . So

t h e a p p r o p r i a t e

a c t i o n i s t o s c a l e

t h e

p a g e a n d

p l a c e

o n

an a v a i l a b l e

l o c a t i o n

o n t h e bookcase.

A n o t h e r

e X a m p l e

o f

c o n t e X t s e n s i t i v e

o p e r a t i o n

i s d i s c u s s e d

beloW

W i t h

r e s p e c t t o p l a c i n g one page

o n

a n o t h e r f o r

c r e a t i n g

a

p i l e .

T h e t o u c h d r o p

g e s t u r e

a l s o

h a s

t h e

a d v a n t a g e

o f

n o t

r e q u i r i n g

s c r e e n r e n d e r i n g

o f

a Workspace

i n o r d e r

t o

move

a document o b j e c t .

A n o t h e r

g e s t u r e u s e d

f o r

moving o b j e c t s

i s

t e r m e d

“ ? i c k

i n g ” . I n “ ? i c k i n g ”

a

d o c u m e n t o b j e c t i s

moved b y

t o u c h i n g

t h e

o b j e c t a n d “ ? i c k i n g ” i t

u s i n g

t h e c u r s o r

c o n t r o l d e v i c e i n

a

d e s i r e d

d i r e c t i o n .

G e n e r a l l y What

o c c u r s

i s

t h a t

t h e

o b j e c t

i s

touched

a n d W h i l e t h e s W i t c h o n t h e c u r s o r c o n t r o l d e v i c e

r e m a i n s d e p r e s s e d , t h e c u r s o r i s

q u i c k l y

moved i n t h e

d e s i r e d d i r e c t i o n a n d

t h e n

r e l e a s e d . The

o b j e c t

W i l l

t h e n

move

t o

t h e n e X t immediate

a r e a o r

t o t h e t e r t i a r y a r e a )

i n

t h e

d i r e c t i o n

o f t h e “ ? i c k i n g ”

g e s t u r e . I n


p r e f e r r e d embodiment

a

doWn?ick

moves documents c l o s e r

t o

t h e

u s e r

s o t h e

d o c u m e n t

o b j e c t

g e t s

l a r g e r ) ,

u p ? i c k s

move

document

aWay from t h e

u s e r

s o t h e

document

o b j e c t

g e t s s m a l l e r ) , s i d e ? i c k s

move

document

o b j e c t s

t o t h e

5

1 5

25

35

45

55

1 0

t i e r .

U p ? i c k i n g

s e n d s

documents

o t h e

Y p o s i t i o n i n

t h e n e X t

f a r t h e r t i e r Which i s

n o t

o c c l u d e d a n d t h e X

r i d d i n g

k e e p s

more t h a n one document o b j e c t from

ending

up i n t h e same

o r

o v e r l a p p i n g

s p a c e .

F l i c k i n g i s i l l u s t r a t e d i n F I G S . 8 — 9 . R e f e r r i n g t o F I G . 8 ,

p a g e

202a

o n

desk

202

i s

touched u s i n g

a

c u r s o r

c o n t r o l

d e v i c e . While a b u t t o n a s s o c i a t e d

With

t h e

c u r s o r

c o n t r o l

d e v i c e

r e m a i n s

d e p r e s s e d a

r a p i d movement o f t h e c u r s o r

c o n t r o l d e v i c e i n a n “upWard”

d i r e c t i o n

o c c u r s and

t h e

b u t t o n r e l e a s e d

i l l u s t r a t e d b y l i n e 8 0 1 ) . T h e

r e s u l t

i s

i l l u s

t r a t e d i n F I G . 9 Where t h e page 202 a

h a s

been

moved

t o

t i e r

205

o f t h e

“ a i r ”

p o r t i o n o f t h e i m m e d i a t e s p a c e

i n

t h e

d o c u m e n t W o r k s p a c e .

I t

s h o u l d b e n o t e d

t h a t “ s c a l i n g ” o f

document

o b j e c t s

a s

t h e y

a r e

moved f r o m

f o r e g r o u n d

t o

b a c k g r o u n d

p o s i t i o n s i n

t h e d o c u m e n t W o r k s p a c e i s p e r f o r m e d b y t h e r e n d e r i n g

s y s t e m o f t h e t h r e e - d i m e n s i o n a l

c o m p u t e r

c o n t r o l l e d

d i s p l a y

s y s t e m .

T h u s ,

no f u r t h e r

d i s c u s s i o n

o f h o W document

o b j e c t s a r e

s c a l e d

a s

t h e y

a r e moved

t h r o u g h t h e document

W o r k s p a c e

i s

n o t deemed n e c e s s a r y .

D oc ume n t

C o l l e c t i o n s

I n t h e c u r r e n t l y p r e f e r r e d e m b o d i m e n t , c o l l e c t i o n s o f

documents

may b e i m p o r t e d o r t h e y c a n b e

c r e a t e d

dynami

c a l l y .

W e b B o o k s a r e a n eXample

o f


o f

documents

t h a t

a r e

i m p o r t e d .

ynamic

W a y o f c r e a t i n g

a c o l l e c t i o n

i s

t h r o u g h

“ p i l i n g ”

documents

on

t o p

o f e a c h

o t h e r t o

c r e a t e a

p i l e .

A p i l e

i s c r e a t e d

s i m p l y b y m o v i n g

o n e d o c u m e n t

o n t o

a n o t h e r

document u s i n g a t o u c h

d r o p

g e s t u r e . I t s h o u l d

b e

n o t e d t h a t

a

p i l e

may be

added t o

a n o t h e r

p i l e

t o

c r e a t e

a n

e v e n b i g g e r

p i l e .

W h e n a p i l e i s

c r e a t e d

a

“ t r a y ” i s

p l a c e d

u n d e r them t o

i n d i c a t e

t h e i r

r e l a t i o n s h i p

a s a p i l e . T h e t r a y

a l s o

p r o v i d e s a c o n v e n i e n t

“ h a n d l e ”

f o r

s e l e c t i n g t h e

e n t i r e

p i l e .

T h e


a r e

p o s i t i o n e d

i n

t h e p i l e b y

h a v i n g e a c h n e W p a g e o n e quantum f a r t h e r i n r a d i u s from

t h e

c e n t e r

o f

t h e

p i l e i n

p o l a r

c o o r d i n a t e s ) .

T h e

a n g l e

f r o m

t h e

c e n t e r

i s chosen randomly

o r

i t ma y be c o n s t a n t

s o

t h a t

t h e document

o b j e c t s

a r e

i n - l i n e . W h e n t h e a n g l e

f r o m

t h e

c e n t e r i s c h o s e n

r a n d o m l y ,

e a c h p i l e W i l l h a v e a d i s t i n c t

a p p e a r a n c e a n d e a c h document i n t h e p i l e W i l l b e v i s i b l e .

C r e a t i o n

o f p i l e s

W i t h

t h e a n g l e

f r o m

t h e c e n t e r c h o s e n

randomly

i s i l l u s t r a t e d i n F I G . 1 2 . F I G . 1 2 i l l u s t r a t e s a

t h i r d

document b e i n g p l a c e d o n t h e p i l e . R e f e r r i n g t o F I G . 1 2 , a

document 1201 h a v i n g a c e n t e r 1202 i s

added

t o

t h e p i l e .

I n

t h i s c a s e t h e

c e n t e r

1202 s a t c o o r d i n a t e 4 ) , 2 X ) , a g a i n Where

t h e a n g l e 4 ) i s r a n d o m l y

c h o s e n a n d

t h e

r a d i u s

2 X

d e t e r m i n e d

by

W h e n

t h e document

Was

a d d e d

t o t h e

p i l e .

I t s h o u l d b e n o t e d t h a t i n

t h e

p i l e

r e p r e s e n t a t i o n o f

t h e


e m b o d i m e n t , e a c h

d o c u m e n t may

b e

s e l e c t e d

a n d b r o u g h t

t o

t h e

t o p o f

t h e

p i l e .

W h e n

d o i n g

t h i s ,

none o f

t h e

o t h e r documents become blocked from v i e W .

P i l e s

may

b e g e n e r a t e d

a u t o m a t i c a l l y o r m a n u a l l y . I n

m a n u a l c r e a t i o n , p i l e s a r e

s i m p l y

c r e a t e d b y c a u s i n g d o c u

m e n t s o r o t h e r p i l e s ) t o o v e r l a y

e a c h o t h e r .

I n a u t o m a t i c

c r e a t i o n , a

p i l e

may b e g e n e r a t e d

by

a

t o o l i n t h e Document

Workspace Which

l o o k s

f o r

a n d r e t r i e v e s d o c u m e n t s

a c c o r d

i n g t o

some

p r e d e t e r m i n e d c r i t e r i a .

T h u s , a c o m p u t e r

c o n t r o l l e d

d i s p l a y

s y s t e m

f o r d i s p l a y i n g

a t h r e e


document Workspace i s d i s c l o s e d .

While t h e p r e s e n t i n v e n t i o n i s d e s c r i b e d W i t h r e s p e c t

t o

a

p r e f e r r e d e m b o d i m e n t , i t Would b e a p p a r e n t t o

o n e s k i l l e d

i n

t h e a r t t o p r a c t i c e t h e p r e s e n t i n v e n t i o n

W i t h

o t h e r con?gu

r a t i o n s . Such a l t e r n a t e embodiments Wou ld n o t

c a u s e

d e p a r

t u r e

f r o m

t h e

s p i r i t

a n d

s c o p e o f

t h e

p r e s e n t

i n v e n t i o n .

We

l a i m :

1 . o m p u t e r c o n t r o l le d d i s p l a y

s y s t e m f o r

d i s p l a y i n g




5 8 4 7 7 0 9

1 1

document r e c e i v i n g

means

f o r r e c e i v i n g document

o b j e c t s ;

W o r k s p a c e d i s p l a y c i r c u i t r y f o r

g e n e r a t i n g

d i s p l a y i n f o r

m a t i o n f o r

d i s p l a y i n g s a i d


document

W o r k s p a c e a n d s a i d

d o c u m e n t

o b j e c t s s a i d W o r k s p a c e

d i s p l a y

c i r c u i t r y



d i s p l a y i n g

a

f o c u s s p a c e s a i d f o c u s

s p a c e

f o r

d e t a i l d i s p l a y

o f

a

document

o b j e c t ;

c i r c u i t r y f o r d i s p l a y i n g a n i m m e d i a t e

s p a c e

s a i d imm e

d i a t e

s p a c e

f o r

e p h e m e r a l p o s i t i o n i n g

o f

d o c u m e n t

o b j e c t s

t h a t a r e i n u s e b u t

n o t

i n f o c u s ;

and

c i r c u i t r y f o r d i s p l a y i n g a t e r t i a r y s p a c e s a i d

t e r t i a r y


document

o b j e c t s

t h t

a r e

n o t

i n u s e .

2 . The

c o m p u t e r

c o n t r o l l e d


c l a i m 1 W h e r e i n

s a i d

immediate s p a c e i s c o m p r i s e d o f a

p l u r a l i t y

o f t i e r s

a l o n g a

Z - a X i s

W h e r e i n

e a c h o f s a i d t i e r s

c a u s e s

a

d o c u m e n t

o b j e c t

t o

be

s c a l e d t o

a

corresponding

p r e d e t e r m i n e d s i Z e .

3 .

The c o m p u t e r

c o n t r o l l e d

d i s p l a y

s y s t e m

a s r e c i t e d i n

claim

2 Wherein s a i d

immediate

space

f u r t h e r

h a s a n

a r e a

v i s u a l l y r e p r e s e n t e d a s

a d e s k t o p .

4 .

The

c o m p u t e r

c o n t r o l l e d

d i s p l a y s y s t e m

a s

r e c i t e d i n

c l a i m

1

W h e r e i n

s a i d t e r t i a r y s p a c e

i s

v i s u a l l y r e p r e s e n t e d

a s

a b ookcase

5 .

The c o m p u t e r c o n t r o l l e d


a s

r e c i t e d i n

c l a i m 1 f u r t h e r

c o m p r i s i n g

a

r e c e i v e d

document s p a c e f o r

d i s p l a y i n g r e q u e s t e d

d o c u m e n t

o b j e c t s a s t h e y a r e r e c e i v e d .

6 .

The

c o m p u t e r

c o n t r o l l e d


a s

r e c i t e d i n

c l a i m 1

f u r t h e r

c o m p r i s i n g n a v i g a t i o n means f o r p r o v i d i n g

u s e r

i n p u t f o r


a

u s e r v i e W p o i n t W i t h i n

s a i d

t h r e e - d i m e n s i o n a l d o c u m e n t

W o r k s p a c e .

7 . The c o m p u t e r c o n t r o l l e d

d i s p l a y s y s t e m a s

r e c i t e d

i n

c l a i m

1 W h e r e i n s a i d document

a c c e s s i n g

means

i s

f u r t h e r

c o m p r i s e d o f

W e b i n t e r a c t i o n means

f o r

r e t r i e v i n g

p a g e s

from t h e World Wide Web

1 5

25

35

1 2

8 . The

c o m p u t e r

c o n t r o l l e d

d i s p l a y

s y s t e m


c l a i m

1

f u r t h e r

c o m p r i s i n g

WebBook g e n e r a t i o n means f o r

c r e a t i n g

a W e b B o o k

f r om

a n

i d e n t i ? e d c o l l e c t i o n

o f r e l a t e d

W e b

p a g e s .

9 .

o m p u t e r


s y s t e m f o r

d i s p l a y i n g

document

o b j e c t s

i n a


document Work

s p a c e

on a d i s p l a y

s a i d c o m p u t e r c o n t r o l l e d d i s p l a y

s y s t e m


document

r e t r i e v a l

m e a n s

f o r

r e t r i e v i n g

d o c u m e n t

o b j e c t s ;


means o r

r e c e i v i n g

u s e r

i n p u t

f o r


document o b j e c t s W i t h i n s a i d t h r e e - d i m e n s i o n a l d o c u

m e n t W o r k s p a c e ;

W o r k s p a c e

d i s p l a y


g e n e r a t i n g d i s p l a y

i n f o r

m a t i o n

f o r

d i s p l a y i n g

s a i d t h r e e - d i m e n s i o n a l document

W o r k s p a c e

a n d s a i d d o c u m e n t

o b j e c t s

s a i d

t h r e e

d i m e n s i o n a l W o r k s p a c e c o m p r i s i n g :

a f o c u s s p a c e f o r d i s p l a y i n g a c t i v e

i n

u s e

d o c u m e n t

o b j e c t s ;

a n

immediate

s p a c e

f o r

d i s p l a y i n g

i n

u s e

d o c u m e n t

o b j e c t s ; a n d

a t e r t i a r y

s p a c e

f o r d i s p l a y i n g document

o b j e c t s

t h a t a r e

not i n u s e .

1 0 . The

c o m p u t e r

c o n t r o l l e d

d i s p l a y

s y s t e m


c l a i m

9

Wherein

s a i d a

? r s t p a r t o f s a i d immediate s p a c e i s

v i s u a l l y r e p r e s e n t e d by a

d e s k t o p a n d

a

s e c o n d

p a r t

o f

s a i d

i m m e d i a t e s p a c e i s v i s u a l l y r e p r e s e n t e d by

a n a i r

s p a c e

b e h i n d s a i d ? r s t p a r t .

1 1 .

The

c o m p u t e r

c o n t r o l l e d


a s

r e c i t e d

i n

c l a i m

1 0

W h e r e i n

s a i d f o c u s

s p a c e i s

p o s i t i o n e d

a b o v e

s a i d

? r s t p a r t o f s a i d i m m e d i a t e s p a c e .

1 2 . The

c o m p u t e r

c o n t r o l l e d

d i s p l a y s y s t e m a s r e c i t e d

i n

c l a i m 9 W h e r e i n s a i d t e r t i a r y s p a c e i s v i s u a l l y r e p r e s e n t e d b y

a b ookcase






JS 44 Reverse (Rev. 09/11)

INSTRUCTIONS FOR ATTORNEYS COMPLETING CIVIL COVER SHEET FORM JS 44

Authority For Civil Cover Sheet

The JS 44 civil cover sheet and the information contained herein neither replaces nor supplements the filings and service of pleading or other papers as reqby law, except as provided by local rules of court. This form, approved by the Judicial Conference of the United States in September 1974, is required fuse of the Clerk of Court for the purpose of initiating the civil docket sheet. Consequently, a civil cover sheet is submitted to the Clerk of Court for eachcomplaint filed. The attorney filing a case should complete the form as follows:

I. (a) Plaintiffs-Defendants. Enter names (last, first, middle initial) of plaintiff and defendant. If the plaintiff or defendant is a government agency, us

the full name or standard abbreviations. If the plaintiff or defendant is an official within a government agency, identify first the agency and then the official, gboth name and title.

(b) County of Residence. For each civil case filed, except U.S. plaintiff cases, enter the name of the county where the first listed plaintiff residestime of filing. In U.S. plaintiff cases, enter the name of the county in which the first listed defendant resides at the time of filing. (NOTE: In land condemncases, the county of residence of the “defendant” is the location of the tract of land involved.)

(c) Attorneys. Enter the firm name, address, telephone number, and attorney of record. If there are several attorneys, list them on an attachment, nin this section “(see attachment)”.

II. Jurisdiction. The basis of jurisdiction is set forth under Rule 8(a), F.R.C.P., which requires that jurisdictions be shown in pleadings. Place an “X” of the boxes. If there is more than one basis of jurisdiction, precedence is given in the order shown below.

United States plaintiff. (1) Jurisdiction based on 28 U.S.C. 1345 and 1348. Suits by agencies and officers of the United States are included here.

United States defendant. (2) When the plaintiff is suing the United States, its officers or agencies, place an “X” in this box.

Federal question. (3) This refers to suits under 28 U.S.C. 1331, where jurisdiction arises under the Constitution of the United States, an amendment

Constitution, an act of Congress or a treaty of the United States. In cases where the U.S. is a party, the U.S. plaintiff or defendant code takes precedence, an1 or 2 should be marked.

Diversity of citizenship. (4) This refers to suits under 28 U.S.C. 1332, where parties are citizens of different states. When Box 4 is checked, the citizensthe different parties must be checked. (See Section III below; federal question actions take precedence over diversity cases.)

III. Residence (citizenship) of Principal Parties. This section of the JS 44 is to be completed if diversity of citizenship was indicated above. Mark this sfor each principal party.

IV. Nature of Suit. Place an “X” in the appropriate box. If the nature of suit cannot be determined, be sure the cause of action, in Section VI belsufficient to enable the deputy clerk or the statistical clerks in the Administrative Office to determine the nature of suit. If the cause fits more than one natsuit, select the most definitive.

V. Origin. Place an “X” in one of the seven boxes.

Original Proceedings. (1) Cases which originate in the United States district courts.

Removed from State Court. (2) Proceedings initiated in state courts may be removed to the district courts under Title 28 U.S.C., Section 1441. When the pefor removal is granted, check this box.

Remanded from Appellate Court. (3) Check this box for cases remanded to the district court for further action. Use the date of remand as the filing date

Reinstated or Reopened. (4) Check this box for cases reinstated or reopened in the district court. Use the reopening date as the filing date.

Transferred from Another District. (5) For cases transferred under Title 28 U.S.C. Section 1404(a). Do not use this for within district transfers or multidlitigation transfers.

Multidistrict Litigation. (6) Check this box when a multidistrict case is transferred into the district under authority of Title 28 U.S.C. Section 1407. Whebox is checked, do not check (5) above.

Appeal to District Judge from Magistrate Judgment. (7) Check this box for an appeal from a magistrate judge’s decision.

VI. Cause of Action. Report the civil statute directly related to the cause of action and give a brief description of the cause. Do not cite jurisdictional staunless diversity. Example: U.S. Civil Statute: 47 USC 553

Brief Description: Unauthorized reception of cable service

VII. Requested in Complaint. Class Action. Place an “X” in this box if you are filing a class action under Rule 23, F.R.Cv.P.

Demand. In this space enter the dollar amount (in thousands of dollars) being demanded or indicate other demand such as a preliminary injunction.

Jury Demand. Check the appropriate box to indicate whether or not a jury is being demanded.

VIII. Related Cases. This section of the JS 44 is used to reference related pending cases if any. If there are related pending cases, insert the docket nuand the corresponding judge names for such cases.

Date and Attorney Signature. Date and sign the civil cover sheet.
