43
The Related Worksheets Application

Related Worksheets

Embed Size (px)

DESCRIPTION

A key feature of relational database applications is managing plural relationships—one-to-many and many-to-many—between entities. However, since it is often infeasible to adopt or develop a new database application for any given schema at hand, information workers instead turn to spreadsheets, which lend themselves poorly to schemas requiring multiple related entity sets. In this project, we propose to reduce the cost-usability gap between spreadsheets and tailor-made relational database applications by extending the spreadsheet paradigm to let the user establish relationships between rows in related worksheets as well as view and navigate the hierarchical cell structure that arises as a result. We present Related Worksheets, a spreadsheet-like prototype application, and evaluate it with a screencast-based user study on 36 Mechanical Turk workers. First-time users of our software were able to solve lookup-type query tasks with the same or higher accuracy as subjects using Microsoft Excel, in one case 40% faster on average.

Citation preview

Page 1: Related Worksheets

The Related Worksheets Application

Page 2: Related Worksheets

Stereotypical Enterprise Database UI

Switchboard

Rep

orts

Table viewRecord view

Search form

Page 3: Related Worksheets

Highly Domain-SpecificDatabase Applications

• Require large development efforts

• Have high training/support costs

• Put developers between data and users

• Seldom reach a high level of maturity

• Usually just a CRUD1 interface to some relational database

1 “Create, Read, Update, Delete”

Page 4: Related Worksheets

Alternative

Page 5: Related Worksheets

Spreadsheets• General-purpose data management UI,

widely used for database-style tasks• Large range of streamlined facilities for

interacting with any data in a grid• Sadly, spreadsheets lack features

essential to any relational database UI– Joins, managing one-to-many/many-to-many relationships– No dynamic views– Non-tabular views and layouts– Need better scaling, multiuser support

• Great it your database is single-table, single-user

Page 6: Related Worksheets

One-to-Many/Many-to-ManyRelationships

See P.P. Chen’s "The Entity Relationship Model: Toward a Unified View of Data“(IBM 1976)

Page 7: Related Worksheets
Page 8: Related Worksheets

?

Page 9: Related Worksheets

App Builders

Desktop IDEs

Page 10: Related Worksheets

Spreadsheets vs.Database App Builders (Access et. al.)

Spreadsheets• A mature, grand unified

idea for how to interact with data

• Limited strategies available for presenting data.

• Does not help you manage relationships between multiple tables of data

Access/FileMaker/etc.• Access to the full power

of relational databases

• Too technical interface• Often requires macro

programming• Requires you to design

and implement a new UI for every schema

Good

Bad

Page 11: Related Worksheets

Spreadsheets vs.Database App Builders (Access et. al.)

Spreadsheets• A mature, grand unified

idea for how to interact with data

• Limited strategies available for presenting data.

• Does not help you manage relationships between multiple tables of data

Access/FileMaker/etc.• Access to the full power

of relational databases

• Too technical interface• Often requires macro

programming• Requires you to design

and implement a new UI for every schema

Good

Bad

Page 12: Related Worksheets

Spreadsheets vs.Database App Builders (Access et. al.)

Spreadsheets• A mature, grand unified

idea for how to interact with data

• Limited strategies available for presenting data.

• Does not help you manage relationships between multiple tables of data

Access/FileMaker/etc.• Access to the full power

of relational databases

• Too technical interface• Often requires macro

programming• Requires you to design

and implement a new UI for every schema

Good

Bad

Page 13: Related Worksheets

TheRelated Worksheets

System

A spreadsheet metaphor for plural relationships

Page 14: Related Worksheets

A database with one-to-many and many-to-many relationships,accessed through a general-purpose, spreadsheet-like UI

Page 15: Related Worksheets

“Related Worksheets” application at startup

Page 16: Related Worksheets

Creating a new worksheet

Page 17: Related Worksheets

After entering some simple, tabular data

Page 18: Related Worksheets

1st New Concept: Data Types for Worksheet Columns

Page 19: Related Worksheets

2nd New Concept: Array Types

Page 20: Related Worksheets

3rd New Concept: Reference Types(“Each cell in this column refers to a row in a different worksheet”)

Page 21: Related Worksheets

3rd New Concept: Reference TypesReference values are displayed recursively, as configured

by the user in the “Show/Hide Columns” tree

Page 22: Related Worksheets

3rd New Concept: Reference TypesReference values are displayed recursively, as configured

by the user in the “Show/Hide Columns” tree

Page 23: Related Worksheets

3rd New Concept: Reference TypesReference values are displayed recursively, as configured

by the user in the “Show/Hide Columns” tree

Page 24: Related Worksheets

Select/deselect fields in the “Show/Hide Columns” tree,

change column widths, names

3rd New Concept: Reference TypesReference values are displayed recursively, as configured

by the user in the “Show/Hide Columns” tree

Page 25: Related Worksheets

4th New Concept: Relationships are bidirectional

Page 26: Related Worksheets

1

4th New Concept: Relationships are bidirectional

Page 27: Related Worksheets

2

4th New Concept: Relationships are bidirectional

Page 28: Related Worksheets

Teleport Feature(Press Ctrl+Space)

1

2

4th New Concept: Relationships are bidirectional

Page 29: Related Worksheets

Result: The ability to keep track of one-to-many/many-to-manyrelationships from within a spreadsheet-like user interface

Page 30: Related Worksheets

Array Columns and Cursor Movement

Page 31: Related Worksheets

Related Work

Commercial Application Builders

• 4th Dimension• FileMaker• Microsoft Access• Intuit QuickBase• AppForge (Yang et al. ‘08)

• App2You(Kowalzcykowski et al. ‘09)

Spreadsheet systems• IceSheets (Whitmer ‘08)

• PrediCalc (Kassoff et al. ‘07)

Visual Query Languages• Query-by-Example

(Zloof ‘77)

• Pivot Tables• Tableau (Stolte et al. ‘02)

Page 32: Related Worksheets

Related Work

Commercial Application Builders

• 4th Dimension• FileMaker• Microsoft Access• Intuit QuickBase• AppForge (Yang et al. ‘08)

• App2You(Kowalzcykowski et al. ‘09)

Spreadsheet systems• IceSheets (Whitmer ‘08)

• PrediCalc (Kassoff et al. ‘07)

Visual Query Languages• Query-by-Example

(Zloof ‘77)

• Pivot Tables• Tableau (Stolte et al. ‘02)

Page 33: Related Worksheets

Related Work(Tree-Structured Views)

AppForge (Yang et al. ‘08) IceSheets (Whitmer ‘08)

App2You (Kowalzcykowski et al. ‘09)

Page 34: Related Worksheets

UserStudy

Page 35: Related Worksheets

User Study• Hypothesis: Excel-proficient users will be faster at

lookup (read-only) tasks on a database stored in normalized form in our system vs. Microsoft Excel

Page 36: Related Worksheets

User Study• Mechanical Turk

• Remotely screen-recorded

• Lookup tasks on course catalog database in Excel vs. Related Worksheets (between-subjects)

• Initial qualification task on Excel only

Page 37: Related Worksheets

User Study

Page 38: Related Worksheets

Results:Demographics

Page 39: Related Worksheets

Results: Correctness and Features Used

Page 40: Related Worksheets

Results: Timing

p < 0.05 for Task 4 only

(41% faster)

Page 41: Related Worksheets

Observations

• Possible learning costs, including search

• Benefit for complex join task

• Excel users (73%) use filtering heavily, sorting less so (7%)

• Related Worksheets users made use of the teleport feature

Page 42: Related Worksheets

Conclusion• Spreadsheets unsuitable as database with multiple

tables, plural relationships; otherwise great general tool• Enhance spreadsheet paradigm with

– Column type system: primitive types, array types, reference types

– Bidirectional hierarchical views of reference types

to handle plural relationships• User Study shows system usable without instruction,

sometimes faster than Excel (more study needed).

Acknowledgements• Thanks to Paul Grogan and Yod Watanaprakornkul for

their help designing and implementing the original prototype for this software!

Page 43: Related Worksheets

A Spreadsheet-Based User Interface for Managing Plural

Relationships in Structured Data

Eirik Bakke, David R. Karger, Robert C. MillerMIT CSAIL