20
Umbrella File System : Storage Umbrella File System : Storage Umbrella File System : Storage Umbrella File System : Storage Umbrella File System : Storage Umbrella File System : Storage Umbrella File System : Storage Umbrella File System : Storage Management Across Heterogeneous Management Across Heterogeneous Management Across Heterogeneous Management Across Heterogeneous Management Across Heterogeneous Management Across Heterogeneous Management Across Heterogeneous Management Across Heterogeneous Devices (TOS09’) Devices (TOS09’) Devices (TOS09’) Devices (TOS09’) Devices (TOS09’) Devices (TOS09’) Devices (TOS09’) Devices (TOS09’) JOHN A. GARRISON and A.L. NARASIMHA REDDY Mobile Embedded Lab. School of Computer Science University of Seoul Mobile Embedded Lab. School of Computer Science University of Seoul 2010/02/02 Yongseok Oh [email protected] 1 Texas A&M University

Umbrella File System : Storage Management Across ... · Umbrella File System : Storage Management Across Heterogeneous Devices (TOS09’) JOHN A. GARRISON and A.L. NARASIMHA REDDY

  • Upload
    others

  • View
    4

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Umbrella File System : Storage Management Across ... · Umbrella File System : Storage Management Across Heterogeneous Devices (TOS09’) JOHN A. GARRISON and A.L. NARASIMHA REDDY

Umbrella File System : Storage Umbrella File System : Storage Umbrella File System : Storage Umbrella File System : Storage Umbrella File System : Storage Umbrella File System : Storage Umbrella File System : Storage Umbrella File System : Storage

Management Across Heterogeneous Management Across Heterogeneous Management Across Heterogeneous Management Across Heterogeneous Management Across Heterogeneous Management Across Heterogeneous Management Across Heterogeneous Management Across Heterogeneous

Devices (TOS09’)Devices (TOS09’)Devices (TOS09’)Devices (TOS09’)Devices (TOS09’)Devices (TOS09’)Devices (TOS09’)Devices (TOS09’)

JOHN A. GARRISON and A.L. NARASIMHA REDDY

Mobile Embedded Lab. School of Computer Science University of SeoulMobile Embedded Lab. School of Computer Science University of Seoul

2010/02/02

Yongseok Oh

[email protected]

1

JOHN A. GARRISON and A.L. NARASIMHA REDDY

Texas A&M University

Page 2: Umbrella File System : Storage Management Across ... · Umbrella File System : Storage Management Across Heterogeneous Devices (TOS09’) JOHN A. GARRISON and A.L. NARASIMHA REDDY

� Introduction

� Our approach

� Implementation

� Evaluation results

ContentsContentsContentsContentsContentsContentsContentsContents

Mobile Embedded Lab. School of Computer Science University of SeoulMobile Embedded Lab. School of Computer Science University of Seoul

� Evaluation results

� Example UmbrellaFS scenarios

2

Page 3: Umbrella File System : Storage Management Across ... · Umbrella File System : Storage Management Across Heterogeneous Devices (TOS09’) JOHN A. GARRISON and A.L. NARASIMHA REDDY

� Storage systems in the future will likely incorporate both

flash-memory based devices and magnetic disks

� Various methods have been proposed to compensate for

and exploit this diversity in device characteristics

■ AUTORAID

IntroductionIntroductionIntroductionIntroductionIntroductionIntroductionIntroductionIntroduction

Mobile Embedded Lab. School of Computer Science University of SeoulMobile Embedded Lab. School of Computer Science University of Seoul

■ AUTORAID

■ SSDs for a cache to improve the performance

� Current file system map files to devices based on the

namespace organizations

� UmbrellaFS uses three different types of storage, HDD,

SSD, and HDD with H/W encryption support

■ Rule based

3

Page 4: Umbrella File System : Storage Management Across ... · Umbrella File System : Storage Management Across Heterogeneous Devices (TOS09’) JOHN A. GARRISON and A.L. NARASIMHA REDDY

� Hourglass Model

Our approachOur approachOur approachOur approachOur approachOur approachOur approachOur approach

Mobile Embedded Lab. School of Computer Science University of SeoulMobile Embedded Lab. School of Computer Science University of Seoul 4

Page 5: Umbrella File System : Storage Management Across ... · Umbrella File System : Storage Management Across Heterogeneous Devices (TOS09’) JOHN A. GARRISON and A.L. NARASIMHA REDDY

� UmbrellaFS

Our approach(cont’d)Our approach(cont’d)Our approach(cont’d)Our approach(cont’d)Our approach(cont’d)Our approach(cont’d)Our approach(cont’d)Our approach(cont’d)

Mobile Embedded Lab. School of Computer Science University of SeoulMobile Embedded Lab. School of Computer Science University of Seoul 5

as a single file system

Page 6: Umbrella File System : Storage Management Across ... · Umbrella File System : Storage Management Across Heterogeneous Devices (TOS09’) JOHN A. GARRISON and A.L. NARASIMHA REDDY

Our approach(cont’d)Our approach(cont’d)Our approach(cont’d)Our approach(cont’d)Our approach(cont’d)Our approach(cont’d)Our approach(cont’d)Our approach(cont’d)

Mobile Embedded Lab. School of Computer Science University of SeoulMobile Embedded Lab. School of Computer Science University of Seoul 6

soft link

Page 7: Umbrella File System : Storage Management Across ... · Umbrella File System : Storage Management Across Heterogeneous Devices (TOS09’) JOHN A. GARRISON and A.L. NARASIMHA REDDY

� UmbrellaFS functions as a stackable file system,

residing below VFS and above the underlying file

systems

� The policy module

System designSystem designSystem designSystem designSystem designSystem designSystem designSystem design

Mobile Embedded Lab. School of Computer Science University of SeoulMobile Embedded Lab. School of Computer Science University of Seoul

The policy module

■ For example

� Any file larger than 100KB should be directed to a file system on a

RAID5

� Dave’s files should be stored on a seconds storage

7

Page 8: Umbrella File System : Storage Management Across ... · Umbrella File System : Storage Management Across Heterogeneous Devices (TOS09’) JOHN A. GARRISON and A.L. NARASIMHA REDDY

� Dave wants to map most of his personal files to the

encrypted storage, read only files to the flash

storage, and his video files and all other files to the

magnetic storage

ExampleExampleExampleExampleExampleExampleExampleExample

Mobile Embedded Lab. School of Computer Science University of SeoulMobile Embedded Lab. School of Computer Science University of Seoul 8

Page 9: Umbrella File System : Storage Management Across ... · Umbrella File System : Storage Management Across Heterogeneous Devices (TOS09’) JOHN A. GARRISON and A.L. NARASIMHA REDDY

� Periodic policy enforcer to run during off-peak usage

times

System design(cont’d)System design(cont’d)System design(cont’d)System design(cont’d)System design(cont’d)System design(cont’d)System design(cont’d)System design(cont’d)

Mobile Embedded Lab. School of Computer Science University of SeoulMobile Embedded Lab. School of Computer Science University of Seoul 9

Page 10: Umbrella File System : Storage Management Across ... · Umbrella File System : Storage Management Across Heterogeneous Devices (TOS09’) JOHN A. GARRISON and A.L. NARASIMHA REDDY

� UmbrellaFS

■ linux kernel 2.4 and 2.6

■ based on Unionfs

■ the rule evaluation framework

ImplementationImplementationImplementationImplementationImplementationImplementationImplementationImplementation

Mobile Embedded Lab. School of Computer Science University of SeoulMobile Embedded Lab. School of Computer Science University of Seoul 10

Page 11: Umbrella File System : Storage Management Across ... · Umbrella File System : Storage Management Across Heterogeneous Devices (TOS09’) JOHN A. GARRISON and A.L. NARASIMHA REDDY

� eCryptFS

� UnionFS

� RAIF

Stackable file systemStackable file systemStackable file systemStackable file systemStackable file systemStackable file systemStackable file systemStackable file system

Mobile Embedded Lab. School of Computer Science University of SeoulMobile Embedded Lab. School of Computer Science University of Seoul 11

Page 12: Umbrella File System : Storage Management Across ... · Umbrella File System : Storage Management Across Heterogeneous Devices (TOS09’) JOHN A. GARRISON and A.L. NARASIMHA REDDY

� Dell Optiplex GX620

■ Intel 3.2GHz

■ 2GB RAM

■ Linux 2.6.9

Evaluation resultsEvaluation resultsEvaluation resultsEvaluation resultsEvaluation resultsEvaluation resultsEvaluation resultsEvaluation results

Mobile Embedded Lab. School of Computer Science University of SeoulMobile Embedded Lab. School of Computer Science University of Seoul

■ Samsung 7200rpm 250GB SATA

■ Seagate Cheeta 10k 773GB SCSI

12

Page 13: Umbrella File System : Storage Management Across ... · Umbrella File System : Storage Management Across Heterogeneous Devices (TOS09’) JOHN A. GARRISON and A.L. NARASIMHA REDDY

� bonnie++

■ read/write two 1GB files

� Compiling OpenSSH

■ Cpu intensive benchmark

Benchmark toolsBenchmark toolsBenchmark toolsBenchmark toolsBenchmark toolsBenchmark toolsBenchmark toolsBenchmark tools

Mobile Embedded Lab. School of Computer Science University of SeoulMobile Embedded Lab. School of Computer Science University of Seoul

� Postmark

■ 12,500 fiiles between 8kB and 64kB

■ 25,000 transactions

13

Page 14: Umbrella File System : Storage Management Across ... · Umbrella File System : Storage Management Across Heterogeneous Devices (TOS09’) JOHN A. GARRISON and A.L. NARASIMHA REDDY

bonnie++bonnie++bonnie++bonnie++bonnie++bonnie++bonnie++bonnie++

Mobile Embedded Lab. School of Computer Science University of SeoulMobile Embedded Lab. School of Computer Science University of Seoul 14

Page 15: Umbrella File System : Storage Management Across ... · Umbrella File System : Storage Management Across Heterogeneous Devices (TOS09’) JOHN A. GARRISON and A.L. NARASIMHA REDDY

OpenSSHOpenSSHOpenSSHOpenSSHOpenSSHOpenSSHOpenSSHOpenSSH

Mobile Embedded Lab. School of Computer Science University of SeoulMobile Embedded Lab. School of Computer Science University of Seoul 15

Page 16: Umbrella File System : Storage Management Across ... · Umbrella File System : Storage Management Across Heterogeneous Devices (TOS09’) JOHN A. GARRISON and A.L. NARASIMHA REDDY

PostmarkPostmarkPostmarkPostmarkPostmarkPostmarkPostmarkPostmark

Mobile Embedded Lab. School of Computer Science University of SeoulMobile Embedded Lab. School of Computer Science University of Seoul 16

Page 17: Umbrella File System : Storage Management Across ... · Umbrella File System : Storage Management Across Heterogeneous Devices (TOS09’) JOHN A. GARRISON and A.L. NARASIMHA REDDY

Example Example Example Example Example Example Example Example UmbrellaFSUmbrellaFSUmbrellaFSUmbrellaFSUmbrellaFSUmbrellaFSUmbrellaFSUmbrellaFS

ScenariosScenariosScenariosScenariosScenariosScenariosScenariosScenarios

-Samsung 32GB SSD

-RAID 5 of the Seagate Cheetah

Mobile Embedded Lab. School of Computer Science University of SeoulMobile Embedded Lab. School of Computer Science University of Seoul 17

Page 18: Umbrella File System : Storage Management Across ... · Umbrella File System : Storage Management Across Heterogeneous Devices (TOS09’) JOHN A. GARRISON and A.L. NARASIMHA REDDY

Postmark

8kB~1MB

two groups

1. read-only

2. read-write

Mobile Embedded Lab. School of Computer Science University of SeoulMobile Embedded Lab. School of Computer Science University of Seoul 18

Page 19: Umbrella File System : Storage Management Across ... · Umbrella File System : Storage Management Across Heterogeneous Devices (TOS09’) JOHN A. GARRISON and A.L. NARASIMHA REDDY

set 1. read-only 1kB~5kB 50,000 files

set 2. read-write 8kB~1MB

Mobile Embedded Lab. School of Computer Science University of SeoulMobile Embedded Lab. School of Computer Science University of Seoul 19

Page 20: Umbrella File System : Storage Management Across ... · Umbrella File System : Storage Management Across Heterogeneous Devices (TOS09’) JOHN A. GARRISON and A.L. NARASIMHA REDDY

� UmbrellaFS can manage storage across diverse

devices efficiently, providing performance

improvements of up to 44% in a system with both

flash based storage and RAID

ConclusionsConclusionsConclusionsConclusionsConclusionsConclusionsConclusionsConclusions

Mobile Embedded Lab. School of Computer Science University of SeoulMobile Embedded Lab. School of Computer Science University of Seoul 20