View
214
Download
0
Category
Preview:
Citation preview
Unigroup: OpenAFS Distributed Storage
To provide the world with a next generation storage platform for unstructured data,
enabling deployment of mobile applications, virtualization solutions, and software.
To support the on-going development of relevant critical path standards and open source
technologies.
The YFS Mission
AFS is:• A global file system name space (/afs)• A family of file system RPCs used to manipulate the
contents of the name space• A class of client and server implementations that
provide access to the name space OpenAFS is:
• One of the oldest open source communities• One of the largest open source projects• The most widely deployed implementation of AFS
What are AFS and OpenAFS?
Andrew File System• Part of the Carnegie Mellon University and IBM
Andrew Project of the 1980s• First reference to “Cloud Storage” in early papers• I.P. owned by IBM not Carnegie Mellon
AFS commercialized by Transarc / IBM• Shifted focus to DCE DFS
Open source era began in 2000
A Very Brief History of AFS
Large active team. • 40 devs in last 12 months. • 249 since formation.
Nearly 1 million lines of code and documentation.
Approaching 10,000 contributions. Basic COCOMO effort analysis
• 217 person years• $23 million
11 Years of Open Source
AFS satisfies Operational RequirementsPlatform Specific
Redirection
Authentication and Privacy
Geographic Data Replication & Data Integrity
Distributed Administration &
Disconnected Operation
Atomic Publishing
Model
One File System for All Clients
Global Accessibility
and Federation
Platfiorm & Location Independence
High Level Architecture
OS
Apps
AFS Cache
Client DeviceDesktop, Laptop, Mobile
AFS cache stores recently accessed file, directory and location data
reducing network traffic
AFS Client
Location Server File Server DataFile ServerData
OS
Apps
AFS Client
AFS Cache
Client Device
Authenticated Callbacks notify clients of changes to data, metadata and lock status
Separate location and data servers allow for strong scalability and
seamless maintenance
Replication of data volumes ensure high availability and
disaster recovery
Rich security services provide secure access on open networks
and federated collaboration
Portable cross platform client
Each has an owner Each belongs to a specific cell which
determines which protection database is used for access control
Each can be migrated, replicated and backed up independently
Each can mount other volumes within the same or different cells
AFS Volumes are File Systems
Graph of Cell Volume Structure
The fastest RPC is the one that is never sent AFS caches data and metadata to avoid
repetitive fetches from the file servers Cached info:
• Object Status (size, timestamps, data version)• Per user permissions• Lock state• Unix mode bits / attributes• Accessed data extents (offset, length)
How to Make Stuff Go Fast
For each read-write object and each read-only volume a callback promise is registered with the file server the data was accessed on.
When any change occurs to the state of the object or volume, the file server notifies all registrants that some change *might* have occurred.
It is up to the client to decide if updated data is required.
What about multi-user access?
Cache Coherency Matters
BulletsTitle
BulletsTitle
BulletsTitle
BulletsTitle
BulletsTitle
BulletsTitle
BulletsTitle
BulletsTitle
BulletsTitle
BulletsTitle
BulletsTitle
Enhanced user interface integration Troubleshooting wizards Integrated update service OS Vendor certification
• Microsoft Windows only
Products and Services:Enhanced Desktop Clients
Features• File Browser• Integrated document viewing• Open documents with third
party applications• Save documents from third
party applications• Integrated authentication• User to User Document Sharing
Service Core Application Frameworks
available for integration in custom apps
Products and Services:iOS Mobile Clients
Capable of monitoring multiple cells
Collects server performance data
Performs cell consistency checks
Alert generation Cell introspection Browser and mobile
application
Products and Services:Monitoring and Management Service
Integrated Turnkey Storage Appliances offering a superset of OpenAFS functionality
Products and Services:Storage Appliances
24-7 Crisis Resolution Services Troubleshooting and Configuration Services On-site and remote training classes for
system administrators and end users Custom feature development
Services provided for both OpenAFS and YFS
Products and Services:Training and Support
Storage Appliance Road Map1st Gen
2012 Q1
1st Gen
Base file system platform• Large volume support• GSS Authentication• AES-256 RFC3962 encryption• High scalability• R/W replication• IPv6• Parallel reads• Unicode directories• Disaster recovery capabilities• No single points of failure• Departmental file servers• Byte range locks• Authenticated Fine Grained Coherency• Many-to-One Authn to Authz IdsArbitrary file system importAutomated client update servicesAutomated Troubleshooting ToolsMobile clients and SDKs for custom applicationsIntegrated Monitoring and Management Interface
Storage Appliance Road Map1st Gen 2nd Gen
2012 Q1 2013 Q1
1st Gen 2nd Gen
Advanced volume storage• Data integrity• De-duplication• Compression• Self-healing• Snapshots & clones• Storage poolsAdditional features• TCP transport• Disconnected clients• Event driven server arch.• Multiple data streams• Extended Attributes• Peer to peer data sharing• Hypervisor Integration
Base file system platform• Large volume support• GSS Authentication• AES-256 RFC3962 encryption• High scalability• R/W replication• IPv6• Parallel reads• Unicode directories• Disaster recovery capabilities• No single points of failure• Departmental file servers• Byte range locks• Authenticated Fine Grained Coherency• Many-to-One Authn to Authz IdsArbitrary file system importAutomated client update servicesAutomated Troubleshooting ToolsMobile clients and SDKs for custom applicationsIntegrated Monitoring and Management Interface
Storage Appliance Road Map1st Gen 2nd Gen
2012 Q1 2013 Q1
Consumer storage appliance
YFS hosted storage services and facilities build out using YFS rack servers
1st Gen 2nd Gen
Advanced volume storage• Data integrity• De-duplication• Compression• Self-healing• Snapshots & clones• Storage poolsAdditional features• TCP transport• Disconnected clients• Event driven server arch.• Multiple data streams• Extended Attributes• Peer to peer data sharing
Hardware encryption module
YFS hosted storage services and facilities build out using YFS rack servers
Base file system platform• Large volume support• GSS Authentication• AES-256 RFC3962 encryption• High scalability• R/W replication• IPv6• Parallel reads• Unicode directories• Disaster recovery capabilities• No single points of failure• Departmental file servers• Byte range locks• Authenticated Fine Grained Coherency• Many-to-One Authn to Authz IdsArbitrary file system importAutomated client update servicesAutomated Troubleshooting ToolsMobile clients and SDKs for custom applicationsIntegrated Monitoring and Management Interface
Storage Appliance Road Map1st Gen 2nd Gen 3rd Gen
2012 Q1 2013 Q1 2014 Q1
Consumer storage appliance
YFS hosted storage services and facilities build out using YFS rack servers
1st Gen 2nd Gen 3rd Gen
Advanced volume storage• Data integrity• De-duplication• Compression• Self-healing• Snapshots & clones• Storage poolsAdditional features• TCP transport• Disconnected clients• Event driven server arch.• Multiple data streams• Extended Attributes• Peer to peer data sharing• Hypervisor Integration
Hardware encryption module
YFS hosted storage services and facilities build out using YFS rack servers
Base file system platform• Large volume support• GSS Authentication• AES-256 RFC3962 encryption• High scalability• R/W replication• IPv6• Parallel reads• Unicode directories• Disaster recovery capabilities• No single points of failure• Departmental file servers• Byte range locks• Authenticated Fine Grained Coherency• Many-to-One Authn to Authz IdsArbitrary file system importAutomated client update servicesAutomated Troubleshooting ToolsMobile clients and SDKs for custom applicationsIntegrated Monitoring and Management Interface
• Improved Package Management• Namespaces• Volumes• Application deployment
• Hybrid cloud deployments• Integrated Search• Named Pipes
YFS Storage Appliance v1
OEM HardwareHardware RAID
OEM PartnerOn-site Service
Debian kFreeBSD(Linux with BSD Kernel)
Microsoft OEMStorage Server 2008 R2
Volume Location DB
+
Protection DB
File Server
Salvager,Vol Mgmt,
BackupMonitor
YFS Storage Appliance v2
OEM HardwareHardware RAID
OEM Partner On-site Service
Debian kFreeBSD Microsoft OEM Storage Server 2008
Volume Location DB
+
Protection DB
File Server
Salvager,Vol Mgmt,
BackupMonitor
Pooled storage devices
Hypervisor IntegrationGuest
Host
Hypervisor Virtual FS
GuestHypervisor Virtual FS
GuestHypervisor Virtual FS
YFS cache Virtualized cache access
iOS applications Monitoring tools
Demos
255 W 94TH STNew York NY 10025 USA
+1 212 769-9018sales@your-file-system.com
http://www.your-file-system.com
Recommended