Embed Size (px)
Citation preview
Optimizing Cloud Usage with High-Speed Big Data Transport June 2016
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
Note: Table displays throughput degradation of TCP transfers on a 1Gbps network as estimated round trip time and packet loss increases with distance.
•
•
•
•
•
•
•
•
•
•
•
•
•
Note: The relative bandwidth utilization for FASP transfers over a 1 Gbps network are immune to latency (distance) with very little effect from packet loss.
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
HTTP
Key Value
H(URL) R1, R2, R3
Data Nodes Master Database Mapping Object ID to File Data Replicas and Storing Metadata
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
••
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
• •
•
•
•
•
Utilization > high w/m Available Pool
New Cl ients connect to “available” pool
Exis ting cl ient
transfers
Console
•Col lect / aggregate transfer data • Transfer activity /
reporting (UI, API)
Shares •User management • Storage access control
• Cluster Manager for Auto-scale and Scaled DB
• Console Management UI + Reporting API • Enhanced Client for Shares
Authorizations • Unified Access to Files/Directories
(Browser, GUI, Commend Line, SDK)
Scaling Parameters • Min/max number of t/s • Utilization low/high
watermark
• Min number of t/s in “available” pool
• Min number of idle t/s in ”available” pool
Management and Reporting
Cluster Manager • Monitor cluster nodes • Determine eligibility for
transfer scale up / down
• Create / remove db with replicas
• Add / remove node
Scale DB Persistence Layer
• Deep system integration
between Akamai NetStorage
and Aspera FASP
• Maximum speed upload
directly to NetStorage
• Single platform for ingest and geo-
distributed replication
• Highly redundant, geographically
dispersed storage, 34+ locations
NetStorage Upload Acceleration +
•
•
•
•
•
•
•
•
•
