Intel: Next Generation SSDs & ForestDB Next Generation Storage Engine: Couchbase Connect 2015

INTEL® SOLID STATE DRIVE (SSD) & FOREST DB

Frank Ober, Solution Architect, IntelQi Zhu, Product Manager, Couchbase

©2015 Couchbase Inc. 2

Agenda

Intel SSD and NVMe Technology ForestDB Evaluation Results Q/A


Storage Progression > Closer to the CPU…

3

M.2

I/OController

Yesterday Today Tomorrow

M.2

I/OController

M.2

Hott

est

Data

Needs

Low

er

Late

ncy

All information provided here is subject to change without notice. Contact your Intel representative to obtain the latest Intel product specifications and roadmaps. Other names and brands may be claimed as the property of others.

http://www.google.com/url?sa=i&rct=j&q=&esrc=s&frm=1&source=images&cd=&cad=rja&uact=8&docid=gNpf-uRf_0_FMM&tbnid=mLI2mZWEauxQQM:&ved=0CAUQjRw&url=http://www.lycom.com.tw/ST117.htm&ei=tp6HU_LpBMSGkAX84YGACg&psig=AFQjCNEQ-CmWbnI19rpJC8qAVNku7LtCEQ&ust=1401483314717180

The Data Center SSD Market

4

Source: IDC, 2013, 2014, Q3 2014

Intel® Data Center SSDs: #1 chosen Data Center SATA Solid-State Drive

Intel20%

Fusion IO17%

HGST11%

NetApp7%

STEC6%

SanDisk5%

Samsung5%

Other 28%

2012 DC Total Revenue

5X revenue growth 2013-2018

8+ years of Leadership

Source: IDC, June, 2014

Intel29.5%

SanDisk11.7%

WD10.6%

Fusion IO9.2%

Samsung8.9%

Other30.0%

Q2 '14 DC Revenue

The Data Center Solid-State Drive Market

5

Source: Intel Market Model and multiple industry analysts

SATA and PCIe account for approximately 70% of SSD interfaces

SATA is the dominant interface through 2016

Intel delivers SATA and PCIe* solutions to meet customer needs

NVM Express* – Architected for NVM NVM Express* is a standardized high performance software interface

for PCI Express* (PCIe*) SSDs Standardizes register set, feature set, and command set where there were only

proprietary PCIe solutions before Architected from the ground up for NAND and next generation NVM Designed to scale from Enterprise to Client systems

• Developed by an open industry consortium with a 13 company Promoter Group

*Other names and brands may be claimed as the property of others.

NVM Express* Technical Overview Supports deep queues (64K commands per queue, up to 64K queues) Supports MSI-X and interrupt steering Streamlined & simple command set (13 required commands) Optional features to address target segment Data Center: End-to-end data protection, reservations, etc. Client: Autonomous power state transitions, etc.

Designed to scale for next generation NVM, agnostic to NVM type used

NVM Express* (NVMe)*Other names and brands may be claimed as the property of others.

The Latency of NVM Express* (NVMe)• The efficiency of NVM Express* (NVMe) directly results

in leadership latency• When doubling from 6Gb to 12Gb, SAS only reduces

latency by ~ 60 µS• NVMe is more than 200 µs lower latency than 12 Gb

SAS

NVMe delivers the lowest latency of any standard storage interface.Software and workloads used in performance tests may have been optimized for performance only on Intel microprocessors. Performance tests, such as SYSmark and MobileMark, are measured using specific computer systems, components, software, operations and functions. Any change to any of those factors may cause the results to vary. You should consult other information and performance tests to assist you in fully evaluating your contemplated purchases, including the performance of that product when combined with other products. For detailed configuration information, refer to following slide, Slide #17, “Setup for Efficiency and Latency Analysis.”

Intel® SSD Data Center P3700 Series Capacity

Workload Performance

Random 4k Read 450k IOPS

Random 4k write 175k IOPS

Random 4k 70/30 R/W

265k IOPS

Sequential Read 2800 MB/s

Sequential Write 2000 MB/s

800GB

400GB

1.6TB 2TB

Form Factor

2.5inx15mm x4 HHHL Add in card

Performance Power TechnologyPower loss protection

End-to-end data protectionUBER 10-17, 2M hours MTBF

Active Write25W

Active Read11W

Idle4W

High Endurance Technology 20nm NAND – 10 to 17 DWPD

3.0, x4

Consistent performanceUltra low latency

Tests document performance of components on a particular test, in specific systems. Differences in hardware, software, or configuration will affect actual performance. Consult other sources of information to evaluate performance as you consider your purchase. For more complete information about performance and benchmark results, visit www.intel.com/benchmarks. Configurations: Intel Core i7-3770K CPU @ 3.50GHz, 8GB of system memory, Windows* Server 2012, IOMeter. Random performance is collected with 4 workers each with 32 QD.

http://www.intel.com/benchmarks

ForestDB


ForestDB

A new KV storage engine developed by Couchbase caching and storage team

1.0 beta was release in Oct 2014, GA later this year

Scale from small devices to large servers Couchbase Server Secondary Index Couchbase Lite Couchbase Server KV Engine


ForestDB in Couchbase 4.0

Couchbase Server 4.0 introduces MDS(multi-dimensional scalability) ForestDB is the storage engine for Indexing Service We are working on integrating ForestDB into Couchbase Server Data

Service and Couchbase Mobile


ForestDB

Next Generation Storage Engine: ForestDB (Chiyoung Seo)

Under the Hood ForestDB: Performance on SSDs and File Systems (Sang-Won Lee and Sundar Sridharan)

SSD Optimization Adapt the SSD Flash Translation Layer (FTL) Use async I/O library (e.g., libaio)

Evaluation Results


Disclaimer

Couchbase Server 4.0 and ForestDB are still in development and the final version of the products may not be identical in details discussed on this session.


Lab Configuration

CentOS 6.5 Intel® Xeon® processor E5-2697 v3 @ 2.60GHz Number of Cores: 56 RAM: 65G Storage:

HDD: 7200 RPM HDD 1.0TB SATA SSD: IntelDC S3710 1.2TB NVMe SSD: Intel DC P3700 1.6TB

ForestDB: https://github.com/couchbase/forestdb

ForestDB benchmark: https://github.com/couchbaselabs/ForestDB-Benchmark

https://github.com/couchbase/forestdb

https://github.com/couchbase/forestdb

https://github.com/couchbaselabs/ForestDB-Benchmark

https://github.com/couchbaselabs/ForestDB-Benchmark


Testing Scenarios

Key/Value store Index Simulation Throughput Testing (Parallel Benchmark)


Key/Value Store

Key size: 48 bytes Document size: 1KB Number of documents: 100M ForestDB cache: 30G 4 reader thread, 1 writer thread(sync write) R:W = 4:1 Single File/Single benchmark program


K/V Testing : Throughput (op/s)

0

5000

10000

15000

20000

25000

30000

189 47

16678

4170

HDD SATA NVMe

Read Throughput Write Throughput

25302

6325

R:W = 4:1Single File/Instance


K/V Testing: Read Latency (ms)

0

0.5

1

1.5

2

2.5

3

3.5

1.745

3.264

1.136

2.994

SATA NVMe

95% 99%

R:W = 4:1Single File/InstanceSATA throughput: 16678NVMe throughput: 25302


K/V Testing: Durable Write Latency (ms)

0

50

100

150

200

250

300264.165

282.442

188.333 200.758

SATA NVMe

95% 99%



Key/Value Testing Summary

Comparing to SATA, NVMe provides 50% increase on R/W throughput 40% improvement on R/W latency (95%)


Indexing Service Testing

Key size: 1KB Document size: null Number of documents: 100M ForestDB cache: 30G 4 reader thread, 1 writer thread(sync write) R/W= 4:1 Single file/Single benchmark program


Index Testing: Throughput (op/s)

0

5000

10000

15000

20000

25000

186 46

13987

3497

HDD SATA NVMe


20841

5209

R:W = 4:1Single File/Instance


Index Testing: Read Latency (ms)

0

0.5

1

1.5

2

2.5

3

3.5

4

4.5

1.853

3.811

1.254

3.145

SATA NVMe

95% 99%



Index Testing: Durable Write Latency (ms)

0

50

100

150

200

250

300

350

275.812301.768

215.758 228.819

SATA NVMe

95% 99%



Index Simulation Testing Summary

Comparing to SATA, NVMe provides 50% increase on R/W throughput 30% improvement on R/W latency (95%)


Throughput Testing : Parallel Benchmark

Key size: 48 bytes Document size: 1K Number of documents: 100M ForestDB Cache: 10G 4 benchmark program running in parallel

4 reader/1 writer for each benchmark program Each thread is running at its max capacity Each benchmark reads/writes to its own file


Throughput Testing: Throughput (op/s)

0

10000

20000

30000

40000

50000

60000

70000

30755

7282

47345

63946

SATA NVMe


4 reader, 1 writerMax capacity for each thread 4 files, 4 instances


Throughput Testing Summary

Comparing to SATA drive, NVMe provides 50% increase on read throughput 900% increase on write throughput


Summary

K/V Store Indexing Parallel Throughput

SATA NVMe SATA NVMe SATA NVMeRead Throughput

16678 25302 13987 20341 30755 47345

Write Throughput

4170 6325 3497 5209 7282 63946

95% Read Latency

1.745 1.136 1.853 1.254 4.0(?) 7.5(?)

95% Write Latency

264 188 276 216 1934 270SATA: S3710 1.2TBNVMe: P3700 1.6TB

Thank you.