13
LDBC SOCIAL NETWORK BENCHMARK - FULL DISCLOSURE REPORT 20/04/2015 Social Network Benchmark Interactive Workload Full Disclosure Report Moritz Kaufmann 20/04/2015

LDBC SOCIAL NETWORK Benchmark - Full Disclosure Report ldbcouncil.org/sites/...I_20150427_SF30_sparksee.pdf · LDBC SOCIAL NETWORK BENCHMARK - FULL DISCLOSURE REPORT 20/04/2015

  • Upload
    others

  • View
    7

  • Download
    0

Embed Size (px)

Citation preview

Page 1: LDBC SOCIAL NETWORK Benchmark - Full Disclosure Report ldbcouncil.org/sites/...I_20150427_SF30_sparksee.pdf · LDBC SOCIAL NETWORK BENCHMARK - FULL DISCLOSURE REPORT 20/04/2015

LDBC SOCIAL NETWORK BENCHMARK - FULL DISCLOSURE REPORT 20/04/2015

Social Network Benchmark Interactive Workload Full Disclosure Report Moritz Kaufmann

20/04/2015

Page 2: LDBC SOCIAL NETWORK Benchmark - Full Disclosure Report ldbcouncil.org/sites/...I_20150427_SF30_sparksee.pdf · LDBC SOCIAL NETWORK BENCHMARK - FULL DISCLOSURE REPORT 20/04/2015

LDBC SOCIAL NETWORK BENCHMARK - FULL DISCLOSURE REPORT <DATE>

Table of Contents

3

4

5 5 5 5 6

7 7

7 Error! Bookmark not defined. Error! Bookmark not defined. 7

Error! Bookmark not defined. 7

8 8 8 8 Error! Bookmark not defined.

9

11

12

13

Page 3: LDBC SOCIAL NETWORK Benchmark - Full Disclosure Report ldbcouncil.org/sites/...I_20150427_SF30_sparksee.pdf · LDBC SOCIAL NETWORK BENCHMARK - FULL DISCLOSURE REPORT 20/04/2015

Preface

This is the Full Disclosure Report for the LDBC SNB interactive audit results for Sparksee 5.1.1 by Sparsity Technologies, Scale Factor SF30 on a single server configuration.

Page 4: LDBC SOCIAL NETWORK Benchmark - Full Disclosure Report ldbcouncil.org/sites/...I_20150427_SF30_sparksee.pdf · LDBC SOCIAL NETWORK BENCHMARK - FULL DISCLOSURE REPORT 20/04/2015

General Terms Test sponsor of this benchmark is Sparsity Technologies, Spain. Sparsity technologies is a leading provider of graph database and applications that use the graph to add value to our customers. Our high end technologies, based on top research, combine the experience of University researchers and Industrial professionals. We have a vast Industrial experience to push your development to a more competitive customer solution. Sparsity was created based on the technologies developed at DAMA-UPC, and have successfully provided solutions to clients such as Barclays, Acceso, CA Technologies, MPG and contributed to leading European Projects such as LDBC and CoherentPaaS. This report contains an audited LDBC benchmark run. The results have been gathered by an independent and impartial auditor, who has validated the implementation of the queries and the overall system's configuration conform to the description of the benchmark and his strict requirements.

Page 5: LDBC SOCIAL NETWORK Benchmark - Full Disclosure Report ldbcouncil.org/sites/...I_20150427_SF30_sparksee.pdf · LDBC SOCIAL NETWORK BENCHMARK - FULL DISCLOSURE REPORT 20/04/2015

1. System Description

1.1 Database System

Vendor Name Sparsity Technologies

Database Name Sparksee

Version No 5.1.1

Table 1: DBMS Characteristics

1.2 Database Engine Configuration

Cache Configuration Default

Transaction Isolation Level/Model Serializable

Special settings sparksee.io.rollback=false sparksee.io.recovery=true sparksee.io.recovery.checkpointTime=0

Table 2: Database Engine Configuration

1.3 Platform Description

Table 3: System Configuration

Model

Processors 2X INTEL XEON E5-2630 V3

Memory 8X 32GB LRDIMM, 2133 MT/S

No Disks/Type/Storage Configuration

2X80GB SSD SATA MLC 6GB/S IN HOT-PLUG

DRIVE 1X2TB SATA 6GB/S 7,2K RPM 3,5" HDD

Network Adapters BROADCOM 5720

Operating System DEBIAN GNU/LINUX 7.8 (WHEEZY)

File System EXT4

No Threads 32

No Cores 16

Memory 256 GB

Total Disks Capacity 2.16 TB

Page 6: LDBC SOCIAL NETWORK Benchmark - Full Disclosure Report ldbcouncil.org/sites/...I_20150427_SF30_sparksee.pdf · LDBC SOCIAL NETWORK BENCHMARK - FULL DISCLOSURE REPORT 20/04/2015

Storage Intel Corporation Wellsburg 6-Port SATA Controller

RAID/HBA controller Not installed

Table 4: No Disks/Type/Storage/Configuration

1.4 Network Infrastructure Information

Model Not applicable

Network Switches Not applicable

Wiring Information Not applicable

Table 5: Network Infrastructure Information

Page 7: LDBC SOCIAL NETWORK Benchmark - Full Disclosure Report ldbcouncil.org/sites/...I_20150427_SF30_sparksee.pdf · LDBC SOCIAL NETWORK BENCHMARK - FULL DISCLOSURE REPORT 20/04/2015

2. Data Generation & Loading

2.1 Dataset Information

2.1.1 Description

Scale Factor 30

Data Format CSV

Data Generator Version v.0.2.0

Time Compression ratio 0.61

Table 6: Dataset characteristics

2.1.2 Data Generator Parameters

ldbc.snb.datagen.generator.scaleFactor: 30

ldbc.snb.datagen.serializer.compressed:false

ldbc.snb.datagen.serializer.personSerializer: ldbc.snb.datagen.serializer.snb.interactive.CSVPersonSerializer

ldbc.snb.datagen.serializer.invariantSerializer: ldbc.snb.datagen.serializer.snb.interactive.CSVInvariantSerializer

ldbc.snb.datagen.serializer.personActivitySerializer: ldbc.snb.datagen.serializer.snb.interactive.CSVPersonActivitySerializer

ldbc.snb.datagen.generator.numThreads:4

ldbc.snb.datagen.serializer.updateStreams:true

2.3. Bulk Loading

Loading Time 216min 48s

Table 7: Bulk Loading Time

Page 8: LDBC SOCIAL NETWORK Benchmark - Full Disclosure Report ldbcouncil.org/sites/...I_20150427_SF30_sparksee.pdf · LDBC SOCIAL NETWORK BENCHMARK - FULL DISCLOSURE REPORT 20/04/2015

3. Benchmark Test Driver

3.1. Basic test driver configuration details

No of worker threads 16

No of write streams 8

Table 8: Basic Test Driver Configuration Details

3.2. Configuration Parameters for Driver Warmup

Warmup using the first 160,000 operations

3.3. Configuration Parameters for Driver Execution

See user_parameters.properties, startup with 16 worker threads and TCR = 0.61

Page 9: LDBC SOCIAL NETWORK Benchmark - Full Disclosure Report ldbcouncil.org/sites/...I_20150427_SF30_sparksee.pdf · LDBC SOCIAL NETWORK BENCHMARK - FULL DISCLOSURE REPORT 20/04/2015

4. Performance Metrics

Duration Operations Throughput % above threshold

72.5min 377,000 86.5 3.89%

Query Count Mean % Execution

Complex 1 2,955.0 331.2 2.61%

Complex 2 2,076.0 354.7 1.96%

Complex 3 725.0 725.4 1.40%

Complex 4 2,134.0 326.8 1.86%

Complex 5 1,068.0 405.7 1.16%

Complex 6 243.0 984.0 0.64%

Complex 7 1,601.0 333.5 1.42%

Complex 8 8,537.0 351.8 8.01%

Complex 9 200.0 3,451.4 1.84%

Complex 10 2,076.0 449.7 2.49%

Complex 11 3,841.0 362.1 3.71%

Complex 12 1,746.0 383.0 1.78%

Complex 13 4,043.0 1,137.6 12.27%

Complex 14 1,566.0 2,010.3 8.40%

Short 1 41,220.0 40.9 4.49%

Short 2 41,221.0 27.8 3.06%

Short 3 41,222.0 31.2 3.43%

Short 4 41,027.0 45.0 4.93%

Short 5 41,029.0 19.7 2.16%

Short 6 41,030.0 19.0 2.08%

Short 7 41,033.0 18.0 1.97%

Update 1 17.0 964.6 0.04%

Update 2 8,776.0 187.8 4.40%

Update 3 15,423.0 189.5 7.79%

Update 4 242.0 179.9 0.12%

Update 5 21,901.0 188.9 11.04%

Update 6 3,031.0 176.5 1.43%

Update 7 6,166.0 189.2 3.11%

Update 8 851.0 176.0 0.40%

Table 10: Execution Summary

Page 10: LDBC SOCIAL NETWORK Benchmark - Full Disclosure Report ldbcouncil.org/sites/...I_20150427_SF30_sparksee.pdf · LDBC SOCIAL NETWORK BENCHMARK - FULL DISCLOSURE REPORT 20/04/2015

Query Min Max Mean 50th 90th 95th 99th

Complex 1 2.0 3,055.0 331.2 98.0 896.0 1,007.0 2,122.6 Complex 2 2.0 3,431.0 354.7 112.5 927.0 1,027.0 2,146.5 Complex 3 2.0 3,496.0 725.4 606.0 1,329.4 1,501.4 2,207.6 Complex 4 1.0 2,998.0 326.8 103.0 884.4 1,003.4 1,923.0 Complex 5 2.0 3,452.0 405.7 242.5 993.6 1,329.0 2,060.3 Complex 6 2.0 2,814.0 984.0 820.0 1,622.8 1,757.8 2,359.8 Complex 7 1.0 2,887.0 333.5 91.0 898.0 1,022.0 1,851.0 Complex 8 11.0 3,572.0 351.8 109.0 922.0 1,032.0 2,115.1 Complex 9 1,554.0 5,808.0 3,451.4 3,392.5 4,427.2 4,711.2 5,032.0 Complex 10 1.0 3,575.0 449.7 215.5 1,041.0 1,144.5 2,238.8 Complex 11 2.0 3,264.0 362.1 125.0 941.0 1,049.0 2,220.6 Complex 12 2.0 3,290.0 383.0 155.5 954.0 1,063.3 1,915.5 Complex 13 6.0 4,657.0 1,137.6 1,139.0 1,911.8 2,005.0 2,946.4 Complex 14 15.0 6,324.0 2,010.3 1,878.0 3,511.0 3,935.5 4,623.8

Table 11: Complex reads detail

Query Min Max Mean 50th 90th 95th 99th

Short 1 1.0 3,767.0 40.9 12.0 56.0 98.0 995.0 Short 2 1.0 3,593.0 27.8 18.0 43.0 57.0 112.0 Short 3 1.0 3,057.0 31.2 19.0 42.0 52.0 119.0 Short 4 1.0 3,775.0 45.0 12.0 58.0 102.0 1,003.0 Short 5 1.0 3,509.0 19.7 11.0 30.0 44.0 98.0 Short 6 1.0 3,586.0 19.0 11.0 30.0 40.0 81.0 Short 7 1.0 3,777.0 18.0 10.0 27.0 34.0 73.0

Table 12: Short Reads detail

Query Min Max Mean 50th 90th 95th 99th

Update 1 14.0 3,827.0 964.6 702.0 2,948.6 3,781.4 3,817.9 Update 2 6.0 5,669.0 187.8 24.0 796.0 1,073.3 2,510.0 Update 3 6.0 5,996.0 189.5 24.0 821.0 1,105.0 2,457.7 Update 4 7.0 4,145.0 179.9 25.0 561.1 1,031.8 2,626.2 Update 5 6.0 5,831.0 188.9 24.0 817.0 1,069.0 2,424.0 Update 6 9.0 3,897.0 176.5 28.0 757.0 1,014.5 2,229.1 Update 7 7.0 4,065.0 189.2 29.0 823.0 1,046.0 2,333.6 Update 8 6.0 3,682.0 176.0 24.0 764.0 1,004.0 2,243.0

Table 13: Updates detail

Page 11: LDBC SOCIAL NETWORK Benchmark - Full Disclosure Report ldbcouncil.org/sites/...I_20150427_SF30_sparksee.pdf · LDBC SOCIAL NETWORK BENCHMARK - FULL DISCLOSURE REPORT 20/04/2015

5. Recovery

Table 14: Recovery

Time to Recover 1.281s

Page 12: LDBC SOCIAL NETWORK Benchmark - Full Disclosure Report ldbcouncil.org/sites/...I_20150427_SF30_sparksee.pdf · LDBC SOCIAL NETWORK BENCHMARK - FULL DISCLOSURE REPORT 20/04/2015

6. Pricing Summary

Item Price

SPARKSEE 5.1.1 SME LARGE 3Y 21,600.00 €

DELL R730 8,827.94 €

TOTAL 30,427.94 €

Table 15: Pricing Information

Page 13: LDBC SOCIAL NETWORK Benchmark - Full Disclosure Report ldbcouncil.org/sites/...I_20150427_SF30_sparksee.pdf · LDBC SOCIAL NETWORK BENCHMARK - FULL DISCLOSURE REPORT 20/04/2015

7. Attachment's CheckList

DATAGEN PARAMS.INI Attached

DRIVER’S LDBC-CONFIGURATION.PROPERTIES Attached

DRIVER’S LDBC-RESULTS.JSON Attached

VENDOR SPECIFIC CONFIGURATION FILES sparksee.cfg

Table 9: Checklist