68
Copyright © 2012 Cloudian Inc. & KK All Rights Reserved. NOSQLについて 河野 達也 / Tatsuya Kawano CloudianKK 2012年8月24日 日本OSS推進フォーラム勉強会

NOSQLの基礎知識(講義資料)

Embed Size (px)

DESCRIPTION

2012年8月24日、日本OSS推進フォーラム勉強会講義資料です。「NOSQLの基礎知識(ビッグデータを活かすデータベース技術)」の著者である河野達也がNOSQLについてわかりやすく解説しています。

Citation preview

  • 1. NOSQL / Tatsuya KawanoCloudianKK2012824OSS Copyright 2012 Cloudian Inc. & KK All Rights Reserved.

2. NOSQL 5+1 2 Copyright 2012 Cloudian Inc. & KK All Rights Reserved. 3. NOSQL +1 NOSQL Copyright 2012 Cloudian Inc. & KK All Rights Reserved. 4. SlideShare Copyright 2012 Cloudian Inc. & KK All Rights Reserved. 5. HBase YCSBYahoo! Cloud Serving BenchmarkCopyright 2012 Cloudian Inc. & KK All Rights Reserved. 6. / Tatsuya Kawano Copyright 2012 Cloudian Inc. & KK All Rights Reserved. 7. CloudianKK Cloudian S3 Hibari DB GB NOSQL afternoon in Japan Gary Ogasawara InktomiCAPE. Brewer Copyright 2012 Cloudian Inc. & KK All Rights Reserved. 8. NOSQLCopyright 2012 Cloudian Inc. & KK All Rights Reserved. 9. http://www.slideshare.net/sunsuk7tp/hbase-at-lineCopyright 2012 Cloudian Inc. & KK All Rights Reserved. 10. M2M 00-3Copyright 2012 Cloudian Inc. & KK All Rights Reserved. 11. 12TB/ 12TB 80MB/ 42 Copyright 2012 Cloudian Inc. & KK All Rights Reserved. 12. Bigtable Dynamo Web Bigtable Dynamo 0-2 Google Bigtable Amazon Dynamo Copyright 2012 Cloudian Inc. & KK All Rights Reserved. 13. In-Box Cassandra Web SNS Digg 1-2 NOSQL Copyright 2012 Cloudian Inc. & KK All Rights Reserved. 14. SQL 100 Copyright 2012 Cloudian Inc. & KK All Rights Reserved. 15. NOSQL 2 2-7 NO 2NO S2-7 QL Copyright 2012 Cloudian Inc. & KK All Rights Reserved. 16. NOSQL Copyright 2012 Cloudian Inc. & KK All Rights Reserved. 17. NOSQL Copyright 2012 Cloudian Inc. & KK All Rights Reserved. 18. 1LINEhttp://www.slideshare.net/sunsuk7tp/hbase-at-line Copyright 2012 Cloudian Inc. & KK All Rights Reserved. 19. http://www.slideshare.net/sunsuk7tp/hbase-at-line Copyright 2012 Cloudian Inc. & KK All Rights Reserved. 20. http://www.slideshare.net/sunsuk7tp/hbase-at-line Copyright 2012 Cloudian Inc. & KK All Rights Reserved. 21. http://www.slideshare.net/sunsuk7tp/hbase-at-line Copyright 2012 Cloudian Inc. & KK All Rights Reserved. 22. http://www.slideshare.net/sunsuk7tp/hbase-at-line Copyright 2012 Cloudian Inc. & KK All Rights Reserved. 23. http://beautifuldata.net/2012/01/telling-stories-with-network-data-instagram-in-china/ Copyright 2012 Cloudian Inc. & KK All Rights Reserved. 24. RDB 2-1RDB2-1 RDB _.indd 0502012/04/06 10:59:32 Copyright 2012 Cloudian Inc. & KK All Rights Reserved. 25. NOSQL DynamoHibariRedisScalaris Tokyo Cabi- Copyright 2012 Cloudian Inc. & KK All Rights Reserved. 26. RDB 1 2 3 4 Inc. & KK Copyright 2012 Cloudian All Rights Reserved. 27. 1 2 22NOS QL 3 4 2012 Cloudian Inc. & KKCopyrightAll Rights Reserved. 28. 0 1 2 3Copyright 2012 Cloudian Inc. & KK All Rights Reserved. 29. { author:joe,created: new Date(03/28/2009),title: Yet another blog post,text:Here is the text...,tags:[ example, joe ],comments : [ { author: jim,comment: I disagree}, { author: nancy, comment: Good post }]} Copyright 2012 Cloudian Inc. & KK All Rights Reserved. 30. RDB RDB 2-13 SNS ID ID1234567 1234568 1234569 ID 2-14 2u2415t342 t353t389 ID 2 2-14 N O S Q L ID ID t342u2415 gemini NOSQL is fun1234567 RDB RDB Inc. & KKCopyright 2012 Cloudian All Rights Reserved. 31. 2-14 IDt342Bigtable HBase 2-1 4 2-1 HBase t342 IDu2415t342 geminit342 NOSQL is funt342 1234567 RDB NOSQL columnar Inc. & KK All Rights Reserved. Copyright 2012 Cloudian 32. P2PCAPCopyright 2012 Cloudian Inc. & KK All Rights Reserved. 33. Bigtable Amazon Dynamo 2 Bigtable P2P 3-1 3-1 Dynamo P2P 3-2 NOSQL BigtableCouchDBHBase HibariMongoDB 3 3 1 3-2 P2P 74117_3_.indd 074 2012/04/06 11:06:27 Copyright 2012 Cloudian Inc. & KK All Rights Reserved. 34. 3-19 Bigtable Bigtable Arkansas California 1 California California-LosAngeles California-LosAngeles Colorado 2 Colorado Florida Garbage CollectionGC 2012 & KK All Rights Reserved. Copyright Cloudian Inc. 35. 0.45 C 3-16 AA0.00.0 0.20 0.75 0.25 D B0.750.25 DB0.70 0.5 C C C 3-13 0.0 1.0 4 A 0.0 B 0.25 2012 Cloudian Inc. & KK CopyrightAll Rights Reserved. 36. ACMAssociation for Computing Machinery PODC Prin-ciple Of Distributed ComputingTowards Ro-Eric BrewerCAPbust Distributed Systems3-6 Eric Brewer CAP 3 C or A 3Consistency Availability Tolerance to network 3 2 Partitions 2000 7 19 PODC Copyright 2012 Cloudian Inc. & KK All Rights Reserved. 37. 1 A B 2 B 3 A 1 2 A B1 AA A B B Copyright 2012 Cloudian Inc. & KK All Rights Reserved. 38. CPAP Copyright 2012 Cloudian Inc. & KK All Rights Reserved. 39. 1 2 3 3ABCPAP CP AP A A B A B 1 2 1 2 AB AB AP A B Copyright 2012 Cloudian Inc. & KK All Rights Reserved. 40. R W N -10 Quorum R W NRWN W1 R1 N3 1 2 3 1 1.2.3 1 Copyright 2012 Cloudian Inc. & KK All Rights Reserved. 41. 3-11 Quorum W N RRWN W2R2N3 1 2 3 2 2 2 1 Copyright 2012 Cloudian Inc. & KK All Rights Reserved. 42. HBaseCassandraRiakRedisMongoDBVoltDB (NewSQL)Copyright 2012 Cloudian Inc. & KK All Rights Reserved. 43. Apache HBase Google Bigtable Facebook LINEMozilla CP Copyright 2012 Cloudian Inc. & KK All Rights Reserved. 44. Apache HBase HDFSMapRMapR Copyright 2012 Cloudian Inc. & KK All Rights Reserved. 45. Apache Cassandra Amazon DynamoGoogle Bigtable TwitterDiggCloudian APCP P2P Copyright 2012 Cloudian Inc. & KK All Rights Reserved. 46. Apache Cassandra Copyright 2012 Cloudian Inc. & KK All Rights Reserved. 47. Basho Riak Amazon Dynamo JSON APCP P2P Copyright 2012 Cloudian Inc. & KK All Rights Reserved. 48. Basho Riak Copyright 2012 Cloudian Inc. & KK All Rights Reserved. 49. MongoDB CP Copyright 2012 Cloudian Inc. & KK All Rights Reserved. 50. MongoDB Copyright 2012 Cloudian Inc. & KK All Rights Reserved. 51. Redis CP Copyright 2012 Cloudian Inc. & KK All Rights Reserved. 52. Redis Copyright 2012 Cloudian Inc. & KK All Rights Reserved. 53. VoltDB NewSQL SQLACID Copyright 2012 Cloudian Inc. & KK All Rights Reserved. 54. VoltDB Java Copyright 2012 Cloudian Inc. & KK All Rights Reserved. 55. 2CloudianRedisCassandraHyperStore http://cloudian.jp/cloud-storage-products/cloudian.html Copyright 2012 Cloudian Inc. & KK All Rights Reserved. 56. Cloudian Admin (Redis) HTTPS HTTP QoS DB/ HTTPS S3 Servlets(Redis) HTTP HTTPData Explorer (Cassandra) UI (Cassandra) HTTP or HTTPS (S3) (Cassandra) 56 57. Cassandra BLOB column family / ACL () Cassandra S3 Amazon S3 multi-part API 10MB HTTP HEAD HyperStore 58. 30 95() () 100KB(/) GetPutGetPutHibari 0.1.8 9.26812.29961.914 75.934 2,073 3,733,136Cassandra 1.0 28.551 9.992 379.745155.6801,699 3,060,198Cassandra 0.8.6 34.099 8.4021,015.888 333.0481,336 2,406,446 1KBHibari 0.1.81.0271.6763.0692.881 8,775 15,804,196Cassandra 1.0 1.0160.9492.4764.789 8,748 15,755,306Cassandra 0.8.6 1.2820.9485.7292.243 8,700 15,668,017:NOSQL20124 59. HyperStoreAdminHyperStore(Redis) S3 QoS(Redis) HyperStore CassandraManager Data Store (Cassandra)CassandraCloudian CassandraAccounting(Cassandra) Reporting(Cassandra) 60. HyperStore: 50.0 37.5 >30% fasterms 25.0 PUT-CassPUT-HS 12.5 0 0 1 10 100 1000 KB60.045.0>400% fasterms30.0GET-CassGET-HS15.00 0 1 10 100 1000 KB 61. Copyright 2012 Cloudian Inc. & KK All Rights Reserved. 62. NOSQL () () () ()256: (2012/4/25)ISBN-10: 4897978874ISBN-13: 978-4897978871 Copyright 2012 Cloudian Inc. & KK All Rights Reserved. 63. NoSQLShashank Tiwari () () ()HBaseCassandraMongoDBRedis407: (2012/5/18)ISBN-10: 4798126055ISBN-13: 978-4798126050Copyright 2012 Cloudian Inc. & KK All Rights Reserved. 64. ()MongoDBVoltDB360: BP (2012/5/17)ISBN-10: 4822234630ISBN-13: 978-4822234638Copyright 2012 Cloudian Inc. & KK All Rights Reserved. 65. NoSQL ()MongoDBRedis232: (2011/04)ISBN-10: 4798029599ISBN-13: 978-4798029597 Copyright 2012 Cloudian Inc. & KK All Rights Reserved. 66. HBaseLars George ()Sky ()584: (2012/7/25)ISBN-10: 4873115663ISBN-13: 978-4873115665 Copyright 2012 Cloudian Inc. & KK All Rights Reserved. 67. NOSQL NOSQL Copyright 2012 Cloudian Inc. & KK All Rights Reserved. 68. Questions?http://gplus.to/tatsuya6502http://twitter.com/tatsuya6502Copyright 2012 Cloudian Inc. & KK All Rights Reserved.