#ISSlearn
REAL-TIME ANALYTICS USING COUCHBASE + ELASTIC STACK
15 July 2016 / Francisco Liwa
1(Total Slides=8) T:\S-ITSM-F\OM\Module 1 v3.pptx © 2016 National University of Singapore. All Rights Reserved
#ISSlearn
Real Time Analytics Using Couchbase + Elastic Stack
• What is Couchbase• What is Elastic Stack
- ElasticSearch- Kibana
2(Total Slides=8) T:\S-ITSM-F\OM\Module 1 v3.pptx © 2016 National University of Singapore. All Rights Reserved
#ISSlearn
What is Couchbase
• A NoSQL DataBase• In-Memory• Scalable• Distributed System• Document-Store• Key-Value Store• JSON Format
3(Total Slides=8) T:\S-ITSM-F\OM\Module 1 v3.pptx © 2016 National University of Singapore. All Rights Reserved
#ISSlearn
What is Elastic Stack
• Group of Application Software for Search and Analytics from the Elastic Company • Elastic Search• Logstash• Kibana• Filebeat• PacketBeat• Etc.
4(Total Slides=8) T:\S-ITSM-F\OM\Module 1 v3.pptx © 2016 National University of Singapore. All Rights Reserved
#ISSlearn
What is ElasticSearch
• Multi-tenant , realtime and distributed search and analytics engine.• Opensource , Apache license 2• Unstructured search• Structured Search• Analytics• Full text search (lucene-based)
5(Total Slides=8) T:\S-ITSM-F\OM\Module 1 v3.pptx © 2016 National University of Singapore. All Rights Reserved
#ISSlearn
What is Kibana
• Kibana is an open source analytics and visualization platform
• Designed for ElasticSearch
• Search, view, and interact with data stored in Elasticsearch indices
• Perform advanced data analysis and visualize your data in a variety of charts, tables, and maps.
6(Total Slides=8) T:\S-ITSM-F\OM\Module 1 v3.pptx © 2016 National University of Singapore. All Rights Reserved
#ISSlearn
DEMO
SUBTITLE
7(Total Slides=8) T:\S-ITSM-F\OM\Module 1 v3.pptx © 2016 National University of Singapore. All Rights Reserved
#ISSlearn
Real time Analytics Using Couchbase and Elastic Stack
• Hardware:2 Machines - 16 GB Memory / 160 GB Disk / SGP1 - CentOS 6.8
• prereq: Java: yum install java-1.8.0-openjdk.x86_64
8(Total Slides=8) T:\S-ITSM-F\OM\Module 1 v3.pptx © 2016 National University of Singapore. All Rights Reserved
#ISSlearn
Real time Analytics Using Couchbase and Elastic Stack
• A. Setup NoSQL DB Cluster 1. setup Couchbase - http://www.couchbase.com/ 3.x Community edition - 128.199.86.160:8091 (password1.)• B. Setup Elastic Stack 2. setup Elasticsearch - https://www.elastic.co/
* https://www.elastic.co/downloads/past-releases/elasticsearch-2-3-3 3. setup Elasticsearch-head plugin - elasticsearch plugin for web front end (
https://github.com/mobz/elasticsearch-head ) http://localhost:9200/_plugin/head/http://188.166.214.126/ 4. setup KIbana - a web visualization tool from Elastic ( https://www.elastic.co/products/kibana )
Kibana 4.5 5 setup elasticsearch-couchbase transport plugin - couchbase transport plugin for elasticsearch
( https://github.com/couchbaselabs/elasticsearch-transport-couchbase) 6. INGEST DATA• (
https://www.digitalocean.com/community/tutorials/how-to-install-elasticsearch-1-7-logstash-1-5-and-kibana-4-1-elk-stack-on-centos-7)
9(Total Slides=8) T:\S-ITSM-F\OM\Module 1 v3.pptx © 2016 National University of Singapore. All Rights Reserved
#ISSlearn
THANK YOU [email protected]/[email protected]
10(Total Slides=8) T:\S-ITSM-F\OM\Module 1 v3.pptx © 2016 National University of Singapore. All Rights Reserved