10
#ISSlearn REAL-TIME ANALYTICS USING COUCHBASE + ELASTIC STACK 15 July 2016 / Francisco Liwa 1 (Total Slides=8) T:\S-ITSM-F\OM\Module 1 v3.pptx © 2016 National University of Singapore. All Rights Reserved

NUS-ISS Learning Day 2016 - Big Data Analytics

Embed Size (px)

Citation preview

Page 1: NUS-ISS Learning Day 2016 - Big Data Analytics

#ISSlearn

REAL-TIME ANALYTICS USING COUCHBASE + ELASTIC STACK

15 July 2016 / Francisco Liwa

1(Total Slides=8) T:\S-ITSM-F\OM\Module 1 v3.pptx © 2016 National University of Singapore. All Rights Reserved

Page 2: NUS-ISS Learning Day 2016 - Big Data Analytics

#ISSlearn

Real Time Analytics Using Couchbase + Elastic Stack

• What is Couchbase• What is Elastic Stack

- ElasticSearch- Kibana

2(Total Slides=8) T:\S-ITSM-F\OM\Module 1 v3.pptx © 2016 National University of Singapore. All Rights Reserved

Page 3: NUS-ISS Learning Day 2016 - Big Data Analytics

#ISSlearn

What is Couchbase

• A NoSQL DataBase• In-Memory• Scalable• Distributed System• Document-Store• Key-Value Store• JSON Format

3(Total Slides=8) T:\S-ITSM-F\OM\Module 1 v3.pptx © 2016 National University of Singapore. All Rights Reserved

Page 4: NUS-ISS Learning Day 2016 - Big Data Analytics

#ISSlearn

What is Elastic Stack

• Group of Application Software for Search and Analytics from the Elastic Company • Elastic Search• Logstash• Kibana• Filebeat• PacketBeat• Etc.

4(Total Slides=8) T:\S-ITSM-F\OM\Module 1 v3.pptx © 2016 National University of Singapore. All Rights Reserved

Page 5: NUS-ISS Learning Day 2016 - Big Data Analytics

#ISSlearn

What is ElasticSearch

• Multi-tenant , realtime and distributed search and analytics engine.• Opensource , Apache license 2• Unstructured search• Structured Search• Analytics• Full text search (lucene-based)

5(Total Slides=8) T:\S-ITSM-F\OM\Module 1 v3.pptx © 2016 National University of Singapore. All Rights Reserved

Page 6: NUS-ISS Learning Day 2016 - Big Data Analytics

#ISSlearn

What is Kibana

• Kibana is an open source analytics and visualization platform

• Designed for ElasticSearch

•  Search, view, and interact with data stored in Elasticsearch indices

• Perform advanced data analysis and visualize your data in a variety of charts, tables, and maps.

6(Total Slides=8) T:\S-ITSM-F\OM\Module 1 v3.pptx © 2016 National University of Singapore. All Rights Reserved

Page 7: NUS-ISS Learning Day 2016 - Big Data Analytics

#ISSlearn

DEMO

SUBTITLE

7(Total Slides=8) T:\S-ITSM-F\OM\Module 1 v3.pptx © 2016 National University of Singapore. All Rights Reserved

Page 8: NUS-ISS Learning Day 2016 - Big Data Analytics

#ISSlearn

Real time Analytics Using Couchbase and Elastic Stack

• Hardware:2 Machines - 16 GB Memory / 160 GB Disk / SGP1 - CentOS 6.8

• prereq: Java: yum install java-1.8.0-openjdk.x86_64

8(Total Slides=8) T:\S-ITSM-F\OM\Module 1 v3.pptx © 2016 National University of Singapore. All Rights Reserved

Page 9: NUS-ISS Learning Day 2016 - Big Data Analytics

#ISSlearn

Real time Analytics Using Couchbase and Elastic Stack

• A. Setup NoSQL DB Cluster 1. setup Couchbase - http://www.couchbase.com/ 3.x Community edition - 128.199.86.160:8091 (password1.)• B. Setup Elastic Stack 2. setup Elasticsearch - https://www.elastic.co/

* https://www.elastic.co/downloads/past-releases/elasticsearch-2-3-3 3. setup Elasticsearch-head plugin - elasticsearch plugin for web front end (

https://github.com/mobz/elasticsearch-head ) http://localhost:9200/_plugin/head/http://188.166.214.126/ 4. setup KIbana - a web visualization tool from Elastic ( https://www.elastic.co/products/kibana )

Kibana 4.5 5 setup elasticsearch-couchbase transport plugin - couchbase transport plugin for elasticsearch

( https://github.com/couchbaselabs/elasticsearch-transport-couchbase) 6. INGEST DATA• (

https://www.digitalocean.com/community/tutorials/how-to-install-elasticsearch-1-7-logstash-1-5-and-kibana-4-1-elk-stack-on-centos-7)

9(Total Slides=8) T:\S-ITSM-F\OM\Module 1 v3.pptx © 2016 National University of Singapore. All Rights Reserved

Page 10: NUS-ISS Learning Day 2016 - Big Data Analytics

#ISSlearn

THANK YOU [email protected]/[email protected]

10(Total Slides=8) T:\S-ITSM-F\OM\Module 1 v3.pptx © 2016 National University of Singapore. All Rights Reserved