Click here to load reader
View
0
Download
0
Embed Size (px)
MURAL Software Installation Guide
Version 3.9
Published: 2016-10-27
MURAL Software Installation Guide
Copyright © 2016, Cisco Systems, Inc.
Americas Headquarters
Cisco Systems, Inc.
170 West Tasman Drive
San Jose, CA 95134-1706 USA
http://www.cisco.com
Tel: 408 526-4000
800 553-NETS (6387)
Fax: 408 527-0883
3 Copyright © 2016, Cisco Systems, Inc.
MURAL Software Installation Guide
THE SPECIFICATIONS AND INFORMATION REGARDING THE PRODUCTS IN THIS MANUAL ARE SUBJECT TO CHANGE
WITHOUT NOTICE. ALL STATEMENTS, INFORMATION, AND RECOMMENDATIONS IN THIS MANUAL ARE BELIEVED TO
BE ACCURATE BUT ARE PRESENTED WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED. USERS MUST TAKE
FULL RESPONSIBILITY FOR THEIR APPLICATION OF ANY PRODUCTS.
THE SOFTWARE LICENSE AND LIMITED WARRANTY FOR THE ACCOMPANYING PRODUCT ARE SET FORTH IN THE
INFORMATION PACKET THAT SHIPPED WITH THE PRODUCT AND ARE INCORPORATED HEREIN BY THIS
REFERENCE. IF YOU ARE UNABLE TO LOCATE THE SOFTWARE LICENSE OR LIMITED WARRANTY, CONTACT YOUR
CISCO REPRESENTATIVE FOR A COPY.
The Cisco implementation of TCP header compression is an adaptation of a program developed by the
University of California, Berkeley (UCB) as part of UCB’s public domain version of the UNIX operating system.
All rights reserved. Copyright © 1981, Regents of the University of California.
NOTWITHSTANDING ANY OTHER WARRANTY HEREIN, ALL DOCUMENT FILES AND SOFTWARE OF THESE SUPPLIERS
ARE PROVIDED “AS IS” WITH ALL FAULTS. CISCO AND THE ABOVE-NAMED SUPPLIERS DISCLAIM ALL WARRANTIES,
EXPRESSED OR IMPLIED, INCLUDING, WITHOUT LIMITATION, THOSE OF MERCHANTABILITY, FITNESS FOR A
PARTICULAR PURPOSE AND NONINFRINGEMENT OR ARISING FROM A COURSE OF DEALING, USAGE, OR TRADE
PRACTICE.
IN NO EVENT SHALL CISCO OR ITS SUPPLIERS BE LIABLE FOR ANY INDIRECT, SPECIAL, CONSEQUENTIAL, OR
INCIDENTAL DAMAGES, INCLUDING, WITHOUT LIMITATION, LOST PROFITS OR LOSS OR DAMAGE TO DATA
ARISING OUT OF THE USE OR INABILITY TO USE THIS MANUAL, EVEN IF CISCO OR ITS SUPPLIERS HAVE BEEN
ADVISED OF THE POSSIBILITY OF SUCH DAMAGES.
Cisco and the Cisco Logo are trademarks of Cisco Systems, Inc. and/or its affiliates in the U.S. and other
countries. A listing of Cisco's trademarks can be found at www.cisco.com/go/trademarks. Third party
trademarks mentioned are the property of their respective owners. The use of the word partner does not imply
a partnership relationship between Cisco and any other company. (1005R)
Any Internet Protocol (IP) addresses and phone numbers used in this document are not intended to be actual
addresses and phone numbers. Any examples, command display output, network topology diagrams, and other
figures included in the document are shown for illustrative purposes only. Any use of actual IP addresses or
phone numbers in illustrative content is unintentional and coincidental.
MURAL Software Installation Guide
Copyright © 2016, Cisco Systems, Inc.All rights reserved.
Copyright © 2016, Cisco Systems, Inc. 4
http://www.cisco.com/go/trademarks
MURAL Software Installation Guide
Table of Contents
1. Installation Overview 8
1.1 Before you begin 8
1.2 System Components 8
1.3 Standard Setup 9
1.4 Installation Package 10
1.5 Customer Information Questionnaire (CIQ) Sheet 11
2. Installation Phases 13
2.1 Installing Operating System 13
2.2 Configuring Mural Nodes 13
2.3 Configuring ASR and IBs 13
2.4 Processing the Data 14
3. Installing Operating System 15
3.1 Manufacturing the Initial Node 15
3.2 Configuring Node as Master GMS Node 20
3.3 Manufacturing Other Nodes using the GMS Node 22
3.4 Preparing the Final XML with WWIDs and Applications 27
3.5 Applying Patches on MURAL Nodes 30
4. Configuring Mural Nodes 31
4.1 Creating GMS XML using Deployment Wizard 31
4.2 Assigning Role to MURAL Nodes 36
4.3 Configuring Site-Specific Applications 39
4.4 Verifying the Setup 39
5. Configuring ASR and IBs 43
5 Copyright © 2016, Cisco Systems, Inc.
MURAL Software Installation Guide
5.1 Updating IBs 43
5.2 Adding ASR Gateways 44
5.3 Modifying Behaviour for Cell Sector Annotation 47
5.4 Verifying Collector Process 49
6. Processing the Data 50
6.1 Verifying Incoming Data 50
6.2 Configuring Oozie Jobs 52
6.3 Validating Data on Nodes 54
6.4 Starting UI Processes and Verifying Data 61
6.5 Updating Whitelists 63
6.6 Setting Up Offline Reports 64
A. Fetching MAC ID from UCS Manager 67
B. PXE Boot of Blades using the KVM console 68
C. Getting the WWIDs of LUNs 70
D. Verifying Installation with Dummy Data 72
D.1 Prerequisite 73
D.2 Assumptions 77
D.3 Run the Complete Pipe 78
D.4 Clean up the Pipe 82
E. File Pattern Regular Expression 85
F. Mandatory Parameters for Incoming ASR Files 90
F.1 Mandatory Attributes for Flow EDRs for MURAL 90
F.2 Mandatory HTTP EDR Attributes for MURAL 91
F.3 ASR-Side Configuration 92
Copyright © 2016, Cisco Systems, Inc. 6
MURAL Software Installation Guide
G. Understanding the CIQ Sheet 94
G.1 MiscInfo 94
G.2 NetworkInfo 95
G.3 ClusterInfo 96
G.4 NodeInfo 96
G.5 StorageInfo 97
7 Copyright © 2016, Cisco Systems, Inc.
MURAL Software Installation Guide
1. Installation Overview
This document describes how to install the MURAL application. MURAL provides
Web-based reporting and analytics abilities for deep packet inspection (DPI) data
emerging from your network.
1.1 Before you begin
Before installing MURAL, you should possess a working knowledge of the fol-
lowing:
l Linux
l Cisco UCS
Prior to installing the application, we recommend that you:
l Review the MURAL 3.9 Release Notes.
l Complete a training course on MURAL.
l Ensure that installation package components are available. For more inform-
ation see "Installation Package " on page 10.
l Have an understanding of Cisco UCS hardware administration.
l Ensure that MURAL system hardware installation has been completed suc-
cessfully as specified in the bill of materials (BOM) and the setup is ready to
install the system.
l The number of each type of node is customized for your deployment.
l Update the CIQ sheet completely, excluding ‘storageInfo’ section with MURAL
setup details as required. For more information, see "Understanding the CIQ
Sheet" on page 94.
1.2 System Components
The following figure illustrates the components of the MURAL platform, focusing
on how the data flows through the system:
Copyright © 2016, Cisco Systems, Inc. 8
MURAL Software Installation Guide
1.3 Standard Setup
The MURAL platform consists of the following nodes, each hosted on blades in the
UCS Chassis:
1. General Management System (GMS)—Provides centralized management of
the Reflex platform nodes, such as remote manufacturing of blades
(installing the MURAL operating system), patch management, monitoring
of all nodes and operations, and importing and running node con-
figurations. The GMS node cluster supports high availability.
2. Collector—Collects data streams pushed to the Reflex platform, interprets
the exported flows, enriches them with static data, and assembles data
sets. The Collector stores the raw data in the Hadoop file system (HDFS)
and sends it to the Compute node. The Collector node cluster can have any
number of servers, in pairs for master and standby and uses 1+1 redund-
ancy (transparent failover between pairs of active-active nodes).
3. UI/Caching (Rubix)—Hosts the Rubix engine and data cache. The Rubix
engine queries the Insta nodes constantly and when new data is available,
it fetches it to store in the data cache, so that it can respond more quickly
9 Copyright © 2016, Cisco Systems, Inc.
MURAL Software Installation Guide
to requests from the UI engine. The Caching node is sometimes called the
Rubix node. The Caching node uses N+1 redundancy in active-active mode.
4. Compute node—Analyzes and aggregates the data, creating data cubes. The
Compute node cluster can have any number of servers, depending on your
deployment, and uses N+1 redundancy.
5. Insta node—Stores and manages the processed data in a columnar data-
base. It also manages the Insta database, which stores processed data
cubes. The Insta node cluster has two servers with 1+1 redundancy.
Apart from standard installations, MURAL system can be prepared with fewer
blades by accommodating two or three application components into a single
cluster, as described in the following sections.
1.3.1 Starter Pack Setup
In the Starter Pack setup, GMS, Collector (with Name-node) and UI components
are hosted together on the same cluster.
1.3.2 Medium Pack Setup
In the Medium Pack setup, G