Embed Size (px)
DESCRIPTION
This session will give you an update on what SUSE is up to in the Big Data arena. We will take a brief look at SUSE Linux Enterprise Server and why it makes the perfect foundation for your Hadoop Deployment.
Citation preview
SUSE for Hadoop & Big Data
Stephen MoggSUSE UKOctober 2014
2
About SUSE
• SUSE Employee 4 years • Systems Engineer
About Me
• Established 1992• Original Provider of Enterprise Linux
3
If you want to know more about SUSE
• New Certifications• New Resources• New Lab
SUSE for Hadoop
5
Big Data Reference Architecture
Source: Hortonworks Modern Data Architecture - http://hortonworks.com/partner/suse/
Operating System OS / Cloud Platform
6
SUSE Big Data Reference Architecture
Source: Hortonworks Modern Data Architecture - http://hortonworks.com/partner/suse/
7
SUSE Big Data Partners
Hadoop Data Systems
Applications Services
8
Additional level of testing and quality assurance to make sure SUSE Linux Enterprise Server integrates with partner software, saving our customers time while providing them with an assurance of interoperability.
Certified for Leading Hadoop Platforms
Cloudera CDH 5
Hortonworks HDP2
We hereby declare thatSUSE Linux Enterprise Server
is officially certified for:
Market Leadership
10
SUSE in High Performance
“Teradata's extensive financial, technical, and management resources can create a unique, high-performance Hadoop appliance that few other vendors can match.”
– Forrester Feb 2014
High Performance Computing‒ Half of the world's largest super computer
clusters run SUSE Linux Enterprise Server
Mainframe Computing‒ Over 80% of all Linux running on mainframe
computers is SUSE Linux
SAP Hana‒ SUSE Linux Enterprise Server is the
recommended OS for the market leading analytics appliance, SAP HANA.
Teradata‒ SUSE Linux Enterprise Server is the OS
foundation for Hadoop in the Aster Big Analytics Appliance
IBM Watson‒ Power artificial intelligence computer runs SUSE
Linux and Hadoop
11
What Makes an Optimal Foundation for Hadoop?
SLAs andBusiness Continuity
Resource Utilization and Efficiency
Security and Compliance
Affordable, No Vendor Lock-in
12
Power, Scalability
Horizontal/Vertical Scalability:Large capacity and faster system interconnect (OFED, Infiniband)
Reliability, Availability,Serviceability: Swap-over NFS
Built-in open source multi-path IO CPU/Memory hot-plugging
A rock-solid, certified foundation for deploying
Hadoop clusters.
Huge Data, Massive Compute:4096 logical CPU
64 TiB RAM
Supports latest Intel CPUs:Ivy Bridge v2
Haswell
SUSE Linux Enterprise Server
13
Flexibility, Agility
Massively Scalable Private Cloud Implementations
Deploy pre-configured Hadoop clusters on
KVM, Xen, Hyper-V, ESXi
Spin up fully configured and optimized Hadoop Cluster in
minutes for dev/test
Scale-out Hadoop clusterInfrastructure easily
API for Cloud-aware Applications
Hadoop in the Cloud: OpenStack based
enterprise ready IaaS Cloud Platform.
SUSE Cloud
14
Improve Resource Utilization and Efficiency
Centralized Server Infrastructure Management
Software and Patch Management for Linux and
Hadoop
Batch-deploy config files to entire Hadoop cluster
Asset Management and Reporting
Application and Infrastructure Monitoring
Batch Command Speeds UpCluster Implementation
A perfect complement to the monitoring and
management capabilities provided in the Hadoop
cluster management software.
SUSE Manager
15
Security and Certifications
Security Features SUSE Linux Enterprise Server
System Hardening YaST2 Security Center
Application Confinement AppArmor
System Confinement SE Linux (stack support)
Intrusion Detection (file system) AIDE
Fine-grained Access Rights File system POSIX capabilities
Encryption CapabilitiesThree ways: Full disk, Volume, Filesystem (eCryptFS)
Certifications Carrier Grade Linux (CGL) 4.0 IPv6 (refresh)
Measure and Monitor System Integrity During Reboot
Trusted Platform Modules (TPM)—Trusted Computing
System Requirements for Cryptographic Modules FIPS 140-2 Validation for OpenSSL
Common Criteria for IT Security EvaluationCommon Criteria Certification for SP2 (x86 64 with KVM; IBM System z)
90% of companies cite data access and data protection as either extremely or very important security capabilities. - IDG Big Data Survey 2014
16
Summary: Key Features and Benefits
Key Features Benefits
Reliability, Availability, Serviceability, Scalability
Swap over NFS Cut cost with less expensive diskless servers
Kernel 3.0 Enhanced RAS capabilities
Intel Ivy-Bridge 2 and Haswell Support Harness the latest CPU technologies and provides excellent vertical scalability4096 Logical CPU, 64TiB RAM Support
InfiniBand, iSCSI Target (LIO) and OFED Faster connectivity with networking and storage equipment
Dual Hypervisor Support: Xen and KVM
Maximum choice both as a host and as a guestCross-platform Virtualization
Optimized for vSphere, Hyper-V, Open Source Hypervisors
Linux Containers Light weight OS level virtualization
UEFI Secure Boot Less malicious attach risk in boot
Security and Compliance
FIPS 140-2 Validation and Common Criteria Certification
Security standard compliance
AppArmor Protects from external/internal threats and zero-day attacks
Integrated System Management
Snapper and BTRFS Snapshot and rollback for easy management
YaST, AutoYaST and ZyppIntegrated single system management and fast update tools
Interop with Other Platforms
SAMBA 3.6 Compatible with Windows
IPv6 Compliance Networking with IPv6 equipment
SUSE Big Data Resources
18
Hadoop on SLES
Best Practices White Paper:
• Deployment scenarios
• Proposed Architecture using SLES
• Infrastructure considerations
• Basic optimization of the Linux OS
• Installation and configuration of Hadoop on SLES
19
SUSE Manager and Hadoop
Step-by-step guide for using SUSE Manager to deploy Cloudera on SLES:• Automate OS provisioning
• Deploy new servers with identical characteristics
• Auto-deployment of RPM-based applications
• Centralize management of configuration files
• Connect to SUSE Customer Center for updates
• Create / manage multiple organizations from a single remote console.
• Create customized repositories
• Maintain the security of enterprise systems
• Leverage the SUSE Manager API to create custom scripts to manage tasks or integrate third-party applications and management tools
20
Hadoop / HP Reference Architecture
HP Reference Architechture:
• Written by SUSE, HP & Hortonworks,
• Proposed Architecture using SLES
• HP Recommends SLES
21
SUSE Big Data Lab
• Benchmarking
• Software certification
• Integration / test
• Reference architectures
Big Data Cluster in USA for:
22
SUSE Linux Expert Days
• SUSE and Big Data
• Towards Zero Uptime with SUSE Tecnology
• SUSE Linux Enterprise Server
https://www.suse.com/events/slef-2014/#Liste
Learn About:
Register:
23
Learn More
Visit our web site www.suse.com/solutions/platform.html#big_data
Read our whitepapers Deploying Hadoop on SLESDeploy and Manage Hadoop with SUSE ManagerHP Reference Architecture.
Contact us [email protected]
24
Unpublished Work of SUSE LLC. All Rights Reserved.This work is an unpublished work and contains confidential, proprietary and trade secret information of SUSE LLC. Access to this work is restricted to SUSE employees who have a need to know to perform tasks within the scope of their assignments. No part of this work may be practiced, performed, copied, distributed, revised, modified, translated, abridged, condensed, expanded, collected, or adapted without the prior written consent of SUSE. Any use or exploitation of this work without authorization could subject the perpetrator to criminal and civil liability.
General DisclaimerThis document is not to be construed as a promise by any participating company to develop, deliver, or market a product. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. SUSE makes no representations or warranties with respect to the contents of this document, and specifically disclaims any express or implied warranties of merchantability or fitness for any particular purpose. The development, release, and timing of features or functionality described for SUSE products remains at the sole discretion of SUSE. Further, SUSE reserves the right to revise this document and to make changes to its content, at any time, without obligation to notify any person or entity of such revisions or changes. All SUSE marks referenced in this presentation are trademarks or registered trademarks of Novell, Inc. in the United States and other countries. All third-party trademarks are the property of their respective owners.
