1

Running SAP Data Hub On Kubernetes With SUSE CaaS Platform

TUT-1212

Overview, Installation & Outlook

Kevin Klinger

SAP Solutions Architect

kevin.klinger@suse.com

2

Agenda

1. Introduction

2. What is SUSE Container as a Service

3. What is SAP Data Hub

4. Bring them together

5. Requirements + How to install

3

About The

• Founded in 1999

• Interdisciplinary team with employees from

SAP, hard- & software vendors

• Innovation projects

• Development support

• 3rd level customer support

• Our mission: Make Linux #1 platform

for SAP workloads 3

4

Unrivaled Relationship Making SUSE the Smart Choice for SAP Workloads

• ~90%+ of SAP HANA customers rely on SUSE Linux

• 70% of SAP NetWeaver-on-Linux customers rely on SUSE Linux

• 20 years of joint testing and development at the SAP LinuxLab

• Seamless support from SAP and SUSE

• SLES for SAP Applications is the #1 choice for SAP and SAP customers

• Joint collaboration on Cloud Foundry

• Data Hub 2 validated with SUSE Container as a Service Platform

+

5

What Is SUSE

CaaS Platform

6

3 Key Technology Components

7

Suse CaaS Platform

8

What Is SAP Data

Hub

10

10

SAP Data Hub 2 - Overview

SUSE CaaS PlatformSUSE Enterprise StorageSUSE Linux Enterprise Server

for SAP Applications

SAP S/4HANA

SAP BW/4 HANA

SAP HANA

Other Databases

SAP Cloud Applications

3rd Party Apps

Connected Apps

Data Lake,Machine Learning,Predictive Analytics

AWS S3, GCP GCSAzure ADL, WASB

SAP Data Hub

Data Discovery &Pipelines

Orchestration & Monitoring

Ingestion & Integration

Data Storage

Hadoop

Cloud Storagescontainerized

11

SAP Data Hub

+

SUSE CaaS

Platform

12

SAP Data Hub

Architectural Overview on SUSE CaaS Platform and SUSE Enterprise Storage

SAP Data Hub Foundation containerized

Tenant Applications / Services (Managed by System Management)

DiagnosticsInternal

SAP HANA

Pipeline Modeler

Database Tools

Flow Agent

Spark on K8S

Metadata Explorer

Connection Management

Vora Database

System Management

• SUSE CaaS Platform (Kubernetes)

• SUSE Enterprise Storage

not containerized

optional

Hadoop cluster

HDFS / Spark

Vora Spark Extension

Docker™ Registry

13

14

Requirements

And

Installation

15

Requirements SAP Data Hub 2.7

• 256 GB RAM

• 64 CPUs

• 2,100 GB disk (persistent volumes)

• 100 GB ephemeral disk for each of the Kubernetes worker nodes

• Container registry with at least 60 GB free space

Official sizing guide:

https://help.sap.com/doc/d48a2185992f4148aabd525f1f781606/2.7.latest/en-

US/loiod48a2185992f4148aabd525f1f781606.pdf

16

Reference Architecture

• For on-premise solutions

• Created by Lenovo, SUSE and SAP:

https://lenovopress.com/lp0897.pdf

• Valid for all Data Hub Version <= 2.6

17

17

Installation order

SUSE CaaS Platform cluster

SUSE Enterprise Storage cluster

SAP Data Hub

Linux Workstation

with Kubernetes client,Docker, Helm,

Data Hub Installer

Private Docker Registry

SLES 12/15 withDocker Registry and Portus

1

2

3

4

5

18

Setup The Workstation

• Install the operating system (e.g. OpenSUSE Leap/Tumbleweed)

• Install Docker™

• Install Kubernetes

• Install Helm

• Download SAP Data Hub

1

19

Install SUSE Enterprise Storage

• At least four nodes required

• Follow the SUSE Enterprise Storage Deployment Guide at:

https://documentation.suse.com/ses/5.5/single-html/ses-deployment/#book-storage-deployment

2

20

Install SUSE CaaS Platform

3

• Install Master & Worker Nodes

(SUSE Linux Enterprise Server)

• Install Load Balancer

(e.g. SUSE Linux Enterprise Server)

21

Install SUSE CaaS Platform

• Bootstrap the cluster using skuba:

• skuba cluster init –control-plane <LB_IP/FQDN> my-cluster

• skuba node bootstrap --user sles --sudo --target <IP/FQDN> <NODE_NAME>

• skuba node join --role <master/worker> --user sles --sudo --target <IP/FQDN> <NODE_NAME>

• skuba cluster status

3

22

Setup Your Private Docker Registry

• Install SLES with container module

• Install Docker Registry and Portus

• Generate SSL certificates for container-registry host

(Signed by a valid CA or self-signed)

• Configure Docker Registry and Portus (according to SLES installation guide)

• Distribute the root CA to all CaaSP hosts and management workstation

• Test registry (docker login https://my-registry:5000 –u <user>)

4

23

Install SAP Data Hub

2 ways to install SAP Data Hub:

1. Install.sh script

2. Maintenance Planner & Software Lifecycle Plugin

https://help.sap.com/viewer/product/SAP_DATA_HUB/

5

24

24

./install.sh \

--cert-domain=master-node.testlab.intern \--sap-registry-login-type 2 \

--sap-registry-login-username=<S-USER> \

--cert-domain=master-node.testlab.intern \--sap-registry-login-password=<password> \

--vora-admin-username=admin \

--vora-admin-password=<password> \--vora-system-password=<password> \

--extra-arg=vora-vsystem.vSystem.nodePort=32123 \--extra-arg=vora-dqp.components.txCoordinator.nodePort=30343 \

--extra-arg=vora-cluster.components.txCoordinator.hanawire.portNumber=32215 \

--namespace=datahub24 \--registry=container-registry.testlab.intern:5000 \

--interactive-security-configuration=no \

--enable-checkpoint-store=no \--image-pull-secret=regcred \

--pv-storage-class=nfs-client \--dlog-storage-class=nfs-client \

--disk-storage-class=nfs-client \

--consul-storage-class=nfs-client \--hana-storage-class=nfs-client \

--accept-license \

--confirm-settings \--install

5

Install SAP Data Hub

25

25

SUSE CaaS Platform cluster

SUSE Enterprise Storage cluster

SAP Data Hub

Data Hub Installer

Running to theManagement Workstation

Private Docker Registry

Deplo

ys w

ith H

ELM

chart

spro

vis

ions p

ers

iste

nt

volu

mes

pulls

images

pushesimages

valid

ate

s D

ata

Hub insta

llation

runs in containers / starts containers

store and pull data

SAP ContainerRegistry pulls images1.

1.

2.

2.

3.

5

Install SAP Data Hub

26

Have A Lot Of Fun!

27

SUSE CaaS Platform & SUSE Enterprise Storage

Product landing-pages

https://www.suse.com/de-de/products/caas-platform/

https://www.suse.com/de-de/products/suse-enterprise-storage/

Deployments Guides, Administration Guides & more

https://documentation.suse.com/suse-caasp/4.0/

https://documentation.suse.com/ses/5.5/

SAP Data Hub

Product landing-page

https://www.sap.com/products/data-hub.html

Installation Guide, Administration Guide & more

https://help.sap.com/viewer/product/SAP_DATA_HUB/2.7.latest/en-US

Resources

29

General Disclaimer

This document is not to be construed as a promise by any participating company to

develop, deliver, or market a product. It is not a commitment to deliver any material,

code, or functionality, and should not be relied upon in making purchasing

decisions. SUSE makes no representations or warranties with respect to the contents

of this document, and specifically disclaims any express or implied warranties of

merchantability or fitness for any particular purpose. The development, release, and

timing of features or functionality described for SUSE products remains at the sole

discretion of SUSE. Further, SUSE reserves the right to revise this document and to

make changes to its content, at any time, without obligation to notify any person or

entity of such revisions or changes. All SUSE marks referenced in this presentation are

trademarks or registered trademarks of SUSE, LLC, Inc. in the United States and other

countries. All third-party trademarks are the property of their respective owners.