57

Quantity Category Brand Model Part Edge Cluster Standard setup 3 64-bit x86 server / / Haswell X86 microarchitecture or better 1G intf and 10G intf 4 Openflow switch EdgeCore AS6712-32X

  • Upload
    others

  • View
    12

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Quantity Category Brand Model Part Edge Cluster Standard setup 3 64-bit x86 server / / Haswell X86 microarchitecture or better 1G intf and 10G intf 4 Openflow switch EdgeCore AS6712-32X
Page 2: Quantity Category Brand Model Part Edge Cluster Standard setup 3 64-bit x86 server / / Haswell X86 microarchitecture or better 1G intf and 10G intf 4 Openflow switch EdgeCore AS6712-32X

Page 3: Quantity Category Brand Model Part Edge Cluster Standard setup 3 64-bit x86 server / / Haswell X86 microarchitecture or better 1G intf and 10G intf 4 Openflow switch EdgeCore AS6712-32X

Page 4: Quantity Category Brand Model Part Edge Cluster Standard setup 3 64-bit x86 server / / Haswell X86 microarchitecture or better 1G intf and 10G intf 4 Openflow switch EdgeCore AS6712-32X

Edge Cluster in ONF-Connect Conference

Internet

Central Cluster in ONF Menlo Park

Page 5: Quantity Category Brand Model Part Edge Cluster Standard setup 3 64-bit x86 server / / Haswell X86 microarchitecture or better 1G intf and 10G intf 4 Openflow switch EdgeCore AS6712-32X

Quantity Category Brand Model Part

Edge Cluster

Standard setup

3 64-bit x86 server / / Haswell X86 microarchitecture or better

1G intf and 10G intf

4 Openflow switch EdgeCore AS6712-32X

1 L2 Management Switch D-Link DGS-1510-28X Support both 1G and 10G

1 Cabling (data plane, fiber) Robofiber QSFP-40G-03C

6 Cabling (management, copper)

/ CAT6, 3M

Central Cluster

3 64-bit x86 server / Haswell X86 microarchitecture or better

1 L2 Management Switch D-Link DGS-1510-28X

3 Cabling (management, copper)

/ CAT6, 3M

Page 6: Quantity Category Brand Model Part Edge Cluster Standard setup 3 64-bit x86 server / / Haswell X86 microarchitecture or better 1G intf and 10G intf 4 Openflow switch EdgeCore AS6712-32X

●○

●○

●○

NAT container

Redis container

BBUcontainer

Page 7: Quantity Category Brand Model Part Edge Cluster Standard setup 3 64-bit x86 server / / Haswell X86 microarchitecture or better 1G intf and 10G intf 4 Openflow switch EdgeCore AS6712-32X

Fabric

Fabric

Fabric

Fabric

Central Cluster

COMAC Fabric

Edge1

K8S K8SK8S

Edge2 Edge3 VPNRRU

Enodeb

ON

OS

Fab

ric

ON

OS

Slic

ing

XO

S

Pro

met

heu

s/G

rafa

na

COMAC Management Network & Virtual COMAC 3GPP CP Network

SRIOV SRIOVSRIOV

Virtual COMAC 3GPP UP Network Running on Fabric

CD

N-L

oca

l

SPG

W-U

L2 Management Network

Calico Calico Calico

Page 8: Quantity Category Brand Model Part Edge Cluster Standard setup 3 64-bit x86 server / / Haswell X86 microarchitecture or better 1G intf and 10G intf 4 Openflow switch EdgeCore AS6712-32X

Central 1

K8SK8S

COMAC Management Network & Virtual COMAC 3GPP CP Network

Calico

Calico

Central 2

VPNMM

E

HSS

SPG

W-C

Router

RA

N-C

U

Central 3

K8S

Calico

CD

N-R

emo

te

HSS

DB

Fabric

Fabric

FabricCOMAC Fabric

L2 Management NetworkFabric

Edge Cluster

Page 9: Quantity Category Brand Model Part Edge Cluster Standard setup 3 64-bit x86 server / / Haswell X86 microarchitecture or better 1G intf and 10G intf 4 Openflow switch EdgeCore AS6712-32X

● ://wiki.opencord.org/display/CORD/Trellis+Underlay+Fabric

Step2: Install OF-DPA package

●○ 32 ports are running in 1x40G mode. ○ Modify /etc/accton/ofdpa.conf to break out 1x40G into 4x10G.

Page 10: Quantity Category Brand Model Part Edge Cluster Standard setup 3 64-bit x86 server / / Haswell X86 microarchitecture or better 1G intf and 10G intf 4 Openflow switch EdgeCore AS6712-32X
Page 12: Quantity Category Brand Model Part Edge Cluster Standard setup 3 64-bit x86 server / / Haswell X86 microarchitecture or better 1G intf and 10G intf 4 Openflow switch EdgeCore AS6712-32X

● subnet: 119.0.0./24RRU← → SPGWU containerNode← →Node

● & Node subnet: 116.0.0./24 RRU← → BBU container

● Subnet: 13.1.1./24SPGWU ← → CDN or Internet GW.

Node

Calico

Calico

1G 10G

Node

Calico

Calico

1G 10G

Node

Calico

Calico

1G 10G

Internet

Page 13: Quantity Category Brand Model Part Edge Cluster Standard setup 3 64-bit x86 server / / Haswell X86 microarchitecture or better 1G intf and 10G intf 4 Openflow switch EdgeCore AS6712-32X

Page 14: Quantity Category Brand Model Part Edge Cluster Standard setup 3 64-bit x86 server / / Haswell X86 microarchitecture or better 1G intf and 10G intf 4 Openflow switch EdgeCore AS6712-32X
Page 15: Quantity Category Brand Model Part Edge Cluster Standard setup 3 64-bit x86 server / / Haswell X86 microarchitecture or better 1G intf and 10G intf 4 Openflow switch EdgeCore AS6712-32X

#OpenCORD

Page 16: Quantity Category Brand Model Part Edge Cluster Standard setup 3 64-bit x86 server / / Haswell X86 microarchitecture or better 1G intf and 10G intf 4 Openflow switch EdgeCore AS6712-32X

• Most popular open-source container-orchestration system• Just define your application as K8S resources like Deployment,

ConfigMap, Service, and so on• Helps automating deployment, management, and scaling

your-app.sh

kubectl create-f your_app.yaml

config.conf

kubectl scale--replicas=3 your-app.sh your-app.sh

your-app.sh

configmap.yml

your-app.sh

deployment.yml

Page 17: Quantity Category Brand Model Part Edge Cluster Standard setup 3 64-bit x86 server / / Haswell X86 microarchitecture or better 1G intf and 10G intf 4 Openflow switch EdgeCore AS6712-32X

Helm Charts• Collection of files that describes related set of K8S resources• Stored locally of fetched from remote chart repository

Helm• Renders Helm Charts and requests deployment to K8S• Composed of Tiller server and Helm client tool

Helm repo

deployment.yaml

Tillerhelm install your-app

Page 18: Quantity Category Brand Model Part Edge Cluster Standard setup 3 64-bit x86 server / / Haswell X86 microarchitecture or better 1G intf and 10G intf 4 Openflow switch EdgeCore AS6712-32X

••••••

•••

••••

https://github.com/opencord/helm-charts

Page 19: Quantity Category Brand Model Part Edge Cluster Standard setup 3 64-bit x86 server / / Haswell X86 microarchitecture or better 1G intf and 10G intf 4 Openflow switch EdgeCore AS6712-32X

#OpenCORD

Page 20: Quantity Category Brand Model Part Edge Cluster Standard setup 3 64-bit x86 server / / Haswell X86 microarchitecture or better 1G intf and 10G intf 4 Openflow switch EdgeCore AS6712-32X

hss mme spgwc

spgwu

DB

onos

fabric

cu

Page 21: Quantity Category Brand Model Part Edge Cluster Standard setup 3 64-bit x86 server / / Haswell X86 microarchitecture or better 1G intf and 10G intf 4 Openflow switch EdgeCore AS6712-32X

data plane switch

DB mme spgwuVF2 VF3

control plane switch

eth0eth0eth0

eth1

onos cu

hss spgwc cdn-local

cdn-remote

VF1

Page 22: Quantity Category Brand Model Part Edge Cluster Standard setup 3 64-bit x86 server / / Haswell X86 microarchitecture or better 1G intf and 10G intf 4 Openflow switch EdgeCore AS6712-32X

spgwu

eth0•••

•••

eth1(PF)

VF1 VF2

sriov-plugin

Page 23: Quantity Category Brand Model Part Edge Cluster Standard setup 3 64-bit x86 server / / Haswell X86 microarchitecture or better 1G intf and 10G intf 4 Openflow switch EdgeCore AS6712-32X

cassandra-0

cassandra-2

cassandra-1

hss

mme-apps6a-apps11-app

s1ap-app

spgwc

spgwu

db-sync bootstrap

Page 24: Quantity Category Brand Model Part Edge Cluster Standard setup 3 64-bit x86 server / / Haswell X86 microarchitecture or better 1G intf and 10G intf 4 Openflow switch EdgeCore AS6712-32X

Page 25: Quantity Category Brand Model Part Edge Cluster Standard setup 3 64-bit x86 server / / Haswell X86 microarchitecture or better 1G intf and 10G intf 4 Openflow switch EdgeCore AS6712-32X
Page 26: Quantity Category Brand Model Part Edge Cluster Standard setup 3 64-bit x86 server / / Haswell X86 microarchitecture or better 1G intf and 10G intf 4 Openflow switch EdgeCore AS6712-32X

••

Page 27: Quantity Category Brand Model Part Edge Cluster Standard setup 3 64-bit x86 server / / Haswell X86 microarchitecture or better 1G intf and 10G intf 4 Openflow switch EdgeCore AS6712-32X

•••

••

MME App in Container

Python Flask Server in Host

machine

Linux Server

IPC BrowserREST API

Page 28: Quantity Category Brand Model Part Edge Cluster Standard setup 3 64-bit x86 server / / Haswell X86 microarchitecture or better 1G intf and 10G intf 4 Openflow switch EdgeCore AS6712-32X

The click on the IMSI gives the various parameters of the UE context.

Page 29: Quantity Category Brand Model Part Edge Cluster Standard setup 3 64-bit x86 server / / Haswell X86 microarchitecture or better 1G intf and 10G intf 4 Openflow switch EdgeCore AS6712-32X
Page 30: Quantity Category Brand Model Part Edge Cluster Standard setup 3 64-bit x86 server / / Haswell X86 microarchitecture or better 1G intf and 10G intf 4 Openflow switch EdgeCore AS6712-32X

Page 31: Quantity Category Brand Model Part Edge Cluster Standard setup 3 64-bit x86 server / / Haswell X86 microarchitecture or better 1G intf and 10G intf 4 Openflow switch EdgeCore AS6712-32X
Page 32: Quantity Category Brand Model Part Edge Cluster Standard setup 3 64-bit x86 server / / Haswell X86 microarchitecture or better 1G intf and 10G intf 4 Openflow switch EdgeCore AS6712-32X

--

XOS Core & Synchronizers

KafkaLogHandler

VOLTHA

KafkaLogHandler

Event_bus

ONOS

Filebeat sidecar

Kafka-onos app

Kafka Topic Exporter Prometheus Grafana

Monitoring

Logstash Elasticsearch Kibana

LoggingKafka

xos.log.* topic

voltha.log topic

onos.log topic

voltha.kpis topic

onos.kpis topic

...

Page 33: Quantity Category Brand Model Part Edge Cluster Standard setup 3 64-bit x86 server / / Haswell X86 microarchitecture or better 1G intf and 10G intf 4 Openflow switch EdgeCore AS6712-32X

---

----

--

Page 34: Quantity Category Brand Model Part Edge Cluster Standard setup 3 64-bit x86 server / / Haswell X86 microarchitecture or better 1G intf and 10G intf 4 Openflow switch EdgeCore AS6712-32X

EdgeCentral

-

Central1

Edge1 Edge2 Edge3

Central2

cAdvisor

Node Exporter

Kube-state-metrics

cAdvisor

Node Exporter

nem-monitoring

Prometheus Grafana

cAdv

isor

Nod

e E

xpor

ter

Kub

e-st

ate-

met

rics

cAdv

isor

Nod

e E

xpor

ter

cAdv

isor

Nod

e E

xpor

ter

Page 35: Quantity Category Brand Model Part Edge Cluster Standard setup 3 64-bit x86 server / / Haswell X86 microarchitecture or better 1G intf and 10G intf 4 Openflow switch EdgeCore AS6712-32X

-

Page 36: Quantity Category Brand Model Part Edge Cluster Standard setup 3 64-bit x86 server / / Haswell X86 microarchitecture or better 1G intf and 10G intf 4 Openflow switch EdgeCore AS6712-32X

---

Page 37: Quantity Category Brand Model Part Edge Cluster Standard setup 3 64-bit x86 server / / Haswell X86 microarchitecture or better 1G intf and 10G intf 4 Openflow switch EdgeCore AS6712-32X

-

Page 38: Quantity Category Brand Model Part Edge Cluster Standard setup 3 64-bit x86 server / / Haswell X86 microarchitecture or better 1G intf and 10G intf 4 Openflow switch EdgeCore AS6712-32X

Page 39: Quantity Category Brand Model Part Edge Cluster Standard setup 3 64-bit x86 server / / Haswell X86 microarchitecture or better 1G intf and 10G intf 4 Openflow switch EdgeCore AS6712-32X
Page 40: Quantity Category Brand Model Part Edge Cluster Standard setup 3 64-bit x86 server / / Haswell X86 microarchitecture or better 1G intf and 10G intf 4 Openflow switch EdgeCore AS6712-32X

••

••

•••

••

Hardware

XOS

ONOS Kubernetes

Trellis SD-RAN

OMEC-UP OMEC-CP CDN Prome-theus

Subs.Monitor Grafana

Helm

CDN

Page 41: Quantity Category Brand Model Part Edge Cluster Standard setup 3 64-bit x86 server / / Haswell X86 microarchitecture or better 1G intf and 10G intf 4 Openflow switch EdgeCore AS6712-32X

Edge Cluster Central Cluster

CDN-RemoteCDN-Local

Pull video streams from CDN-Remote Include multiple video files

Include cached video files

Stream cached & remote videos

Manage video streams

Transmit video streams

Page 42: Quantity Category Brand Model Part Edge Cluster Standard setup 3 64-bit x86 server / / Haswell X86 microarchitecture or better 1G intf and 10G intf 4 Openflow switch EdgeCore AS6712-32X

Edge Cluster Central Cluster

CDN-RemoteCDN-Local

Pull video streams from CDN-Remote Include multiple video files

Include cached video files

Stream cached & remote videos

Manage video streams

Transmit video streams

This is fully “Open-Source CDN”

Page 43: Quantity Category Brand Model Part Edge Cluster Standard setup 3 64-bit x86 server / / Haswell X86 microarchitecture or better 1G intf and 10G intf 4 Openflow switch EdgeCore AS6712-32X

Video archiveMedia server

CDN-RemoteCDN-Local

Video files

(1) Video archive contains video files

(2) Video archive sends videos to media server (RTMP)

(3) Media server transmitsvideo streams (RTMP)

CDN server (4) CDN server gets video stream from Media

server (RTMP)

(5) CDN server starts streaming service

(6) UE requests and then receives video streaming

through OMEC/RAN

Edge Cluster Central Cluster

Page 44: Quantity Category Brand Model Part Edge Cluster Standard setup 3 64-bit x86 server / / Haswell X86 microarchitecture or better 1G intf and 10G intf 4 Openflow switch EdgeCore AS6712-32X

Video archiveMedia server

CDN-RemoteCDN-Local

Video files

CDN server

Cached videos

(1) CDN server includes cached video files

(2) CDN server startsstreaming service

(3) UE requests and then receives video streaming through OMEC/RAN

Edge Cluster Central Cluster

Page 45: Quantity Category Brand Model Part Edge Cluster Standard setup 3 64-bit x86 server / / Haswell X86 microarchitecture or better 1G intf and 10G intf 4 Openflow switch EdgeCore AS6712-32X

Video archiveMedia server

CDN-RemoteCDN-Local

Video files

CDN server

Cached videos

Edge Cluster Central Cluster

NGINX

Ant media

ffMPEGContainerized open-source Web server

Containerized open-source media server

Containerized open-source ffMPEG Apps + video files

Page 46: Quantity Category Brand Model Part Edge Cluster Standard setup 3 64-bit x86 server / / Haswell X86 microarchitecture or better 1G intf and 10G intf 4 Openflow switch EdgeCore AS6712-32X

Video archiveMedia server

Video files

CDN server

Cached videos

Edge Cluster Central Cluster

NGINX

Ant media

ffMPEG

CDN-RemoteCDN-Local

Helm chart #1: CDN-Local Helm chart #2: CDN-Remote

Page 47: Quantity Category Brand Model Part Edge Cluster Standard setup 3 64-bit x86 server / / Haswell X86 microarchitecture or better 1G intf and 10G intf 4 Openflow switch EdgeCore AS6712-32X
Page 48: Quantity Category Brand Model Part Edge Cluster Standard setup 3 64-bit x86 server / / Haswell X86 microarchitecture or better 1G intf and 10G intf 4 Openflow switch EdgeCore AS6712-32X

••••

Hardware

XOS

ONOS Kubernetes

Trellis SD-RAN

OMEC-UP OMEC-CP CDN Prome-theus

Subs.Monitor Grafana

Helm

XOS

Page 49: Quantity Category Brand Model Part Edge Cluster Standard setup 3 64-bit x86 server / / Haswell X86 microarchitecture or better 1G intf and 10G intf 4 Openflow switch EdgeCore AS6712-32X

TOSCA files XOS Synchronizer ONOS-F/R

Profile definition

Fabric definition

UE definition

RAN slice definition

XOS-TOSCA

XOS services

Service chain

Configuration UI

Monitoring

Configuration

Fabric monitoring

Fabric configuration

RAN monitoring

RAN configuration

Page 50: Quantity Category Brand Model Part Edge Cluster Standard setup 3 64-bit x86 server / / Haswell X86 microarchitecture or better 1G intf and 10G intf 4 Openflow switch EdgeCore AS6712-32X

Profile file XOS Synchronizer ONOS-F/R

ONOS apps

Service definitions

Service dependencies

XOS-TOSCA

(1) Send profile TOSCA file to XOS

XOS services

(2) Define services

Service chain

Configuration UI

(3) Draw service chain on dashboard

(4) Make UI for configuration

(5) Onboard synchronizers for services: {ONOS-Fabric, ONOS-RAN}-Synchronizer

(6) ONOS monitoring

Page 51: Quantity Category Brand Model Part Edge Cluster Standard setup 3 64-bit x86 server / / Haswell X86 microarchitecture or better 1G intf and 10G intf 4 Openflow switch EdgeCore AS6712-32X

Fabric file XOS Synchronizer ONOS-Fabric

Node configuration

Switch configuration

Port configuration

XOS-TOSCA

(1) Send Fabric TOSCA file to XOS (2) Save config values

XOS services

Monitoring

Configuration

(3) Send config values

Fabric monitoring

Fabric configuration

(4) Ask fabric configuration

(5) Fabric monitoring(6) ONOS monitoring

Configuration UI(7) W/O TOSCA, admin can configure manually through UI

Page 52: Quantity Category Brand Model Part Edge Cluster Standard setup 3 64-bit x86 server / / Haswell X86 microarchitecture or better 1G intf and 10G intf 4 Openflow switch EdgeCore AS6712-32X

RAN File XOS Synchronizer ONOS-RAN

UE configuration

eNB configuration

Slice configuration

XOS-TOSCA

(1) Send Fabric TOSCA file to XOS (2) Save config values

XOS services

Monitoring

Configuration

(3) Send config values

RAN monitoring

RAN configuration

(4) Ask RAN configuration

(5) RAN monitoring(6) ONOS monitoring

Configuration UI(7) W/O TOSCA, admin can configure manually through UI

Page 53: Quantity Category Brand Model Part Edge Cluster Standard setup 3 64-bit x86 server / / Haswell X86 microarchitecture or better 1G intf and 10G intf 4 Openflow switch EdgeCore AS6712-32X
Page 54: Quantity Category Brand Model Part Edge Cluster Standard setup 3 64-bit x86 server / / Haswell X86 microarchitecture or better 1G intf and 10G intf 4 Openflow switch EdgeCore AS6712-32X
Page 55: Quantity Category Brand Model Part Edge Cluster Standard setup 3 64-bit x86 server / / Haswell X86 microarchitecture or better 1G intf and 10G intf 4 Openflow switch EdgeCore AS6712-32X
Page 56: Quantity Category Brand Model Part Edge Cluster Standard setup 3 64-bit x86 server / / Haswell X86 microarchitecture or better 1G intf and 10G intf 4 Openflow switch EdgeCore AS6712-32X
Page 57: Quantity Category Brand Model Part Edge Cluster Standard setup 3 64-bit x86 server / / Haswell X86 microarchitecture or better 1G intf and 10G intf 4 Openflow switch EdgeCore AS6712-32X