Evolution of Future Internet Testbed:

Experiences in JGN-X Shimojo ShinjiNICT/Osaka U

2012.08

Clean SlateThink Revolutionarily, act Evolutionarily

technology manageable and operationalopen end design

2012/2/29 Eiji  Kawai@ON*VECTOR

Evolu9on  in  JGN

• JGN  =  Japan  Gigabit  Network– Established  in  1999  and  operated  by  TAO  (an  ancestor  of  NICT)

4

1999.4ATM

2004.4Wide-­‐areaEthernet

2008.4Different  QoSin  VLANs

2011.4Future  Internet

Fukuoka

HiroshimaOkayama

Osaka

Nagoya

Sendai

NICTKoganei

Korea

USA TH SG HK

OpLcal  Testbed

■Koganei-­‐Otemachi-­‐Hakusan■Oteamchi～Otemachi

InternaLonal  Circuit

InternaLonal  Circuit

40Gx240G40G

10G10G

10G

Wireless  Testbed

Sapporo

40G10G1GDF

Example

10Gx210Gx210G

10G

1G

Kanazawa 10G

Tokyo

JGN-­‐X  Network  infrastructure  Overview

VLAN  Testbed  Network

VN

VN

VN

VN

OF

OFOF

OFOF Virtual Node Plane

Openflow PlaneRISE

DCN PlaneDCN

DCN

DCN

DCN

Physical  L1(Op;cal  Testbed)  Network  Layer

L2(VLAN)・L3(IP)NetworkLayer

New  Genera;on  Network  Layer（Partnership  Service  R&D  Environment)

StarBED3

JGN-­‐X  Backbone  Network  Figure  (2011/Mid-­‐March-­‐)

2011/3/11MX80  Virtual  Enabled  Switch  

AX66  L2  Core  Switch

AX36  L2    Access  Switch

Meinohama

To:  Korea NTT  Tenjin

GS4K  L2    Access  Switch

KyusyuTech  Univ

OkayamaTeleport

Osaka

Osaka  Univ

Kobe

Keihanna

Hokuriku

Yokosuka

Koganei

KDDI  Ote

NTT  Ote

Sapporo

Tohoku

TohokuUniv

Kashima

Hiroshima

Okayama

Nagoya

To:  USA

L3  slice  operated  by  APAN

Hong  Kong

SingaporeThailand

To:  Singapore

To:  Thailand

To:  HKG

Dual  Plane  Independent  Backbone:    VLAN  based  AX66  L2  Backbone    Virtual  Chassis  Enabled  MX80  Backbone

L2  Backbone

Virtual  Chassis  Backbone

UN5000  Op9cal  Transport

ONS15454M6  OXC

TokyoUniv.

KyushuUniv.

• Network Virtualization

• Software Defined Network

• ID/Locator Separation

• Contents Oriented Network

• In Network Processing

• Optical Networking

• Wireless Networking

New Generation Network Technology

2012/2/29 Eiji  Kawai@ON*VECTOR

Testbed  as  an  Extremely  Flexible  Infrastructure

8

Underlay  Networks

Virtual/Programmable  Networks

Service  Networks

vNode DCN

OpenFlow

L1  (WDM)L2  (Ether/SDH)

MPLS L3  (v4/v6)

V-­‐Chassis

ID-­‐Loc.  Sep

CCN DTN

Sens.  Net.P2P/Overlay

Users

New  Techs

Cloud

2012/2/29 Eiji  Kawai@ON*VECTOR

Service  and  Opera9on  Modelfor  Virtualized  and  Integrated  Infrastructure

9

Service  Layer

Infrastructure  Layer

Service  Provider  #1

Service  Provider  #2

Service  Provider  #3

Infra.  Provider  #1 Infra.  Provider  #2

Middle  Layer

Service  Provider  (SP)• Request  resource-­‐controllable  virtual  

networks  (RCVN)  to  VNP• Provide  service  to  the  end-­‐users  on  RCVN

Virtual  Network  Provider  (VNP)• Coordinate  the  requests  of  SP  and  the  physical  

resouces  of  InP• Calculate  RCVN  requested  by  SP  with  the  

resource  informa9on  from  InP• Translate  the  control  messages  between  the  

SP  and  InP

Infrastructure  Provider  (InP)• Provide  physical  resouces  at  the  requests  from  

VNP• Hold  the  right  to  decide  physical  resources  for  

service

Resource-­‐controllableVirtual  Networks

MiddleVirtualNetworks

PhysicalNetworks

Virtual  Network  Provider  #1

Vertual  Network  Provider  #2

2012/7/17 Eiji  Kawai

RISE:  OpenFlow/SDN  Testbed

• A  large-­‐scale  OpenFlow/SDN  testbed  on  JGN-­‐X–for  researchers,  students,  engineers,  operators,  …

• Challenges–Ini4ally,  demonstra4on  of  wide-­‐area  deployment  of  OpenFlow  technology  (since  2009)• Design  of  under-­‐lay  network  architecture  (tunneling)• Know-­‐hows  in  shooDng  OpenFlow  network  troubles

–Now,  development  of  OpenFlow  testbed  with  …• User  isolaDon  that  allows  user-­‐defined  controllers• InterconnecDon  of  various  testbed  faciliDes  such  as  network  emulator,  wireless/opDcal  network  testbed,  cloud  infrastructure,  …

10

JGN-­‐X  technology  layers

Network A(L1/L2)

Network B(L2/L3)

Network C(L2)

Virtual Network Integration by PseudoWire

OpenFlow

VPLS

Physical Networks

SDTN

IPv6 network

IPv4/6 translation by SA46T

IPv4 networkLayer2  with  QOS

Network D(L2/L3)

DCN  s9ching

RISE

Vnode DPN

Mul9layerMeasuments

#3#2#1

全体

2012/2/29 Eiji  Kawai@ON*VECTOR

Demonstra6on  at  Sapporo  Snow  Fes6val  2012

12

• Technology:– Logical  pool  =  integrated  management  mechanism  of  

physical  and  logical  resources  

– mul9ple  physical  infrastructure  domains  from  lower-­‐layers  to  upper-­‐layers

– Configure  a  wide  variety  of  (logical)  networks  for  the  users  and  provide  consistent  view  to  them

• ApplicaLon:  – On-­‐demand  video  stream  switching  for  broadcas9ng  through  

the  integrated  virtual  networks

Challenges• Manage  mul9ple  logical  networks  

for  HD-­‐quality  video  transfer

• Achieve  fast  recovery  from  network  failure  with  dynamic  rou9ng

• Develop  a  monitoring  mechanism  for  highly  virtualized  networks

• Iden9fy  and  solve  troubles  in  real  opera9on  of  virtualized  infrastructure

Logical  PoolNTT  NS  Lab  /  PCE

Logical  PoolNTT  NS  Lab  /  PCE

Logical  PoolNTT  NS  Lab  /  SDTN

JGN-­‐X(L1/L2)

CKP(L2/L3)

北部広域

(L1)

vNode

ASR

GAORA

MBS HBCIPv4

SA46T

IPv6

VPLS  (2)

OpenFlow

VPLS  (1)

Layer2  /Layer1    

OpenFlowJGN-­‐X  /  NEC

Thailand

Singapore

Uni-­‐Cast

Mul6-­‐Cast

Mul6-­‐Path

SKYA

HTBABC

GEMnet2  (L2)

NTT未来ねっと研

i-­‐Visto

Future  ICT  infrastructure  model  for  new  technologies  and  services

SDN=User based Innovation

9

Interop  Tokyo  2012  Demonstra4on

Demonstra9on  Scenario:•Malicious  traffic  comes  in,  and  sampling  detector  finds  suspicious  traffic  flow•Detector  sends  alert  to  RISE  OpenFlow  Controller•RISE  Controller  copies  suspicious  flow  to  DPI  machine•RISE  Controller  drops  the  flow

DPI

RISE OF Controller

(2)COPY

(4)DROP

(3)Detection by Deep Packet Inspection

Malicious Traffic comes in

SamplingDetector

(1)Alertto Controller

OpenvSwitch

OpenvSwitch

OpenvSwitch

OpenvSwitch

OpenvSwitch

OpenvSwitch

OpenvSwitch

OpenvSwitch

OpenvSwitch

Openflow  ControllerTrema  

(Sliceable  rou;ng  switch)

Osaka  U

AIST

UCSD

Openflow  network

GRE

GRE

GRE

GRE

GRE

GREVM

VM

VM

VM

VM

VM

VM

VMVM

VM

VM

VM

VMVM VM VM

VM

VMVM

VM

VMVM

VM

VM

Virtual  Cluster  A

Virtual  Cluster  B

Courtesy  by  Ichikawa

Demonstra*on  with  SingAREN/ThaiREN  in  FIT/APAN  

4

OF

ThaiSARN

SingAREN

JGN-­‐X

User  Interface

OpenFlow  Controller(Trema)

API

Database

Database

Database

SW

VM

VM

VM

SW

OF

OF

OpenFlow-basedNetwork

VM resource Data backup / recovery

Experiment  in  the  city  of  Tohoku  areaPerform the demonstration of “Robust Network in Emergency

Situation” with following features– Multiplex circuit utilizing multiple access network– Rapid and flexible network construction with remote control

Shopping  Mall

City  Hall

Welfare  Center

Preven9on  Center

IntegratedAdministration

Upper  network

Virtual  Network2Virtual  Network1

CATVPHS3G WiFi ADSLOpt.  Fiber

Remote control Server

Virtual  Network  for  service  in  emergency

(1)  Providing    a  virtual  network  with  integra9ng  heterogeneous  network

(2)Re-­‐construc9ong  network  with  resources  survived  from  the  disaster

Normal serviceEmergency Service

(3)Priority control of data transmission per apps

District  center

Switched byOpenFlow

TV  sta9on

Page 6

Cloud

Future  vision  of  network  testbed

Multilayer  Overlay  Network

Overlay networks for different data and purposes

statistical  analysis messaging RecommendationdistributedcomputationSearch

realtime  analysis  and  prediction

statistical analysis and prediction

data fusion

Distributed data allocation

access control

Dependability

Metaquary

In  house  sensor

Mobile  sensor heterogeneous  sensor  network

Wearable    device

medical  sensor

Think Revolutionarily, act Evolutionarily

User based Innovation

Global Testbed is the field

Thank you

資料はhttps://sites.google.com/site/sshimojo/talks