NKN Future Roadmapworkshop.nkn.in/2013/images/presentation/Talk-2ndNKN... · 2013-10-24 · NKN Future Roadmap Challenges & Opportunities Prabhakar Dhekne ... serve as a test-bed

National Knowledge Network Page 1

NKN Future Roadmap

Challenges & Opportunities

Prabhakar Dhekne

Scientific Consultant to Principal Scientific

Adviser to GOI & Former Associate

Director E&I Group, BARC

2nd Annual NKN workshop at IISC, Bangalore from Oct 17-19, 2013


Outline of Talk

• Global Research Collaborations

• Trends in e-infrastructure

• National Knowledge Network(NKN)

• Major Challenges & Opportunities

• Testing of Dark Fiber for NKN scaling

• Conclusions


Research Collaborations

India is effectively participating in the major international experimental

programmes in Europe such as Large Hadron Collider (LHC), ITER, and

others. Participation in the European Framework Programmes has been very

fruitful and has enabled Indian scientists to collaborate in frontier research

activities with European colleagues.

Cooperation with Global Virtual Research Communities (GVRCs) through

projects like LHC Grid & EU-IndiaGrid gave India much needed impetus

for creating an e-infrastructure within the country. The cooperation has been

enhanced by two closely related EU-funded projects – EU-IndiaGrid2 and

CHAIN.

The EU-IndiaGrid project, which has allowed Indian scientists to access

major European and Indian Grid infrastructures exposing them to the grid

technology, made significant progress in last two years.


Trend: Network Infrastructure

Grid & Cloud computing has demanded deployment of an advanced network infrastructure for Research & Education to be effective

Light (lambda network facility) is the response to the need for high-quality research and education. It will

help create a viable economy-of-scale model for the region to reduce networking costs per country,

serve as a test-bed for development of new services, and allow the R&E community to participate in international networking activities

support the growth of National Research & Education Networks (NRENs), accelerate research, fuel national and regional economic growth, and aid their integration with the rest of world.

Many countries today have Lambda Network Facility – an e-infrastructure


The e-Infrastructure of India

Indian Grid

Certification

Authority

EU-IndiaGrid

CHAIN

TIFR-CERN link

National Knowledge Network: Enabling a Paradigm Shift in Research

Infrastructure And Global Science Cooperation

NKN is a state-of-the-art multi-gigabit pan-India network: www.nkn.in


How Testing of NKN was done?

• Exhaustive testing was conducted

– Functional Testing (ping, test route, latency, packet loss)

– Sustainability Testing by HD Video-Con tests (Light weight,

lossy data permitted)

– End-to-End Performance & Reliability Testing using FTP data

transfer for short & long periods (Heavy weight, lossless data)

– Application testing

• Collab-CAD connecting BARC-IGCAR-NIC

• Grid Computing (DAE grid BARC-IGCAR-TIFR-VECC)


Interconnect-Related Terms

Most critical component of HPC still remains to be interconnect

technology and network topology

Latency:

Networks: How long does it take to start sending a "message"?

Measured in microseconds- startup time

Round Robin Delay & Number of Hops

Processors: How long does it take to output results of some

operations, such as floating point add, divide etc., which are

pipelined?)

Bandwidth: What data rate can be sustained once the message is

started? Measured in Mbytes/sec or Gbytes/sec

National Knowledge Network Page 8 8

Best Effort is not Good Enough …

- Set up optimized

path

- Select Level 2,3

,4 switching

- Trade-off

between buffer

size & Appln

- Guaranteed end-

to-end

performance

Choice for QOS


On the Network: Big Problems!

• Network Traffic Profile

• Mixing Traffic

• Trade of between buffer

size Vs Appln

## Better Data handling methods, Innovative Algorithms in Data analytics are

needed. Also high resolution data visualisation techniques & tools needed to be

developed !!!


National Knowledge Network Progress Chart

NKN User Nodes Commissioned, Mar-14, 58

NKN User Nodes Commissioned, Apr-14, 60

NKN User Nodes Commissioned, May-14, 66

NKN User Nodes Commissioned, Jun-14, 69

NKN User Nodes Commissioned, Jul-14, 73

NKN User Nodes Commissioned, Aug-14, 75

NKN User Nodes Commissioned, Sep-14, 78

NKN User Nodes Commissioned, Oct-14, 81

NKN User Nodes Commissioned, Nov-14, 83

NKN User Nodes Commissioned, Dec-14, 85

NKN User Nodes Commissioned, Jan-15, 89

NKN User Nodes Commissioned, Feb-15, 104


NKN User Nodes Commissioned, Apr-15, 152

NKN User Nodes Commissioned, May-15, 179

NKN User Nodes Commissioned, Jun-15, 199

NKN User Nodes Commissioned, Jul-15, 210

NKN User Nodes Commissioned, Aug-15, 248

NKN User Nodes Commissioned, Sep-15, 358

NKN User Nodes Commissioned, Oct-15, 382

NKN User Nodes Commissioned, Nov-15, 467

NKN User Nodes Commissioned, Dec-15, 606

NKN User Nodes Commissioned, Jan-16, 638

NKN User Nodes Commissioned, Feb-16, 672

712


NKN User Nodes Provisioned, Mar-14, 65

NKN User Nodes Provisioned, Apr-14, 67

NKN User Nodes Provisioned, May-14, 70

NKN User Nodes Provisioned, Jun-14, 72

NKN User Nodes Provisioned, Jul-14, 78

NKN User Nodes Provisioned, Aug-14, 79

NKN User Nodes Provisioned, Sep-14, 85

NKN User Nodes Provisioned, Oct-14, 91

NKN User Nodes Provisioned, Nov-14, 104

NKN User Nodes Provisioned, Dec-14, 121

NKN User Nodes Provisioned, Jan-15, 139

NKN User Nodes Provisioned, Feb-15, 157


NKN User Nodes Provisioned, Apr-15, 224

NKN User Nodes Provisioned, May-15, 259

NKN User Nodes Provisioned, Jun-15, 270

NKN User Nodes Provisioned, Jul-15, 276

NKN User Nodes Provisioned, Aug-15, 418

NKN User Nodes Provisioned, Sep-15, 446

NKN User Nodes Provisioned, Oct-15, 471

NKN User Nodes Provisioned, Nov-15, 557

NKN User Nodes Provisioned, Dec-15, 667

NKN User Nodes Provisioned, Jan-16, 711

NKN User Nodes Provisioned, Feb-16, 754 774


No. of NKN User

Nodes

NKN Progress Chart

NKN User Nodes Commissioned NKN User Nodes Provisioned No. of user nodes

Virtual Classrooms,

Collab-CAD

Model

Projects

Immersive

Classrooms

Global Science Research Collaboration

through TIEN3, GEANT & European Grid

Initiative (EGI)

No. of user nodes projected

High Energy Physics experiment at Large

Hadron Collider, Climate Change Modeling,

OSDD

ESRF Synchrotron Lab at Grenoble, France,

Material Science, Bioscience, Brain Grid etc.

831

980

NKN crosses 1000 Plus !!!


NKN Project Management

High Level Com

DIT TAC

Grid Appln Com

Security Adv Imp Com

Policy

e_Gov Com

NIC

Climate Change, HEP, Bio, Cancer, Brain, Agriculture, S&T

NKN - PIU

Implementing Agency

DG, NIC

Prof P.S.Dhekne

Dr. R.Chidambaram, PSA to GOI

Prof S.V.Raghavan

R.S.Mani, Project Director

NICSI

G.P.Srivastava

Dr. B.K.Gairola

Prof S.V.Raghavan

Model Projects Eval Com


Performance Monitoring, Enhancement, and Scaling

Development of newer High-End Applications

Cyber Security attacks and Solutions

Make or Buy decisions

Establishment of Test labs & Certification

Major Challenges in the Future


Explore Feasibility of setting up Sanitization Lab

Indigenization of Key NKN Components

Manufacturing & Quality Assurance

Deployment & Testing

Building Capacity & Capability in HR

Establishing International NKN PoPs

HLC Decisions


NKN R&D Programme

Model Projects e-class rooms, edu-Medical, Collab-DDS, E-Foundry, DAE

outreach centre, Brain Grid, NBG

Design & Development of Indigenized Products

ITMA (SETS, BARC,NIC,ECIL)

SNAS (BARC, ECIL)

Optics Switch Router ESR series (IITB, ECIL)

Enterprise Router (C-DOT)

NMS (BARC, C-DAC, NIC, NTRO)

Establishing National Test Labs

Setting up of National Data Centres


Participation in Model Projects

• Participation for model projects for key applications and to

take active part in feasibility, capability and sustainability

testing and ensuring effective use of high bandwidth of NKN

• Approach for using NKN

- Proposal in specific format to PSA’s office

- Make plan to implement close user group on NKN

- To demonstrate the potential/benefits of NKN

- Connecting additional sites to NKN

• Approx. 4-6 projects per year


Via CERN NKN PoP

Via Singapore NKN PoP Singapore, Japan, Australia, and rest of Asia Pacific

Via USA NKN PoP

1. East Coast – NY

/ Wash DC / Chicago

2. West Coast –

Los Angeles / Seattle

NKN International Connectivity

Model Project scheme to showcase the

applicability across a spectrum of applications

focusing on education, health and life sciences

NKN HLC has cleared establishment of NKN PoPs overseas - US - Europe - Asia Pacific including Japan and Australia).


Few aspects to be considered

• Sustainable applications of common

interest such as weather/climate

modeling & simulation, biodiversity,

Cancer and Brain Grids, Education

contents

• Agreeing on standard data formats

and data sharing policy

• R & D in advanced networking (100G

& above), software development etc

Enhancing Global Research Collaborations by enhancing network connectivity between NKN and the Research and Education Networks (RENs) of the world is becoming an absolute necessity.

Global Research Collaborations


COMPUTE (more FLOPS)

DA

TA

(m

ore

BY

TE

S)

NETWORK

(more

BW)

Today’s Applications

Data and

High Performance

Computing

Data and

Cyberinfrastructure

Services

These applications, are both

data-intensive and compute-

intensive.


ICFA Report 2009 - Main Trends Accelerate: Dark

Fiber Nets, Dynamic Circuits, 40-100G

Current generation of 10 Gbps network backbones and major Int’l links arrived in 2002-8 in US, Europe, Japan, Korea; Now China, Brazil

Bandwidth Growth: from 16 to 10,000X in 7 Yrs. >> Moore’s Law

Proliferation of 10G links across the Atlantic & Pacific since 2005

Bandwidth for LHC well above 100 Gbps in aggregate

Rapid Spread of “Dark Fiber” and DWDM: Emergence of Continental, Nat’l, State & Metro N X 10G “Hybrid” Networks in Many Nations

Appearance of terrestrial 40 and 100G MAN/WAN: 40G optical backbones in commercial and R&E networks are common

100G pilots/tests in 2009, first service deployments started

Point-to-point “Light-paths” for HEP and “Data Intensive Science”

Now Dynamic Circuits, and Managed Bandwidth Channels

Technology continues to drive Performance Higher, Costs Lower

Commoditization of GE now 10 GE ports on servers

Cheaper and faster storage ($ < 100/Tbyte); 100+ Mbyte/sec disks


Dark Fiber Deployment & Testing

• NKN, NIC Team • Led by R S Mani

• IITB & ECIL Team • Led by Prof A Gumaste

• Railtel Team • Led by Mr. Bahuguna,CMD

: Evaluation & Testing on NKN

: Fiber lighting & Swiching

: Dark Fiber Provisioning

Dark Fiber was deployed for the first time in the

country using locally developed equipment

Experiment Coordinated by the PSA Office:

Organizations involved


Test Setup Using ESR Router

• 5 ESRs (Routers developed by IIT Bombay & manufactured

by ECIL) operated at 10 G

• 2 Cisco ASR 9010

• 1 Cisco ASR 1002

• 1 Juniper MX 80

Devices Used :


Network Connectivity

• Belapur ASR 9010 connected to Pune ASR 9010 through NKN

Cloud.

• Belapur ASR 1002 connected to Pune ASR 9010 through Railtel

dark fiber.

• 5 ESRs connected through Railtel dark fiber in the following

sequence.

NKN Belapur-Panvel-Lonavala-Pune Railway-NIC Pune

• Node A connected to Belapur ASR 9010.

• Node B connected to Belapur ASR 1002.


Railtel dark fiber

Demo Institute at

Belapur

NKN

Cloud

LAN

ASR 1002

Belapur ESR

A

ASR 9K

Belapur

ESR

ASR 9K

Pune

B

14.139.4.62

14.139.109.244

FTP tested between A and B

Skype tested from B

Connectivity Diagram

ESR ESR

ESR

NIC Pune

Pune Railway

Lonavala Panvel NKN Belapur


Applications Tested

• We have tested successfully following

applications through this darkfiber link

FTP.

Ping & Trace.

Internet.

Video Conferencing through Skype.


Report Dated 27.09.2013

IP Address 14.139.4.62(Node A) connected to NKN cloud

IP Address 14.139.109.244 (Node B) connected to Pune ASR through Railtel dark fiber

Wan IP address Belapur Juniper MX80 end 10.119.252.45

Wan IP address Pune ASR9010 end 10.119.252.46

Test Reports with Juniper MX 80

1.Ping Report

2.Trace Report (Node B to Node A)

Sr. No. Time Source IP Address

Destination IP

Address

Minimum

Latency

Average

Latency Maximum Latency

Success

Rate

1 10:25 AM 10.119.252.45 10.119.252.46 3.53ms 11.53ms 29.19ms 100%

2 1:14 PM 10.119.252.45 10.119.252.46 3.43ms 7.41ms 81.25ms 100%

3 2:31 PM 10.119.252.45 10.119.252.46 3.24ms 3.78ms 6.66ms 100%

4 4:00 PM 10.119.252.45 10.119.252.46 3.28ms 3.77ms 7.70ms 100%

5 5:02 PM 10.119.252.45 10.119.252.46 3.59ms 3.70ms 3.78ms 100%

Sr. No. Time IP Address No. of Hops Latency

1 10:25 AM 14.139.4.62 4 6ms

2 1:21 PM 14.139.4.62 4 6ms

3 2:34 PM 14.139.4.62 4 6ms

4 4:00 PM 14.139.4.62 4 6ms

5 8:21 PM 14.139.4.62 4 6ms


3.FTP Test report

3a. Date : 27.09.2013 ( FTP server IP:14.139.109.244)

Serial No File Size Transfer Rate Source IP Address Destination IP Address Errors if any Remarks

1 12.9 MB 0.220 MB/sec 14.139.4.62 14.139.109.244 0

2 82.8 MB 0.243 MB/sec 14.139.4.62 14.139.109.244 0

3 336 MB 0.324 MB/sec 14.139.4.62 14.139.109.244 0

4 521 MB 0.214 MB/sec 14.139.4.62 14.139.109.244 0

5 1.08 GB 0.378 MB/sec 14.139.4.62 14.139.109.244 3 Unable to transfer

NOTE : 1.08 GB file has not transferred and getting error (Could not write to transfer socket:

ECONNABORTED - Connection aborted ) while transferring the file.

3b. Date : 27.09.2013 ( FTP server IP:14.139.109.244)


6 12.9 MB 1.201 MB/sec 14.139.109.244 14.139.4.62 0

7 82.8 MB 1.230 MB/sec 14.139.109.244 14.139.4.62 0

8 336 MB 1.262 MB/sec 14.139.109.244 14.139.4.62 0

9 521 MB 1.240 MB/sec 14.139.109.244 14.139.4.62 0

10 1.08 GB 1.252 MB/sec 14.139.109.244 14.139.4.62 1 Unable to transfer

NOTE : 1.08 GB file has not transferred and getting error (Could not write to transfer socket:

ECONNABORTED - Connection aborted ) while transferring the file.


Report Dated 28.09.2013

IP Address 14.139.4.62(Node A) connected to NKN cloud

IP Address 14.139.109.244 (Node B) connected to Pune ASR through Railtel dark fiber

Wan IP address Belapur ASR1002 end 10.119.252.45

Wan IP address Pune ASR9010 end 10.119.252.46

Test Reports with Cisco ASR 1002

Sr. No. Time Source IP

Address Destination IP Address

Minimum

Latency Average Latency

Maximum

Latency

Success

Rate

1 10:32 AM 10.119.252.45 10.119.252.46 2ms 2ms 103ms 100%

2 12:12 PM 10.119.252.45 10.119.252.46 2ms 2ms 27ms 100%

3 2:39 PM 10.119.252.45 10.119.252.46 2ms 2ms 32ms 100%

4 6:09 PM 10.119.252.45 10.119.252.46 2ms 5ms 42ms 100%

5 7:09 PM 10.119.252.45 10.119.252.46 2ms 5ms 40ms 100%

6 7:45 PM 10.119.252.45 10.119.252.46 2ms 2ms 16ms 100%

TIME Serial No IP Address No. of Hops Latency

10:33 AM 1 14.139.4.62 4 6ms

12:12 PM 2 14.139.4.62 4 6ms

6:10 PM 3 14.139.4.62 4 6ms

7:10 PM 4 14.139.4.62 4 6ms

7:45 PM 5 14.139.4.62 4 6ms

1.Ping Report

2.Trace Report (Node B to Node A)


3a. Date : 28.09.2013 ( FTP server IP:14.139.109.244)


1 12.9 MB 0.330 MB/sec 14.139.4.62 14.139.109.244 0

2 82.8 MB 0.359 MB/sec 14.139.4.62 14.139.109.244 0

3 336 MB 0.366 MB/sec 14.139.4.62 14.139.109.244 0

4 521 MB 0.363 MB/sec 14.139.4.62 14.139.109.244 0

5 1.08 GB 0.381 MB/sec 14.139.4.62 14.139.109.244 0

3b. Date : 28.09.2013 ( FTP server IP:14.139.109.244)


6 12.9 MB 1.201 MB/sec 14.139.109.244 14.139.4.62 0

7 82.8 MB 1.230 MB/sec 14.139.109.244 14.139.4.62 0

8 336 MB 1.235 MB/sec 14.139.109.244 14.139.4.62 0

9 521 MB 1.236 MB/sec 14.139.109.244 14.139.4.62 0

10 1.08 GB 1.236 MB/sec 14.139.109.244 14.139.4.62 0

3c. Date : 28.09.2013 ( FTP server IP:14.139.4.62)


1 12.9 MB 0.287 MB/sec 14.139.4.62 14.139.109.244 0

2 82.8 MB 0.307 MB/sec 14.139.4.62 14.139.109.244 0

3 336 MB 0.283 MB/sec 14.139.4.62 14.139.109.244 0

4 521 MB 0.315 MB/sec 14.139.4.62 14.139.109.244 1

5 1.08 GB 0.288 MB/sec 14.139.4.62 14.139.109.244 0

3d. Date : 28.09.2013 ( FTP server IP:14.139.4.62)


6 12.9 MB 4.404 MB/sec 14.139.109.244 14.139.4.62 0

7 82.8 MB 4.715 MB/sec 14.139.109.244 14.139.4.62 0

8 336 MB 4.785 MB/sec 14.139.109.244 14.139.4.62 0

9 521 MB 4.857 MB/sec 14.139.109.244 14.139.4.62 0

10 1.08 GB 4.845 MB/sec 14.139.109.244 14.139.4.62 0

3.FTP Test report


Outcome from Tests

• Tested over 6 months for short term & long

term for

• Reliability

• Sustainability

• Compatibility across CISCO & Juniper

• Successful deployment of Dark Fibers from

PSU

• Suitability for NKN use


Conclusions

Demand on Computations & Communication is likely to grow

exponentially in the future

Open access to publicly funded research results and data is

now becoming a reality Institutional Repositories will be important elements of the national information

infrastructure

Institutional repositories will need to address data issues as well as research

publications

Establishment of National Data Centres to provide advice,

guidance and data curation services for user community will be

essential

NKN must scale well constantly in terms of users, bandwidth,

end-to-end performance and QOS to be in the race !!!


Faith of a user !!!

Thanks for your Attention !!!

2011


Typical End Node Design

NKN

MPLS SERVICE

PE VLAN1-VPN Green

VLAN2-Blue

VLAN3-Red

Each Sub Interface

associated with different

VPN

v

v

802.1 Q

VPN Blue Site

BIO TECH

VPN Red Site

IIT H

Multi-VRF

Bio-Tech Lab

Phy Lab

Class Room VPN Green Site

DAE LAB

Ingress NKN Router Egress NKN Router


Multiple Zones in NKN Router

User-

end-

Router

WLCG

Segment at

site

To NKN NKN Router at Site

Internet

Segment

at site Segment

at site

Additional CUG


Linux server with 1 Gbps LAN, TCP/IP window (4MB, 8MB, 15.3 MB), Test Pgm: Iperf, Netpipe, Pathload

Test Set UP at BARC

Linux

Linux

MPLS-L3-VPN

BARC, Trombay

10.117.128.50

IGCAR, Kalppakam

10.117.136.5

VECC, Kolkata

10.118.56.10

TIFR, Mumbai

10.117.160.10

Max rate: 923.08 Mbits/s

Min rate: 333 Mbits/sec

1 Gbps

links with

babkbone

2.5 Gbps


Collaborative design of sub assembly of the prototype 500 MW Fast Breeder Reactor from three remote locations from NIC, BARC & IGCAR

Test Set UP for Collab-CAD

Collab-CAD Collab-CAD

MPLS-L3-VPN

NIC, Delhi

10.x.x.x IGCAR, Kalppakam

10.117.136.5

BARC, Trombay

10.117.128.50


Test Set UP at C-DAC

Garuda Grid at C-DAC, Banglore accessed from IISC, Bangalore by Prof Ravi S. Nanjundiah for running weather application

MPLS-L3-VPN

Atmospheric Sciences Dept. IISC, Bangalore

Weather Modeling

Garuda at C-DAC, Bangalore

Documents

NKN Future Roadmapworkshop.nkn.in/2013/images/presentation/Talk-2ndNKN... · 2013-10-24 · NKN Future Roadmap Challenges & Opportunities Prabhakar Dhekne ... serve as a test-bed