Cloud Computing and NKNsymposium.vecc.gov.in/sacet09/public_html/downloads... · 2018-02-14 · 0.6/1 Gbps link to CERN/ GEANT 100 Mbps Link Tier III 2 Mbps ... • Cloud computing

Oct 28-29, 2009 Cloud Computing & NKN 1

Cloud Computing and NKN

P.S.Dhekne,

Raja Ramanna Fellow, BARC


Information Explosion

– Due to the popularity of Internet digital content is growing

exponentially and needs to be accessed quickly by all

– Today’s science is based on worldwide collaborations by

sharing computations, data, expensive equipments,

information/knowledge/wisdom across the Internet

– Researchers need more accurate & precise solutions to

their problems (from 1D to 3D) in shortest possible time


Collaborative environments

Trends: The e-Science

� e-Science is about using leading edge IT to deliver new science

� High-quality scientific computing services

� Management and exploitation of large scale scientific data

� Collaborative R&D

� Support for collaborative working

� Sharing expertise - technology transfer

� Based on core strengths:

Data analysis and

Computation

Data storageData management

Data driven e-Science


Mega Science Projects

•The LHC and Astro-

particle physics

experiments offer new

glimpses beyond the

current frontiers.

� LHC experiments will produce 10-15 million Gigabytes of data each year (about 20 million CDs!)

� LHC data analysis requires a computing power equivalent to ~ 100,000 of today's fastest PC processors.

� Requires many cooperating computer centres, CERN providing only ~20% of the CPU power

And the computing infrastructure to support such physics

research needs to look beyond the cutting edge.


LHC Data Grid Hierarchy

Tier 1

Tier2 Center

Online System

CERN 700k SI95 ~1 PB Disk; Tape Robot

FNAL: 200k SI95; 600 TBIN2P3 Center INFN CenterRAL Center

InstituteInstituteInstituteInstitute ~0.25TIPS

Workstations

~100-400 MBytes/sec

2.5-10 Gbps

0.1–10 Gbps

Physicists work on analysis “channels”

Each institute has ~10 physicists working on one or more channels

Physics data cache

~PByte/sec

~2.5-10 Gbps

Tier2 CenterTier2 CenterTier2 Center

~2.5-10 Gbps

Tier 0 +1

Tier 3

Tier 4

Tier2 Center Tier 2

Experiment

CERN/Outside Resource Ratio ~1:2Tier0/(ΣΣΣΣ Tier1)/(ΣΣΣΣ Tier2) ~1:1:1

Oct 28-29, 2009 Cloud Computing & NKN 6April 22, 2009 Developing e-inftrastructures in India 6

TIFR : CMS Tier II

Regional WLCG Tier II Grid in India 4 Mbps

Links

VECC/SINP: ALICE

Tier II

0.6/1 Gbps link

to CERN/GEANT100 Mbps

Link

Tier III 2 Mbps

IPLC

LC

Original Network started operating since 2007 and upgraded on regular basis

175 Mbps

Link to GEANT


International Connectivity

� Current status- TIFR-CERN link ( 0.6/1Gbps)

- ERNET-GEANT link(175 Mbps)

� Participation in TEIN3 � From India, ERNET was nominated to participate in South Asia

Feasibility Study(SAFS) meetings of TEIN3.

� SAFS report accepted by EC

� During SAFS meeting, we had projected 2.5 Gbps connectivity to India toward GEANT PoP in Europe and toward East Asia PoP of TEIN3

� We are going to participate in network procurement phase of TEIN3 for South Asia

� Connectivity to Internet2� To connect to TEIN3 PoP at Singapore at 622 Mbps from India

� Proposal from Japan for PoP in Chennai


Indian Grid Certification Authority

� ASGC played the role of Grid CA for India till recently

� First Grid CA in India was established at C-DAC, Banglore; Indian Grid

Certification Authority (IGCA) accredited by APGridPMA

� C-DAC presented IGCA in APGridPMA Face to Face meeting on 16th

Sep 2008 @ OGF24, Singapore.

� Reference: http://www.ogf.org/OGF24

http://www.apgridpma.org/meetings/index.html

� IGCA formally inaugurated on Jan 14, 2009 by Dr. R Chidambaram ,

PSA to Govt. of India and presided by Secretary, DIT

� IGCA is fully operational now and issuing user and host certificates


Trend: Network Infrastructure

� Grid has demanded deployment of an advanced network infrastructure for

Research & Education to be effective

� Light (lambda network facility) is the response to the need for high-quality

research and education. It will

� help create a viable economy-of-scale model for the region to

reduce networking costs per country,

� serve as a testbed for development of new services, and allow the

R&E community to participate in international networking

activities

� support the growth of National Research & Education Networks

(NRENs), accelerate research, fuel national and regional economic

growth, and aid their integration with the rest of world.

� Many countries today have Lambda Network Facility – an e-infrastructure


E-infrastructure

� E-infrastructure includes:

� Networks (internet, light paths…)

� Computers (workstations, servers, HPC…)

� Access controls (security, AAA…)

� Middleware (metadata…)

� Finding tools (portals, search engines…)

� Digital libraries (bibliographic, text, images, sound…)

� Scientific Databases

� Research data (national and scientific databases, individual

data…)


New Challenges in ICT

� Today’s ICT infrastructure is much more complex

� Distributed Computing (Clusters & Grids: PetaFlop Computing)

� Internet & Connectivity (OFC: e-infrastructures: Terabit Networking)

� Virtualisation (Distributed File System: Exabyte Storage)

� Heterogeneity and multidisciplinary information

� Software (Open Source Software and Open Standards)

� ICT isn’t glamorous any more – it just needs to keep working – reliability is everything

� Reliability and robustness are expensive and typically mean less flexibility

� Cost effectiveness and flexibility usually mean less reliability

� Need for Improved Efficiency, Business Continuity & Increased Agility

� Users no longer want to manage ICT infrastructures on 24X7 basis but would like to out source


Green Computing Initiative

– Almost half of recurring expenses on data centres come from

power bills (24/7 operation; example EKA)

– Measures like consolidation and virtualization are used to achieve

optimal utilization of IT infrastructure (Grids)

– Green Computing Initiatives and energy efficient technologies

(reduce emissions& increase cooling efficiency)

– Data centres are being redesigned to go green business processes

(Use of energy efficient technology like blade servers, thin client, LCD’s

etc; Global warming culprits)

– Only 20% computing resources come from Tier o centre at CERN

and rest come from collaborators (methods to improve operational

efficiencies)


Paradigm shift in Computing


Cloud Computing: Computing as a Service

Provision of virtualized resources on a commercial Cloud for example by

Amazon, IBM, Google, Yahoo, Microsoft, so that user need not own the

resources or invest on it but can use it transparently & dynamically as per

his demand paying only for the usage

What is Cloud Computing?

A style of computing where

massively scalable IT-enabled

capabilities are provided "as a

service" over the Internet to

multiple users

Grid is a enabling technology for

Cloud computing

India

USA

Europe


What is Cloud Computing?

4+ billion phones by 2010 [Source: Nokia]

Web 2.0-enabled PCs, TVs, etc.

Businesses, from startups to enterprises

An emerging computing paradigm where data and services reside in massively

scalable data centers that can be ubiquitously accessed from any connected

devices over the Internet. The cloud – a service oriented business/

software/hardware platform on the Internet -- rather than from a specific

identifiable device -- aims to deliver supercomputing power over the Internet --

any subscription-based or pay-per-use service that in real time, extends IT's

existing capabilities over the Internet


Benefits of Cloud Computing

• Cloud computing providing unlimited infrastructure to store and

execute customer data and program. As customers you do not

need to own the infrastructure, they are merely accessing or

renting, they can forego capital expenditure and consume

resources as a service, paying instead for what they use.

Benefits of Cloud Computing :

• Minimized Capital expenditure

• Location and Device independence

• Utilization and efficiency improvement

• Very high Scalability (expand on-the-fly as needed)

• High Computing power


Players in Cloud Computing

Commercial Cloud: Amazon EC-2

Scientific Cloud: Nimbus (University of Chicago)

Open Source technologies: Globus VWS (Globus

compatible), Eucalyptus (Interface similar to EC2),

OpenNEbula

Google's App Engine

Windows Azure

Gogrid (www.gogrid.com)

IBM Cloud Computing Initiative


Major types of clouds

� Compute and Data Cloud

� EC2 Amazon (Elastic Computing Cloud), Google Map Reduce, Science clouds

� Provision platform for running science codes

� Open source infrastructure: workspace, eucalyptus, hub0

� Virtualization: providing environments as VMs

� Hosting Cloud

� GoogleApp Engine

� Highly-available, fault tolerance, robustness, etc for Web capabilities

� Community example: IU hosting environment (quarry)


The Science Clouds

� Powered by workspace tools

� EC2-like interfaces (PKI credential vs credit card)

� More clouds on the way

� http://workspace.globus.org/clouds

“Stratus”University of Florida

16x4 nodes

“Nimbus”University of Chicago

16x2 nodes

Public IPsPrivate IPs(via VPN)



Pricing on GoGrid

CPU RAMDisk Space

Cost per Hour *

1 x Core 0.5 GB 30 GB as low as $0.04

1 x Core 1 GB 60 GB as low as $0.08




Data Transfer **

•Outbound: as low as $0.17 / GB •Inbound: FREE

Cloud Storage

•FREE 10GB per month •$0.15 per GB per month(in excess of 10GB)

* Cloud Server Pricing based on Enterprise Cloud Plan** Outbound Data Transfer Pricing based on 6TB Data Transfer plan


Cloud Server Pricing

With Pay-as-you-go Plan, Server RAM hours are billed at $0.19 per GB of deployedRAM per Hour. Per server, that breaks down to:

CPU RAM Disk Size Cost per Hour

1 x Xeon 0.5 GB 30 GB $0.095

1 x Xeon 1 GB 60 GB $0.19

1 x Xeon 2 GB 120 GB $0.38

3 x Xeon 4 GB 240 GB $0.76

6 x Xeon 8 GB 480 GB $1.52


IDG News Service | 14.10.2009

The US Department of Energy will spend $32 million on a

project that will deploy a large cloud computing test bed with

thousands of Intel Nehalem CPU cores and explore the work of

commercial cloud offerings from Amazon, Microsoft and

Google

Known as Magellan project, it will look at cloud computing as a

cost-effective and energy-efficient way for scientists to

accelerate discoveries in a variety of disciplines, including

analysis of scientific data sets in biology, climate change and

physics


National Knowledge Network: Objective

� The objective of the National Knowledge Network is to

bring together all the stakeholders in Science, Technology,

Higher Education, Research and Development, GRID

Computing, e-governance with speeds scalable eventually

up to the order of 10s of gigabits per second coupled with

extremely low latencies.

� NKN will interconnect all the research, higher education

and scientific institutions in the country, over a period of

three years.

� The joint proposal for the establishment of NKN was

initiated by the PSA’s Office and the National Knowledge

Commission and then taken up by the Department of IT.


Action Taken

�NKN was first announced in the budget/2008 - 100 Cr. initial allocation

�High Level Committee ( HLC) was formed

� Technical Advisory Committee was set up for designing NKN

�NIC will manage the implementation of the project and prepare the DPR

�HLC decided to implement the same in two phases

�Initial Phase

�Final Phase

� Initial Phase: By augmenting NIC’s Points of Presence at 15 locations (2.5

gbps) and to provide 1 Gbps links to 57 institutions

�NKN will enable Sectoral Overlay Network

� Agreement with PSU’s (BSNL/PGCIL/Railtel) for supporting fiber for 10

years


NKN Design Philosophy

�Common National e-infrastructure like national

highway, wherein different categories of users

shall be supported

�To build a scalable network, which can expand

both in Reach (spread across the entire country)

and Speed (capacity)


NKN Features

� High Capacity, Highly Scalable Backbone

� Provide Quality of Service (QoS) and Security

� Wide Geographical Coverage

� Bandwidth from many NLD’s

� Highly Reliable & Available by Design

� Test beds ( for various implementation)

� Dedicated and Owned.

� Connectivity for International & other global R&D Networks

Oct 28-29, 2009 Cloud Computing & NKN 28April 22, 2009 Developing e-inftrastructures in India 28

NKN

TOPOLOGY


NKN of INDIA


Implementation of Initial Phase of NKN

� Core links of 2.5 gbps created by various NLD on an

experimental basis for 6 months.

� Equipment at NIC Backbone upgraded to cater to

multiples of 2.5 gbps

� 57 institutions / organisations to be connected (42 already

connected)

� Creation of 48 virtual Class Rooms at various Mentoring &

Mentored IITs. (16 Already in place)


Status on NKN (initial phase)

� Design of the NKN is complete. (including final phase)

� The Backbone of the initial Phase is ready and operational.

� 42 Institutes have been connected so far. 50 more will be

connected in the next 6-8 months.

� 16 Class rooms have been equipped with the Virtual Class Room

facilities

� Rest are getting ready for Mentoring / Mentored IIT’s.


Inaugurated by President of

India on April 9, 2009


NKN connectivity

� NKN Highway will have minimum of 100mbps

connectivity. Hence all the nodes that hook on to

NKN will be on that speed.

� All the colleges and Polytechnics needs to be

aggregated and brought on to NKN.

� Routers and switches to take connections from

User Organizations


Typical End Node Design

NKN

MPLS SERVICE

PEVLAN1VLAN1--VPN GreenVPN Green

VLAN2VLAN2--BlueBlue

VLAN3VLAN3--RedRed

Each Sub Interface

associated with different VPN

vv

vv

802.1 Q

VPN VPN BlueBlue SiteSite

BIO TECHBIO TECH

VPN VPN RedRed SiteSite

IIT HIIT H

Multi-VRF

Bio-Tech Lab

Phy Lab

Class RoomVPN Green SiteVPN Green Site

DAE LABDAE LAB

Ingress NKN RouterEgress NKN Router


Integrating existing networks on NKN

NICNET POPs are upgraded to implement initial phase of

NKN

The major PoPs of ERNET are already a part of NKN - IISC,

VECC, RRCAT, IIT(Chennai, Kanpur, Guwahati), IUCAA,

University of Rajasthan

Out of 45 institutes participating on Garuda application 24

are already in the initial phase of NKN

Most of WLCG, EU-IndiaGrid and DAE Grid sites are

included in the initial phase of NKN


Applications to show cased

• Education & Research

• Countrywide Real Time Classroom (IITs)

• GRID Applications

• Agriculture

• Health Care

• Industry

• e-governance

• Knowledge content creation


What is running on NKN?

� Readiness during inauguration of NKN on 9th April 2009

� Virtual real-time Classrooms in IIT’s (Chennai-Hyd, Mumbai-

Gandhinagar and Guwahati- Patana)

� Grid Computing using DAE Grid (BARC-IGCAR-RRCAT-

VECC)

� Weather Modeling on Garuda Grid of C-DAC (C-DAC-IISC)

� Collab-CAD application for reactor component design from

IGCAR-NIC-BARC

� Open source Drug discovery from CSIR


NKN Events

• The initial phase of the NKN was inaugurated by the

President of India on 9th April, 2009

• NKN workshop at NIC Delhi on 4th July 2009 to train

network administrators on NKN

• NKN workshop at BARC, Mumbai on December 10-11

December 2008 for training users and systems people

• User Workshop on NKN Applications at NIC, Delhi during

Nov 2008


Model Projects

Funds are allotted for implementing about 20-25 model projects

(with unique application in each domain using NKN

backbone) as a proof-of-concept project to demonstrate the

feasibility, capability and effective use of high bandwidth.

Projects under consideration (max 25 with up to Rs 1 Cr each)

- e_Mentoring in Maths Science (IISER, CBS, CMI, HBCSE, TIFR, BARC – Prof

Sujatha Ramdorai)

- Cancer Research & Education (TMH- Dr. Badve)

- Grid for Eye Care (Shankar Netralaya -Dr. Lingam Gopal )

- Climate Modeling (MOES- Dr. Goswami)

- E_governance from Planning Commission (Dr. Pani)

- Public Health Education (Dr. Mohandas)

- Knowledge Hub at Hyderabad


Working as a Close User Group (CUG) of connected Institutions

UOHYD

INTERNET

IIT, Hyderabad

LVP,Hyd

NKN Connectivity for each Model project

IIIT, Hyd

NKN POP

NKN Japanese Collaboration to set up IIT, Hyderabad

Virtual Community NKN

SV Univ, Tirupati Japan REN

IIT, Chennai

Possible NKN-JPREN International link 10 Gbps


NetworkStorageServers

Messaging

OSS Based

Directory

OSS Based

File Systems

OSS Based

Database

OSS Based

Workflow

OSS Based

Security

OSS Based

Web Services

Services Framework for evolution of Knowledge Hub

Foundation Technologies &Defining work packages

LAMP and open tools

Open Services Framework

Client Portal InterfaceWeb Interface

Web Services (SOA)

API

Open source software & tools

Physical


NKN Grid brings Climate Change modelling for

capacity building

NKN Grid brings Climate Change modelling for

capacity building

High Speed NKN

Grid Links

High Speed NKN

Grid Links

CRL, Pune

IISC,

Banglore

PARAM, C-DAC

IITM, Pune

IMD, Delhi

LINUXLINUX

LINUXLINUX

Researcher

IIT Delhi

Secretary MOES has requested for connecting their sites to NKN


Concerns about Cloud Computing

– Performance, reliability, and SLAs,

– Control of data, and service parameters,

– Application features and choices,

– Interaction between Cloud providers,

– No standard APIs – mix of SOAP and REST!

– Privacy, security, compliance, trust…


Security issues

• Security issues must be addressed, these include the

following:

– User Authentication,

– Access control (Authorization),

– Data security,

– Credential security,

– Client security,

– Acceptable use of new tools


Summary

• NREN have become major platform for e_science users

• Cloud Computing is seen as the next generation

architecture of IT Enterprise – a flexible & affordable IT

infrastructure

There is no need for the user to own the IT infrastructure, it

can be merely accessed or rented, by paying for the actual use

thus saving huge cost & headaches of IT management

• We are learning creation, operation and negotiations of

Virtual organizations (VO) in NKN

• Issues in security or security problems, quality and

reliability in NKN have to be handled with care


Thanks for your attention


Benefits of NKN

• National Research & Education Network(NREN): e-

infrastructure

- Ultra High speed (OFC), low latency network with scalability in

terms of reach & capacity

• Cost advantage due to consolidation and sharing - virtualization

• Central depository of software services & data bases for

multidisciplinary applications - effective usage

• Foundation for seamless & secure collaboration over network – uniform interfaces

Documents

Cloud Computing and NKNsymposium.vecc.gov.in/sacet09/public_html/downloads... · 2018-02-14 · 0.6/1 Gbps link to CERN/ GEANT 100 Mbps Link Tier III 2 Mbps ... • Cloud computing