Connect. Communicate. Collaborate
Global On-demand Light Paths – Developing a Global Control Plane
R.Krzywania PSNCA.Sevasti GRNETG.Roberts DANTE
TERENA Networking Conference ‘08, Brugge, Belgium, 19-22.05.2008
Connect. Communicate. Collaborate
AutoBAHN is…
• … a research activity for engineering, automating and streamlining the inter-domain setup of guaranteed capacity (Gbps) end-to-end paths
• … a Joint Research Activity of the GN2 project– GN2 is an European Commission-funded project, with all
the European Research and Education networks (NRENs) as partners
Connect. Communicate. CollaborateAutoBAHN approach
• Control and provisioning has to be distributed• Business-layer related interactions include AA, policies,
advance reservations etc.• Privacy and control of intra-domain resources must be
safeguarded
Connect. Communicate. Collaborate
AutoBAHNarchitecture
A
utoB
AH
N s
yste
m a
D
ata
pla
ne u
Domain Manager
Inter-Domain Manager
Intra-Domain Pathfinder
Topology Abstraction
Reservation Handler
User interface
Timer
User access module
Request handling logicAAI
Resource modelling
Policy module
Inter-domain pathfinder
Technology Proxy
Vendorproxy
CalendarMonitoring
Public Interface
Control/Management plane or Provisioning system
Vendorproxy
Domain-specific proxy
Connect. Communicate. CollaborateAutoBAHN experiences
Jun
20
07
No
v 2
007
Jan
20
08
Apr
200
8
4th G
N2 W
orks
hop
–
AutoB
AHN pro
toty
pe d
emo
SC’07
– 1
st Aut
oBAHN &
DCN d
emo
5th G
N2 W
orks
hop
– Fu
lly o
pera
ble
Europ
ean
AuoBAHN d
emo
Inte
rnet
2 Spr
ing
Mee
ting
– Fu
lly
oper
able
Aut
oBAHN &
DCN d
emo
Connect. Communicate. Collaborate
GEANT2 Workshop June 2007 Demonstration
• Three domains are involved:– GRNET and HEAnet
interconnected through GEANT2 links
• AutoBAHN is in prototype phase– IDM functionality is near
completed– DM functionality is emulated
Connect. Communicate. Collaborate
GEANT2 Workshop June 2007 Demonstration
• The system assumes that it has full control over network resources within domain
• Domains are able to exchange abstracted resources view• Inter-domain pathfinder enables searching for available
resources within AutoBAHN cloud (local domain search was pre-defined manually and fixed)
• Reservations can be set for future execution (advance reservation feature)
• Single reservation requests are grouped under service instance
Connect. Communicate. Collaborate
GEANT2 Workshop June 2007 Demonstration
Lithuania
Albania
Austria
Bulgaria
Croatia
Cyprus
Czech Republic
Finland
France
Germany
Italy
Hungary
Latvia
FYROM
Norway
Poland
Serbia
Slovakia
Slovenia
Spain
Sweden
Switzerland
Turkey
Ukraine
United Kingdom
Denmark
Portugal
Bosnia & Herzegovina
Belgium
Netherlands
Estonia
Belarus
Romania
Moldova
Luxembourg
Montenegro
HEAnet- managed by BLUENet tool- automatic MPLS network provisioning
GRNET- managed by ASNTool- automatic Ethernet network provisioning
GEANT2/DANTE- managed by Alcatel NMS - automatic SDH network provisioning
Calendar module allows to schedule reservations in advance
Connect. Communicate. Collaborate
GEANT2 Workshop June 2007 Demonstration
• The live demonstrations of AutoBAHN have sped up the development process providing feedback to the development.
• It opens NRENs for cooperation, so that important input of requirements and suggestions could be taken into consideration
• The number of NRENs involved in test and demonstration environment is increased
• More NRENs declares its interest to join the AutoBAHN cloud• Reservation time can not be easily estimated. The highest delay is
introduced by Alcatel NMS and associated domain resource management tool (up to 4 minutes).
Connect. Communicate. Collaborate
GEANT2 Workshop June 2007 Demonstration
• Lessons learned– The DM implementation is strongly dependant on local
domain network management model and procedures– The DM needs to be extended with dedicated tools to
collaborate with existing management applications used within domains
– Exceptional situations were encountered during testing, and preventing/reacting actions must be defined and implemented
– Network configuration time depends on domain technology and capabilities (e.g. NMS efficiency) and must not be ignored
Connect. Communicate. Collaborate
GEANT2 Workshop June 2007 Demonstration
Local Mgmt tools NMS Policy Local Mgmt tools NMS Policy
Connect. Communicate. CollaborateAutoBAHN experiences
Jun
20
07
No
v 2
007
Jan
20
08
Apr
200
8
4th G
N2 W
orks
hop
–
AutoB
AHN pro
toty
pe d
emo
SC’07
– 1
st Aut
oBAHN &
DCN d
emo
5th G
N2 W
orks
hop
– Fu
lly o
pera
ble
Europ
ean
AuoBAHN d
emo
Inte
rnet
2 Spr
ing
Mee
ting
– Fu
lly
oper
able
Aut
oBAHN &
DCN d
emo
Connect. Communicate. Collaborate
SuperComputing’07 demonstration
• On November 2007 AutoBAHN is presented on SuperComputing’07 event
• European test environment is interconnected with USA part• Dedicated IDC protocol is defined and implemented to
assure interoperability of AutoBAHN and DCN systems
Connect. Communicate. Collaborate
SuperComputing’07 demonstration
Connect. Communicate. Collaborate
SuperComputing’07 demonstration
• 4 European domains involved
• Attempt to collaborate with alternative system
• Attempt to automatically connect two continents
• Phoebus infrastructure deployment
• Cyclic durability test
Connect. Communicate. Collaborate
SuperComputing’07 demonstration
• IDM is improved and enhanced with IDC capability• DM is implemented and enable control of network
resources (with assist of domain dedicated tools)• Deployment of domain resource management tools in all
involved NRENs in Europe – GRNET, HEAnet, and PSNC/PIONIER, DANTE/GEANT2
• The interoperability with ESNet and Internet2 clouds is enabled
• Phoebus infrastructure is deployed as a client for BoD systems
Connect. Communicate. Collaborate
SuperComputing’07 demonstration
• IDC protocol– Defined by AutoBAHN and DCN team to enable
interoperability of BoD systems– Web Services based messages exchange– Contains:
• Topology exchange details• Reservation related requests/responses
– Scheduling
– Signalling
Connect. Communicate. Collaborate
SuperComputing’07 demonstration
• IDC protocol – Topology elements– Minimal set of toplogy exchange elements
• Domains• Nodes• Ports• Links
– Domain privacy and policy• Only the abstracted topologies are available
to public and is exchanged between systems
• Real data (interface names, etc.) may be hidden or missing depending on abstraction level and policy
Connect. Communicate. Collaborate
SuperComputing’07 demonstration
`
Switch1 Eth1.1
10.0.0.1 10.0.1.1
Eth1.1
urn:ogf:network:domain=net1:node=city.switch1:port=eth1.1
DCN
Switch1
urn:ogf:network:domain=net1:node=10.0.0.1:port=10.0.1.1
Connect. Communicate. Collaborate
• IDC protocol – Path definitions
SuperComputing’07 demonstration
SRC
DST
SRC
DST
SRC
DST
SRC and DST points only
SRC and DST with some intermediate points
All points on the path
Connect. Communicate. Collaborate
SuperComputing’07 demonstration
• Synchronous vs. Asynchronous communication model for inter-domain connections– AutoBAHN implements asynchronous communication as
communication delays and resource processing can not be arbitrary defined
– DCN implements synchronous communication, which leaded to waiting for request responses between Europe and USA
– The reservation time in Europe requires all resources to be configured and put into operational state, which may take up to 4 minutes.
– DCN may consider timeouts and reservation failures if response waiting periods were defined too short.
Connect. Communicate. CollaborateAutoBAHN experiences
Jun
20
07
No
v 2
007
Jan
20
08
Apr
200
8
4th G
N2 W
orks
hop
–
AutoB
AHN pro
toty
pe d
emo
SC’07
– 1
st Aut
oBAHN &
DCN d
emo
5th G
N2 W
orks
hop
– Fu
lly o
pera
ble
Europ
ean
AuoBAHN d
emo
Inte
rnet
2 Spr
ing
Mee
ting
– Fu
lly
oper
able
Aut
oBAHN &
DCN d
emo
Connect. Communicate. Collaborate
Demonstration on GEANT2 Workshop January 2008
• Multiple parallel connections between end points was supported by data plane
• Domains resource management is fully automated and performed without administrator attention
Connect. Communicate. Collaborate
Demonstration on GEANT2 Workshop January 2008
Lithuania
Albania
Austria
Bulgaria
Croatia
Cyprus
Czech Republic
Finland
France
Germany
Italy
Hungary
Latvia
FYROM
Norway
Serbia
Slovakia
Slovenia
Spain
Sweden
Switzerland
Turkey
Ukraine
United Kingdom
Denmark
Portugal
Bosnia & Herzegovina
Belgium
Netherlands
Estonia
Belarus
Romania
Moldova
Luxembourg
Montenegro
HEAnet- BLUENet for MPLS provisioning
PIONIER- Automated MPLS provisioning
GRNET- ASNTool for VLANs proviosioning
GEANT2- Alcatel NMS for SDH provisioning
Connect. Communicate. Collaborate
GEANT2 Workshop Jan’08 Lessons learnt
AdminPolicy
MPLS /GMPLS
• Domains are not keen to show too much details of their topology. In some cases it should be limited just to domain edge points (Ingress/egress points and links to clients)
• MPLS domains topology is seen as a cloud, and limited management capabilities are supported through available NMS’
Connect. Communicate. Collaborate
GEANT2 Workshop Jan’08 Lessons learnt
• Alcatel NMS do not allow easily to control the resources at very low level
• Issues with usage of local NMS pathfinding for advance reservation (pathfinding is done with current state, as no calendar is available)
NMS
A B C D
A C
B
D
Connect. Communicate. Collaborate
GEANT2 Workshop Jan’08 Lessons learnt
• That leads to modification of initial AutoBAHN assumption of having explicit and full control over network resources– Domains may be represented in very simplified way
(abstraction process), even as a single node– NMS may be considered to have „unlimited” resources
and control resources basing more on policy, rather than tracking network status
– Abstraction process should be modified and new methods of resource management at DM level must be introduced
Connect. Communicate. CollaborateAutoBAHN experiences
Jun
20
07
No
v 2
007
Jan
20
08
Apr
200
8
4th G
N2 W
orks
hop
–
AutoB
AHN pro
toty
pe d
emo
SC’07
– 1
st Aut
oBAHN &
DCN d
emo
5th G
N2 W
orks
hop
– Fu
lly o
pera
ble
Europ
ean
AuoBAHN d
emo
Inte
rnet
2 Spr
ing
Mee
ting
– Fu
lly
oper
able
Aut
oBAHN &
DCN d
emo
Connect. Communicate. Collaborate
Internet2 Spring Meeting 2008 demonstration
Connect. Communicate. Collaborate
Internet2 Spring Meeting 2008 demonstration
Lithuania
Albania
Austria
Bulgaria
Cyprus
Finland
France
Germany
Italy
Hungary
Latvia
FYROM
Norway
Serbia
Slovakia
Spain
Sweden
Switzerland
Turkey
Ukraine
United Kingdom
Denmark
Portugal
Belgium
Netherlands
Estonia
Belarus
Romania
Moldova
Luxembourg
Montenegro
GEANT2
HEAnetPIONIER
CESNET
CARNET
GRNET
GARR
Link to NY
Connect. Communicate. Collaborate
Internet2 Spring Meeting 2008 demonstration
• IDC protocol improvements in features and stability• Hazard situations are limited and IDM/DM stack handles
most failure situations• Phoebus infrastructure is used to request circuits and
generate traffic• QinQ support due to Phoebus requirements• Constant, long term durability testing on automated circuit
set up and tear down• 7 domains involved on European site: CARNet , CESNET,
GARR, GEANT2, GRNET, HEAnet, PIONIER
Connect. Communicate. Collaborate
Internet2 Spring Meeting 2008 demonstration – Lessons Learnt
• Reservation states incompatibility – SCHEDULED state is missing in DCN design.
• New features are requested for IDC functionality– Modify reservation– Find possible reservation time
Connect. Communicate. CollaborateThe AutoBAHN team
Connect. Communicate. Collaborate
Global On-demand Light Paths – Developing a Global Control Plane
Thank you
Please visit: http://www.geant2.net/autobahn