37
IXLeeds Technical Update IXLeeds 2 / 12 of September 2012 Thomas Mangin

IXLeeds 2 Technical Update

Embed Size (px)

DESCRIPTION

IXLeeds 2 Members update

Citation preview

Page 1: IXLeeds 2 Technical Update

IXLeeds Technical Update IXLeeds 2 / 12 of September 2012

Thomas Mangin

Page 2: IXLeeds 2 Technical Update

Technical Update

Since IXLeeds 1 ....Work on our core services

EmailNew switching platformLooking GlassRoute ServerBehind the scene

Page 3: IXLeeds 2 Technical Update

Mailing Lists

LIThe initial Leeds Interconnect group

opsfor operational discussion

please make sure you are subscribed

membersfor members discussion

very low volume

event-announcenew mailing list, subscribe if you want to know about IXLeeds’ events.

http://mailman.ixleeds.net/mailman/listinfo/members

Page 4: IXLeeds 2 Technical Update

Contacting us by mail

[email protected] , [email protected] any problems with the LAN or servicesgoes to andy and thomasplease do _not_ send only one of us direct mails

[email protected] , [email protected] any question about ixleedsgoes to the whole board (currently)

[email protected] board email address

Page 5: IXLeeds 2 Technical Update

Migration to the Brocade RX8

Installation and Migration in MarchSurprises during installation

Back to front installation (wrong cold aisle)Front to side airflow intake for powerSide to side air-flow intake for the switch

Overnight workNo complicationPort security works well (some of you know about it)

Thank you to for the donation and the configuration template / manualsAndy and Craig for their help on the night

Page 6: IXLeeds 2 Technical Update

Right location

Page 7: IXLeeds 2 Technical Update

First Uplink

Page 8: IXLeeds 2 Technical Update

Completed Installation

Page 9: IXLeeds 2 Technical Update

Switch Utilisation

Capacity 16x 10GB ports

96x 1GB ports

Utilisation 1x 100 Mb port

previous route collector (still doing IPv6)

21x 1 Gb port 12 1.5k VLAN members 2 9k VLAN members 7 Infrastructure ( 4x servers, 2x route servers, uplink )

2x 10 Gb membernew member port plugged (with PI)

Page 10: IXLeeds 2 Technical Update

Traffic

Traffic at the exchangeStill driven by a very few membersMost networks are eyeballs

Over 300 Mb this Autumn

This week around 100 Mb

Live graphs ?changed a few time the backend

(witchtrial on previous server, cacti, going to FranceIX)need to be merged to keep history

different RRD format .. not as simple as it sounds at first.ETA: with SFlow or before

Page 11: IXLeeds 2 Technical Update

New Looking Glass

New tools availablehttp://lg.ixleeds.net/by Daniel Piekacz (in the room) from Exa Networksusing ExaBGP (our current route-collector)

Publicly released last weekhttps://code.google.com/p/gixlg/

Already other public location using it ..http://www.freestone.net/lg/

Page 12: IXLeeds 2 Technical Update

New Looking Glass

A few glitches to ironNothing major.I am on it ...

Still not completed.IPv6 still on Cisco ..Google “IPv6 vlan ubuntu bug” (now fixed)

Page 13: IXLeeds 2 Technical Update

Looking Glass

Public visibility of the collector

Page 14: IXLeeds 2 Technical Update

Looking Glass

Route information

Page 15: IXLeeds 2 Technical Update

Looking Glass

Route information

Page 16: IXLeeds 2 Technical Update

Looking Glass

Route information

Page 17: IXLeeds 2 Technical Update

GIXLG in a network

Page 18: IXLeeds 2 Technical Update

Visualise your Paths

Page 19: IXLeeds 2 Technical Update

More Specific 8.8.8.0/24

Page 20: IXLeeds 2 Technical Update

Route Servers

Finally ... They are readyThank you to

for sharing their work with usAndy for installing the server and configuring them ...

You can connect !Collector : 91.217.231.1 / AS 51526RS1 : 91.217.231.2 / AS 57932RS2 : 91.217.231.3 / AS 57932

Not yet available on the 9k LAN“Preempting : No Martin, no IPv6. At least not yet”

Page 21: IXLeeds 2 Technical Update

Behind the sceneIntranet

database driven- members

- roles- phone- email

- infrastructure- location- swith(es)- linecards- ports- vlans

Page 22: IXLeeds 2 Technical Update

Behind the sceneIntranet

Page 23: IXLeeds 2 Technical Update

Behind the sceneIntranet

We are missing contact information for a few members, we will be contacting you shortly.

Page 24: IXLeeds 2 Technical Update

Behind the scenecontinued ...

Quickly* to not be too boringPaper .. work

The connection policy ratifiedRIPE resources request and transferDocumentation (network, servers, ...)

Server .. workNew servers installation and maintenance

WEB, DNS, NTP, SYSLOG, MAIL/Mailing Lists, ...Offsite backups

Website .. workWebsite (DB integration) whizz-kid anywhere ?

Late .. workquite a _lot_ on our todo lists .....

* Yes I can speak even faster

Page 25: IXLeeds 2 Technical Update

Technical Update

time is limited .. problem happens

SFLOW statusLAN issues

and lesson learned

Page 26: IXLeeds 2 Technical Update

SFLOW

A work in progress.

Thank you very much to

For sharing their work with us ..is there any IX we did not borrow something from ?

Planning to make their work generic.And release it to every Euro-IX members

Some work leftThe code is good, need cleanup and making generic

Page 27: IXLeeds 2 Technical Update

Issues

One global LAN issueall the port went downrequired a reboot of the switchfound an issue with remote syslog ...

Many port security violationA few member suffering from MAC leaks

Route CollectorTwo separate issues (one in April) not service affecting (one last week)

Fixed quickly (but some members left their session down)left members without session while it was updated / fixed

Page 28: IXLeeds 2 Technical Update

Issues

What did we learnNeed for better (external) monitoringMembers were faster to detect the fault than we were

Better out of band solutionMake sure we have console OOB

The right console cables is now left on-siteWe could not access the switch before the reboot :(

Page 29: IXLeeds 2 Technical Update

Technical Update

New services

9K VLANPrivate InterconnectMore services ?

Page 30: IXLeeds 2 Technical Update

9,000 Bytes MTU VLAN Inspiration : draft-mlevy-ixp-jumboframes-00

Took some convincing to get RIPE to agree ..

Allows to pass encapsulated traffic unfragmentedL2TP, SAN, ...

Requires a new port

No extra cost - Just ask for it

New Service

Page 31: IXLeeds 2 Technical Update

New Service

Member to Member PIProvided by many IXes

https://www.euro-ix.net/tools/ixp_matrix“vlan services”

Possible on existing port as a VLAN

most practical, preferred routeon a dedicated port

for free (as long as we have no port pressure constraint)

Like normal peering LAN, two optionsIPv4 / IPv61500 / 9000 Bytes MTU

Page 32: IXLeeds 2 Technical Update

Moving Forward ..

Starting new services ?Private User Group

Point to Multi-PointStill BGP between different speakers

Provide more value to our membersstarting partnership to become as well a plaform for services

A marketplace for transit ?Allowing different joining condition for foreign networks ?

Require a consultationBoard strategic review on new servicesPresentation to members for a vote

Page 33: IXLeeds 2 Technical Update

Technical Update

Good of the internet

L-ROOTM-LABNews ServiceMore ?

Page 34: IXLeeds 2 Technical Update

Looking Forward

IX helping to keep traffic localone of the reason for peering

IX helping with resiliencepeering is distributed

IX helping internet research helps our members

Page 35: IXLeeds 2 Technical Update

For the good of the internet

Providing connectivity to friendly organisation

L-ROOT DNS ServerConnecting an AnyCast DNS serverProvide resilience for DNSGoogle “godaddy outage million sites”

M-LABMeasurement Lab (M-Lab) is an open, distributed

server platform for researchers to deploy Internet measurement tools.

Page 36: IXLeeds 2 Technical Update

For the good of the t’interweb

News servicerequested by a memberaccess to usenet news to your customers via IXLeedsbinary free to begin withonce online, point your DNS to it :D

Any more ?mirror of popular sites ? Distribution, etc.others