High Energy & Nuclear Physics (HENP) SIG

Embed Size (px)

DESCRIPTION

October 4 th 2011 – Fall Member Meeting Jason Zurawski, Internet2 Research Liaison. High Energy & Nuclear Physics (HENP) SIG. Agenda. Group Name/Future Meetings LHCONE DYNES SC11 Planning AOB. Group Name/Future Meetings. - PowerPoint PPT Presentation

Text of High Energy & Nuclear Physics (HENP) SIG

  • High Energy & Nuclear Physics (HENP) SIGOctober 4th 2011 Fall Member MeetingJason Zurawski, Internet2 Research Liaison

    Internet2 2009

  • Group Name/Future MeetingsLHCONEDYNESSC11 PlanningAOB

    * *, 2011 Internet2

    Internet2 2009

  • HENP SIG is too hard for people to dereference when looking at the agendaPhysics SIG?Science SIG more embracing Others?Alternate Proposal Do we need a LHC BoF topics to focus on network support?

    * *, 2011 Internet2

    Internet2 2009

  • Group Name/Future MeetingsLHCONEDYNESSC11 PlanningAOB

    * *, 2011 Internet2

    Internet2 2009

  • * *, 2011 Internet2

    Internet2 2009

  • Internet2 2009

  • * *, 2011 Internet2Two issues identified at the DC meeting as needing particular attention:Multiple paths across AtlanticResiliencyAgreed to have the architecture group work out a solution

    Internet2 2009

  • LHCONE is a response to the changing dynamic of data movement in the LHC environment.It is composed of multiple parts:North America, Transatlantic Links, EuropeOthers?It is expected to be composed of multiple servicesMultipoint servicePoint-to-point serviceMonitoring service

    * *, 2011 Internet2

    Internet2 2009

  • Initially created as a shared Layer 2 domain.Uses 2 VLANs (2000 and 3000) on separate transatlantic routes in order to avoid loops.Enables up to 25G on the Trans-Atlantic routes for LHC traffic.Use of dual paths provides redundancy.

    * *, 2011 Internet2

    Internet2 2009

  • Planned point-to-point serviceSuggestion: Build on efforts of DYNES and DICE-Dynamic serviceDICE-Dynamic service being rolled out by ESnet, GANT, Internet2, and USLHCnetRemaining issues being worked outPlanned commencement of service: October, 2011Built on OSCARS (ESnet, Internet2, USLHCnet) and AUTOBAHN (GANT), using IDC protocol

    * *, 2011 Internet2

    Internet2 2009

  • Planned monitoring serviceSuggestion: Build on efforts of DYNES and DICE-Diagnostic serviceDICE-Diagnostic service, being rolled out by ESnet, GANT, and Internet2Remaining issues being worked outPlanned commencement of service: October, 2011Built on perfSONAR

    * *, 2011 Internet2

    Internet2 2009

  • * *, 2011 Internet2

    Internet2 2009

  • * *, 2011 Internet2*Mian Usman, DANTE, LHCONE technical proposal v2.0

    Internet2 2009

  • Domains interconnected through Layer 2 switchesTwo vlans (nominal IDs: 3000, 2000)Vlan 2000 configured on GEANT/ACE transatlantic segmentVlan 3000 configured on US LHCNet transatlantic segmentAllows to use both TA segments, provides TA resiliency2 route servers per vlanEach connecting site peers will all 4 route serversKeeping in mind this is a now solution, does not scale well to more transatlantic pathsContinued charge to Architecture group* *, 2011 Internet2

    Internet2 2009

  • * *, 2011 Internet2

    Internet2 2009

  • * *, 2011 Internet2

    Internet2 2009

  • VLANS 2000 and 3000 for the multipoint service are configured.Transatlantic routes, Internet2, and CANARIE all are participating in the shared VLAN service.New switch will be installed at MAN LAN in October.Will enable new connection by BNLPeering with Univ of Toronto through the CANARIE link to MAN LAN is completeEnd sites that have direct connections to MAN LAN are:MITBNLBU/Harvard

    * *, 2011 Internet2

    Internet2 2009

  • VLANS for multipoint service configured on 9/23.Correctly configured shortly thereafter to prevent routing loop Testing on the link can start any time.Status of FNAL Cisco.Resource constraints on the Chicago router have prevented this from happening. Port availability is the issue.End SitesSee diagram from this summer

    * *, 2011 Internet2

    Internet2 2009

  • * *, 2011 Internet2

    Internet2 2009

  • New York Exchange PointCiena Core Director and Cisco 6513Current Connections on the Core Director:11 OC-192s9 1 GigCurrent Connection on the 651316 10G Ethernets7 1G Ethernet

    * *, 2011 Internet2

    Internet2 2009

  • Switch upgrade:Brocade MLXe-16 was purchased with:24 10G ports24 1 G ports2 100G portsInternet2 and ESnet will be connected at 100G.The Brocade will allow landing transatlantic circuits of greater then 10G.An IDC for Dynamic circuits will be installed.Comply with GLIF GOLE definition

    * *, 2011 Internet2

    Internet2 2009

  • MAN LAN is an Open Exchange Point.1 Gbps, 10 Gbps, and 100 Gbps interfaces on the Brocade switch. 40 Gbps could be available by 2012.Map dedicated VLANs through for Layer2 connectivity beyond the ethernet switch.With the Brocade the possibility of higher layer services should there be a need.This would include OpenFlow being enabled on the Brocade.Dynamic services via an IDC.perfSONAR-ps instrumentation.

    * *, 2011 Internet2

    Internet2 2009

  • WIX = Washinton DC International Exchange PointJoint project being developed by MAX and Internet2 and transferred for MAX to manage once in operation.WIX is a stateoftheart international peering exchange facility, located at the Level 3 POP in McLean VA, designed to serve research and education networks.WIX is architected to meet the diverse needs of different networks.Initially, WIX facility will hold 4 racks, expandable to 12 racks as needed.Bulk cables between the existing MAX and Internet2 suites will also be in place.WIX is implemented with a Ciena Core Director and a Brocade MLXe-16.

    * *, 2011 Internet2

    Internet2 2009

  • Grow the connections to existing Exchange Points.Expand the facility with above the net capabilities located in the suite.Allows for easy access both domestically and internationallyGrow the number of transatlantic links to insure adequate connectivity as well as diversity.

    * *, 2011 Internet2

    Internet2 2009

  • Dedicated VLANs between participants for traffic exchange at Layer 2.WDC-IX will be an Open Exchange Point.Access to Dynamic Circuit Networks such as Internet2 ION.With the Brocade, there exists the possibility of higher layer services, should there be a need.Possibility of OpenFlow being enabled on the Brocade1 Gbps, 10 Gbps, and 100 Gbps interfaces are available on the Brocade switch. 40 Gbps could be available by 2012.perfSONAR instrumentation

    * *, 2011 Internet2

    Internet2 2009

  • Group Name/Future MeetingsLHCONEDYNESSC11 PlanningAOB

    * *, 2011 Internet2

    Internet2 2009

  • * *, 2011 Internet2

    Internet2 2009

  • Inter-domain Controller (IDC) Server and SoftwareIDC creates virtual LANs (VLANs) dynamically between the FDT server, local campus, and wide area networkIDC software is based on the OSCARS and DRAGON software which is packaged together as the DCN Software Suite (DCNSS) DCNSS version correlates to stable tested versions of OSCARS. The current version of DCNSS is v0.5.4.Initial DYNES deployments will include both DCNSSv0.6 and DCNSSv0.5.4 virtual machinesCurrently XEN basedLooking into KVM for future releasesA Dell R410 1U Server has been chosen, running CentOS 5.x

    * *, 2011 Internet2

    Internet2 2009

  • Fast Data Transfer (FDT) serverFast Data Transfer (FDT) server connects to the disk array via the SAS controller and runs the FDT softwareFDT server also hosts the DYNES Agent (DA) SoftwareThe standard FDT server will be a DELL 510 server with dual-port Intel X520 DA NIC. This server will a PCIe Gen2.0 card x8 card along with 12 disks for storage.

    DYNES Ethernet switch options:Dell PC6248 (48 1GE ports, 4 10GE capable ports (SFP+, CX4 or optical)Dell PC8024F (24 10GE SFP+ ports, 4 combo ports supporting CX4 or optical)

    * *, 2011 Internet2

    Internet2 2009

  • http://www.internet2.edu/ion/hardware.html IDCDell R410 1U ServerDual 2.4 GHz Xeon (64 Bit), 16G RAM, 500G HDhttp://i.dell.com/sites/content/shared-content/data-sheets/en/Documents/R410-Spec-Sheet.pdf FDTDell R510 2U ServerDual 2.4 GHz Xeon (64 Bit), 24G RAM, 300G Main, 12TB through RAIDhttp://i.dell.com/sites/content/shared-content/data-sheets/en/Documents/R510-Spec-Sheet.pdf SwitchDell 8024F or Dell 604810G vs 1G Sites; copper ports and SFP+; Optics on a site by site basishttp://www.dell.com/downloads/global/products/pwcnt/en/PC_6200Series_proof1.pdf http://www.dell.com/downloads/global/products/pwcnt/en/switch-powerconnect-8024f-spec.pdf

    * *, 2011 Internet2

    Internet2 2009

  • * *, 2011 Internet2

    Internet2 2009

  • AMPATHMid-Atlantic Crossroads (MAX)The Johns Hopkins University (JHU)MidAtlantic Gigapop in Philadelphia for Internet2 (MAGPI)*Rutgers (via NJEdge)University of DelawareSouthern Crossroads (SOX) Vanderbilt UniversityCENIC*California Institute of Technology (Caltech)MREN*University of Michigan (via MERIT and CIC OmniPoP)

    Note: USLHCNet will also be connected to DYNES Instrument via a peering relationship with DYNES

    * *, 2011 Internet2* temp configuration of static VLANs until future group

    Internet2 2009

  • MidAtlantic Gigapop in Philadelphia for Internet2 (MAGPI)University of Pennsylvania Metropolitan Research and Education Network (MREN)Indiana University (via I-Light and CIC OmniPoP)University of Wisconsin Madison (via BOREAS and CIC OmniPoP)University of Illinois at UrbanaChampaign (via CIC OmniPoP)The University of Chicago (via CIC OmniPoP)Lonestar Education And Research Network (LEARN)Southern Methodist University (SMU)Texas Tech UniversityUniversity of HoustonRice UniversityThe University of Texas at DallasThe University of Texas at ArlingtonFlorida International University (Connected through FLR)

    * *, 2011 Internet2

Recommended

View more >