Aruba Test Results

8/12/2019 Aruba Test Results

1/34

Aruba HTFPilot Deployment

This document contains proprietary information of MSA and is provided upon the condition

that the information contained herein will be held in confidence and will not be duplicated

or disseminated to others, in whole or in part, without the written permission of MSA.

1

Aruba HTF - Pilot Deployment

Network Report

&Test Results

Final


2/34





2

Aruba Architecture for HTF Pilot

CorporateController Pair @ HTF MDF:Master - 7240Local17240

Controller: running Aruba AOS-Version 6.3.1.3

------------------------------

Guest - DMZ Single Controller - @ SC DC:Standalone Local1 - 7210Controller: running Aruba AOS-Version 6.3.1.3

------------------------------

WithClearPass Publisher Appliance

AirWave Single Management Systems Server

------------------------------

SSIDs:Employeesvmwave(BSSID)Guestsvmwaveguest


3/34





3

Summary of Performance Results and TestingWLAN & Network Speed and Performance

Results showed the Aruba WLAN had throughput ranges of 3 to 1.2 times greaterperformance than the Cisco Network, tests included iperf and internet testing.

Device and Network Authentication

On Aruba turn-up, all devices available for testing were able to authenticate to the networkand roles appropriately.Since employees returned to work Tuesday 2/18/14, some issues have been found for a fewdevice /OS /browser combinations. These have been documented and trouble-shot creatingfixes /documenting work around solutions.

Survey Results & Range of AP representationsFor the Cisco WLAN, the general level of coverage is -60 dBm to -65 dBm on the reviewedfloors for both frequencies. After the floor plots are pictorials showing the individual AP RFpatterns. The individual AP plots show wide radius coverage for each AP out to the70dBm levels, which will allow clients to hold that AP for a longer distance. So devices, as seenin the roam walks, hold APs longer, and do switch to lower MCS rates and allow greater

distances from APs, before triggering their roaming threshold.In a discrete location, there are many APs (>5) offering similar power levels to devices inthat vicinity.

For the Aruba WLAN, the general level of coverage seen over the floors is very consistent atthe -50 dBm to -55 dBm levels for all floors for both frequencies. After the floor plots, are arange of graphs showing the individual cells of key APs for each of these floor areas andfrequencies. This shows that coverage for each AP is well defined and localized to maintaindevices on high MCS rates, then as you move away roaming is promoted for devices so theymaintain high rates and transition to other APs before degrading service by sticking to an APfor too long.In a discrete location, several APs offer excellent coverage at graduated power levels, so load

can be shared between adjacent APs.

RoamingAs a computer /device moves and transitions away from an AP, it needs to change to a newAP which now is closer and has a stronger signal to maintain the best PHY and Data ratesfor throughput and performance.

The plots, at the end of this report, show the number of roams seen with the same device onboth the Cisco and Aruba Networks. Generally the device was seen to roam more on the

Aruba WLAN, with all roams staying through the preferred 5 GHz band. Cisco on the 2ndfloor did show transitions through 2.4 GHz band, and number of roams in transit across thefloors were less.

AirwaveSummary reports detailing number and type of users are included at the end section of thereport.

Applications and Network Services Access Testing


4/34





4

All applications and services were found to be fully accessible through the Aruba WLAN, noaccess issues have been reported this week.

Tuning /Optimization Processes /Testing Results from Aruba WLAN turn-up

Initial Tuning after Turn-on

AOS Systems and Dashboard ReviewAfter APs has been turned on and allowed to settle for a short period, initial reviewsof AOS Dashboard metrics were completed. This reviews the power levels APs aresettling at, the channel choices APs are making for 2.4 & 5GHz frequencies, and AP statistics such as channel busy, noise floor and other datain the AP dashboard.

These metrics and Client data are reviewed in the AOS Dashboard throughout theTuning Cycle.

WLAN Floor Power Levels, RF Propagation and Client ReviewAfter reviews of controller metrics, initial reviews ClientsLaptops, Tablets andPhones, the WLAN Power levels they see, and their network characteristics are

assessed (PHY rates, roaming, APs seen, relative power levels in the twofrequencies, occurrence of same or adjacent RF channels).

Tuning Performance TestsIn this initial tuning period, a selection of performance tests on various devices wereconducted for assessment of configuration settings and performance.Note on testing techniques are in a later section.

Findings and ChangesIn this initial testing period for Aruba WLAN, power levels were adjustedfrom:

(min /max ARM settings)12 dBm /9 dBm to 9 dBm /9 dBm of 5GHzand9 dBm /6 dBm to 6 dBm /6dBm for 2.4 GHz.


5/34





5

Network Device Access & Testing to Networks Servers and Applications

2nd Stage Testing

After initial stage testing the network was allowed to settle before the next stage oftesting was performed.

This testing is a review of device authentication, performance, access to thenetwork, access to network services, applications usedwith tests performedthroughout the building space.

Network Services & Applications

Access was checked to network servers, applications, and DBs at many locationsthroughout all three floors, with access to them validated.

A selection of normally used devices were taken through the floors and tested fortypical use cases of access to the different network servers and applications normally

visited, from various representative locationsopen spaces, cubes, offices and

meeting rooms each floor.

The applications visited at each were: Biz Apps, SharePoint, PPM, OracleEBS, Horizon Workspace, Source, VPN (Guest ), WebEx, WebEx (steaming) andHelpzilla.

Communication Voice & Video Applications

Some limited testing was performed with Skype, Facetime & Lync, under thefollowing scenarios:

SkypeThree calls and video were held both internally and externally for 15minutes periods, one both devices moving internally, two to external devicesone

moving here in HTF and one static. With two devices moving together around thebuilding, the area of the stairs east end had some freezing of video.

Further testing was carried out 2/24/14, with moving calls throughout thebuilding, devices and calls worked well, though Skype server issues werefound for call set up.

Facetimetwo Facetime calls were made, one with both devices roaming, and theother to an external client generally static with a little local movement. When bothdevices were roaming a call was dropped near the stairs near the south west corner,

will want to test this location to see if isolated or a trend.

Further testing was carried out 2/24/14, calls worked well and no issuesfound.

Lynca Lync call was initiated with in HTF with an iPhone to an external callserver and external iPhone end point. A video and voice call was held for 10minutes while traversing the building and entering many rooms and meeting roomson route. Route taken was from 2nd floor cafeteria, upstairs, along 3rd floor, downelevator, to the 1st floor, walking through out and upstairs then traversing to the


6/34





6

meeting room. Only one issue was foundvideo froze at the bottom of theelevator while until the doors opened.

Further Lync testing is planned week of 2/24.

Formal AirMagnet Surveys

As part of the baseline assessment of the Cisco Network, an AirMagnet survey wastaken of floors 2 and 3. A report was then to show the different coverage over eachfloor through the 5 & 2.4 GHz Frequencies, and break-out for each section of thekey APs and their zones of coverage.

Similarly the same survey was performed over all the floors after the transition toAruba, and the same reports run from the data.

The graphical results are shown in a later section.

Specific Testing at Cube /Meeting Room /Office Locations

As part of the baseline assessment of the Cisco networks, iperf and internet speedtesting was performed at specific locations, which then were repeated after puttingthe Aruba WLAN into service.

The results are shown in a later section.

Roaming Tests

Roaming tests were logged and plotted on floor plans using a single laptop device,ideal results will be a roam by every 2nd - 3rd /4thAP, to maintain the highest MCSrates. Roams should let the device remain on the 5GHz frequency withouttransferring to 2.4GHz. These have been documented and plotted on floor plans forboth network in later sections.


7/34





7

Relative Performance Test results prior CICSO network & new ARUBA Network

HTF Pilot

Iperf ServerSamsung Win8.1 w/ 1G port. Wire iperf test to wired 1G MAC 937 Mbps (Server validation Test).General setting were used, iperf testing could be optimized to increase throughput.

Speed Testswire speed tests with Samsung Win8.1 w/ 1G port were 250/550 @ speedtest.com, and 350/750 atComcast/xfinity test sites.

If dates are not stated in entries below, then measurements were taken on 2/15 for Cisco and 2/16 for Aruba.

Further testing will be planned for iPerf testing, with network under normal load conditions week of

2/24.


8/34





8

Details of other Testing and Applications used for Network Assessmentand Testing

Other testing processes not described elsewhere

Of the different types of devices, many devices have different OSs, wireless NICs(networkinterface cards), and maximum power levels they typically transmit at, and consequentlyeffective range they are able to talkbi-directionally to APs. The graded power curve fordevice types is (most powerful to least): laptops, tablets, phones & other handheld devices.

LaptopsA variety of CMD commands were run to access connection WLAN /NICs, ping,while moving around through the HTF floors to access PHY rates and roamingcharacteristics the device choose, and connectivity for the WLAN config settingsduring testing. This is dynamic testing, and observations are used to review resultsfor Surveys and Roam results.

Tablets /PhonesAruba Utilities is a useful application for Droids and review of networks designedfor capacity; it lists all the SSIDs, channels and frequencies (device must be b/g/an & ac useful) that the device can see, colour codes similar

VAPs, and shows the dBm power levels visible for each at that location. It alsoclearly shows PHY rates & roaming activities for these devices as they movethrough the floor space and network; and can pull AirWave floor plan data andmetrics.


9/34





9

AirMagnet Survey of WLAN

HTFCisco AirMagnet Survey Data Samples

Floor 25 GHz

Signal Distribution


10/34


11/34





11

Floor 22.4 GHz


12/34





12


13/34





13

Floor 35 GHz


14/34





14


15/34





15

Floor 32.4 GHz


16/34





16


17/34





17

HTFAruba AirMagnet Survey Data SamplesSurvey data of the Aruba WLAN was taken on Feb 16th.

Floor 15 GHz


18/34





18


19/34





19

Floor 12.4 GHz


20/34





20


21/34





21

Floor 25 GHz


22/34





22


23/34





23

Floor 22.4 GHz


24/34





24


25/34





25

Floor 35 GHz


26/34





26


27/34





27

Floor 32.4 GHz


28/34





28


29/34





29

Roamingrepresentations of device roaming characteristics for a laptop device


30/34





30


31/34





31


32/34





32


33/34





33

AirWave

Cisco users through their Pilot Phase:

Aruba users through their Pilot first week:


34/34



Documents

Aruba Test Results