29
IT & DATA MANAGEMENT RESEARCH, INDUSTRY ANALYSIS & CONSULTING EMA Research Report: Enterprise Data Center Network Transformation REPORT SUMMARY ENTERPRISE MANAGEMENT ASSOCIATES ® (EMA™) Research Report Written by Shamus McGillicuddy Q4 2017 Sponsored by:

EMA Research Report: Enterprise Data Center Network ... · IT DATA MANAGEMENT RESEARCH INDSTRY ANALSIS CNSLTING EMA Research Report: Enterprise Data Center Network Transformation

  • Upload
    hamien

  • View
    214

  • Download
    0

Embed Size (px)

Citation preview

Page 1: EMA Research Report: Enterprise Data Center Network ... · IT DATA MANAGEMENT RESEARCH INDSTRY ANALSIS CNSLTING EMA Research Report: Enterprise Data Center Network Transformation

IT & DATA MANAGEMENT RESEARCH,INDUSTRY ANALYSIS & CONSULTING

EMA Research Report: Enterprise Data Center Network TransformationREPORT SUMMARYENTERPRISE MANAGEMENT ASSOCIATES® (EMA™) Research ReportWritten by Shamus McGillicuddy

Q4 2017

Sponsored by:

Page 2: EMA Research Report: Enterprise Data Center Network ... · IT DATA MANAGEMENT RESEARCH INDSTRY ANALSIS CNSLTING EMA Research Report: Enterprise Data Center Network Transformation

Table of Contents

©2017 Enterprise Management Associates, Inc. All Rights Reserved. | www.enterprisemanagement.com

EMA Research Report: Enterprise Data Center Network Transformation

Executive Summary ................................................................................................................................. 1

Introduction ............................................................................................................................................ 1

Overview of Research Participants ........................................................................................................... 2

Forces of Change ..................................................................................................................................... 3

Technology Choices for Data Center Network Transformation .............................................................. 4

Leaf-and-Spine Network Fabrics ........................................................................................................ 4

SDN Is Central to Data Center Network Transformation ................................................................. 5

Disaggregated Switching Is Common in Network Transformation .................................................... 9

Load Balancing and Application Delivery Controllers .................................................................... 12

Transforming Data Center Network Engineering and Operations ....................................................... 16

Automating the Data Center Network ............................................................................................. 16

Network Managers Want More From Their Hardware Vendors ....................................................... 18

Organizational Factors of Data Center Network Transformation .......................................................... 20

Networking Life in the Transformed Data Center ............................................................................ 20

Conclusion ............................................................................................................................................ 23

Demographics ........................................................................................................................................ 24

Page 3: EMA Research Report: Enterprise Data Center Network ... · IT DATA MANAGEMENT RESEARCH INDSTRY ANALSIS CNSLTING EMA Research Report: Enterprise Data Center Network Transformation

PAGE 1 ©2017 Enterprise Management Associates, Inc. All Rights Reserved. | www.enterprisemanagement.com

EMA Research Report: Enterprise Data Center Network Transformation

Executive SummaryToday’s enterprises increasingly require data center networks that are more agile, higher performing, more resilient, and more automated. To meet these requirements, IT organizations are adopting new network technologies, including software-defined networks, network virtualization, network orchestration and automation software, disaggregated switches, and much more. This end-user research report is based on a survey of 200 IT professionals directly involved in data center network transformation projects. It identifies the technologies and strategies they use and the challenges that enterprises face with such transformation initiatives. It also identifies some emerging best practices.

IntroductionToday enterprises need data center networks that are dynamic, programmable, automated, and resilient. In fits and starts the networking world has tried to keep up, introducing leaf-and-spine architectures based on equal-cost multi-pathing (ECMP). Later, we saw the emergence of software-defined networking (SDN), network virtualization, and much more.

To varying degrees, many enterprises are transforming their data center networks, but a definitive roadmap for success remains elusive. EMA set out to understand how enterprises are tackling data center network transformation. This research report investigates the drivers of change in enterprise data center networks, the challenges organizations face with these changes, and the technology decisions they are making. EMA surveyed 200 enterprise IT professionals who are directly involved in data center network transformation initiatives.

To provide context for this research, EMA presented participants with the following definition:

data center network transformationAn initiative that leverages new technologies, design practices, and processes to make data center networks more agile, programmable, scalable, efficient, high-performing, and reliable. These transformation initiatives can involve the implementation of a completely new network or the use of new technologies that transform a legacy network or information system.

Examples of transformative network technologies include leaf-and-spine network fabrics, software-defined networking (SDN) solutions, network automation and orchestration software, network virtualization, disaggregated switches (e.g., white-box or bare-metal switches) and private cloud frameworks (e.g., OpenStack).

Only IT professionals who were directly involved in such a transformation initiative were allowed to participate in this survey.

Page 4: EMA Research Report: Enterprise Data Center Network ... · IT DATA MANAGEMENT RESEARCH INDSTRY ANALSIS CNSLTING EMA Research Report: Enterprise Data Center Network Transformation

PAGE 2 ©2017 Enterprise Management Associates, Inc. All Rights Reserved. | www.enterprisemanagement.com

EMA Research Report: Enterprise Data Center Network Transformation

Overview of Research ParticipantsThis research is based on a survey of 200 IT professionals based in North America. Most of them held senior IT positions: 34% were IT managers, 35% were IT directors, 7% were vice presidents, and 22% were CIOs or CTOs. Just 2% were IT specialists, such as engineers or architects.

All participants in this research worked in midmarket or large enterprises. For the purposes of this project, EMA defined a “midmarket enterprise” as an organization with 1,000 to 4,999 global employees. We defined “large enterprises” as organizations with 5,000 or more employees worldwide. Forty percent (40%) of participants worked in midmarket companies, and 60% worked for large enterprises, including 24% who worked in organizations with 20,000 or more employees.

Nearly half of the organizations represented in this research had already completed a data center network transformation initiative. As Figure 1 shows well over one-third said they were in the midst of their transformation implementation, while 15% said they were starting implementation within the next year.

48%

38%

15%

0%

0%

We have completed a transformation implementation

We have started a transformation implementation

We plan to start a transformation implementation within 12 months

We have no transformation plans

Do not know

Figure 1. The current stage of these data center network transformation initiatives

These IT professionals were involved in multiple aspects of data center networking, with a majority participating in the following tasks: researching network solutions, procuring solutions, planning and designing networks, deploying networks, managing performance, managing capacity, and even managing for cost efficiencies.

Page 5: EMA Research Report: Enterprise Data Center Network ... · IT DATA MANAGEMENT RESEARCH INDSTRY ANALSIS CNSLTING EMA Research Report: Enterprise Data Center Network Transformation

PAGE 3 ©2017 Enterprise Management Associates, Inc. All Rights Reserved. | www.enterprisemanagement.com

EMA Research Report: Enterprise Data Center Network Transformation

Forces of ChangeData center network transformation does not happen in a vacuum. There are specific drivers for why enterprises pursue this change. And those drivers often shape the technical and business requirements that organizations establish for these projects.

EMA asked research participants to identify the technology initiatives that are most responsible for driving their data center network transformation efforts. Four initiatives emerged as particularly influential, as Figure 2 shows. Big data analytics (42% of respondents) is the most common driver of network transformation. Big data technologies can create tremendous bursts of traffic in the data center. For our 2015 research study “Big Data Impacts on IT Infrastructure and Management,” EMA asked adopters of big data solutions to identify how the technology was most affecting their IT environments. Forty-five percent (45%) reported increased network traffic loads due to big data collection, and 46% reported increased network traffic loads from backups of big data repositories.

Other leading drivers of network transformation included hybrid cloud or multicloud architecture (32%), server virtualization (32%), and the Internet of Things (31%). Midmarket companies were particularly driven by hybrid cloud and multicloud projects (44%), in contrast to 23% of large enterprises.

42%32%32%

31%20%20%

18%16%16%

15%12%12%

10%0%

Big data analyticsHybrid cloud or multicloud architecture

Server virtualizationInternet of Things

Data center consolidationDisaster recovery strategy

Data center resiliencyRegulatory compliance/risk mitigation

Platform-as-a-service initiativeInternal private cloud transformation

Workload anywhere initiativeDevOps/continuous development

Containers and microservicesOther

Figure 2. Primary drivers of data center network transformation

Big data analytics (42% of respondents) is the most common driver of network transformation.

Page 6: EMA Research Report: Enterprise Data Center Network ... · IT DATA MANAGEMENT RESEARCH INDSTRY ANALSIS CNSLTING EMA Research Report: Enterprise Data Center Network Transformation

PAGE 4 ©2017 Enterprise Management Associates, Inc. All Rights Reserved. | www.enterprisemanagement.com

EMA Research Report: Enterprise Data Center Network Transformation

Technology Choices for Data Center Network Transformation Leaf-and-Spine Network FabricsLeaf-and-spine fabrics appear to be a foundational element of data center network transformation. An alternative to legacy fat-tree network architecture, leaf-and-spine networks provide any-to-any connectivity between any two servers in a data center. A leaf-and-spine topology is two-tiered, with a layer of leaf switches, usually top-of-rack or end-of-row devices, that serve as the server access layer. Leaf switches mesh into the spine layer of switches via specialized Layer 2 protocols or an Equal Cost Multi-Pathing (ECMP) Layer 3 routing scheme. Then the spine layer of switches provide interconnections between different leaf switches. Leaf-and-spine topologies can scale out by adding more switches to the spine layer.

Yes56%

No32%

Do not know12%

Figure 3. Adoption of leaf-and-spine network fabric in data centers

Page 7: EMA Research Report: Enterprise Data Center Network ... · IT DATA MANAGEMENT RESEARCH INDSTRY ANALSIS CNSLTING EMA Research Report: Enterprise Data Center Network Transformation

PAGE 5 ©2017 Enterprise Management Associates, Inc. All Rights Reserved. | www.enterprisemanagement.com

EMA Research Report: Enterprise Data Center Network Transformation

SDN Is Central to Data Center Network TransformationNinety-eight percent (98%) of the enterprises represented in this research are adopting SDN in their data centers. Figure 4 reveals that more than one-third of them had already completed a product deployment, while the rest were either in deployment or were planning to deploy within 12 months.

36%

44%

16%

2%

We have completed an SDN production deployment

We have begun an SDN production deployment

We will begin an SDN production deployment in the next 12 months

We have no plans to proceed with an SDN production deployment in the next 12 months

Figure 4. SDN activity as part of a data center network transformation initiative

98% of the enterprises represented in this research are adopting SDN in their data centers.

Page 8: EMA Research Report: Enterprise Data Center Network ... · IT DATA MANAGEMENT RESEARCH INDSTRY ANALSIS CNSLTING EMA Research Report: Enterprise Data Center Network Transformation

PAGE 6 ©2017 Enterprise Management Associates, Inc. All Rights Reserved. | www.enterprisemanagement.com

EMA Research Report: Enterprise Data Center Network Transformation

SDN Choice: Underlays Versus OverlaysEnterprises generally have two classes of SDN technologies available to them in their data centers: hardware underlays in which switches are programmed by a controller or controller-like function and virtual software overlays, which create a layer of abstraction over an existing hardware network. While it is generally assumed that most enterprises will choose one or the other variety of SDN, EMA is aware of anecdotal examples of enterprises that have deployed both an underlay and an overlay in the same environment to address different use cases or administrative requirements.

EMA asked participants in this study which class of SDN technology they have adopted or are planning to adopt in their data centers. Figure 5 reveals some unusual results. Overlays (43%) are most popular, which is not terribly surprising since they are often deployable without a hardware refresh, reducing potential disruption in a data center. One-third (33%) have chosen a hardware underlay. However, nearly one in four (24%) says they use both an overlay and an underlay in the same environment. EMA believes this final statistic is inflated, given that we have only seen anecdotal examples of dual adoption in the market.

43%

33%

24%

A virtual network overlay (e.g., VMware NSX, Nuage Networks)

A hardware underlay with switches programmed by a controller (e.g., Cisco ACI)

We use both a virtual overlay SDN and hardware underlay SDN in the same environment

Figure 5. Class of SDN technology chosen for data center network transformation

More than half (53%) of organizations that told us they are adopting both classes of SDN technology also reported that their data center network transformation initiatives involve four or more data centers. We suspect that many of these individuals misread the question and that they have adopted an overlay in one subset of their data centers and an underlay in another subset of them.

Page 9: EMA Research Report: Enterprise Data Center Network ... · IT DATA MANAGEMENT RESEARCH INDSTRY ANALSIS CNSLTING EMA Research Report: Enterprise Data Center Network Transformation

PAGE 7 ©2017 Enterprise Management Associates, Inc. All Rights Reserved. | www.enterprisemanagement.com

EMA Research Report: Enterprise Data Center Network Transformation

Data Center SDN Use CasesIn this section we review the SDN use cases that are most important to data center network transformation initiatives. Figure 6 reveals that organizations are targeting two primary SDN use cases: network virtualization and disaster recovery. SDN-based network virtualization enables network teams to create multitenant environments, whether those tenants are business units, application development teams, or customers. With SDN network teams can slice up the network logically for each tenant.

46%

44%

29%

26%

26%

13%

0%

Network virtualization - multitenant infrastructure

Disaster recovery - logical network replication

Automated network provisioning

Application-specific network optimization

Network segmentation - microsegmentation

DMZ service chaining

Other

Figure 6. The SDN use cases most important to data center network transformation

SDN also supports disaster recovery by simplifying the process of logically replicating a network to a disaster recovery site. The middling importance of micro-segmentation is somewhat surprising because several SDN vendors identified it as an important initial use case for many early adopters. These numbers suggest that organizations recognize that other use cases may become more important as they mature their SDN implementations.

Page 10: EMA Research Report: Enterprise Data Center Network ... · IT DATA MANAGEMENT RESEARCH INDSTRY ANALSIS CNSLTING EMA Research Report: Enterprise Data Center Network Transformation

PAGE 8 ©2017 Enterprise Management Associates, Inc. All Rights Reserved. | www.enterprisemanagement.com

EMA Research Report: Enterprise Data Center Network Transformation

Data Center SDN ChallengesFigure 7 reveals the top technical challenges of SDN that organizations experience during data center network transformation.

30%

20%

20%

18%

17%

16%

16%

14%

13%

12%

7%

2%

2%

Security risk

Quality of service enforcement is ineffective

Insufficient interoperability with legacy networks

Lack of integration with data center/cloud orchestration tools

Lack of integration with bare-metal server workloads

Insufficient performance of programmable SDN switches

Lack of interoperability or integration with other data center vendors (e.g., Layer 4-7 devices)

Recovery/convergence from failure is too slow

Central controller function is a single point of failure

Central controller function introduces too much latency

Hierarchical control plane doesn't scale

Other

Do not know

Figure 7. The top technical challenges to SDN adoption

“Security risk” stands out as the number one technical challenge today. Enterprises are struggling to understand just how secure SDN solutions are. Ineffective enforcement of quality of service (QoS) and insufficient interoperability with legacy networks are the leading secondary challenges, followed closely by lack of integration with data center and cloud orchestration tools.

Page 11: EMA Research Report: Enterprise Data Center Network ... · IT DATA MANAGEMENT RESEARCH INDSTRY ANALSIS CNSLTING EMA Research Report: Enterprise Data Center Network Transformation

PAGE 9 ©2017 Enterprise Management Associates, Inc. All Rights Reserved. | www.enterprisemanagement.com

EMA Research Report: Enterprise Data Center Network Transformation

Figure 8 details the top business-related challenges of SDN adoption in data center networks. Here organizations are most concerned that their network teams lack sufficient skills and expertise with SDN (32%).

32%

29%

27%

26%

25%

22%

14%

2%

0%

Limited internal SDN skills and expertise

Security team resistance

Too expensive

Lack of adequate vendor support

Network team resistance

Lack of support/buy-in from IT leadership

No compelling use case

Do not know

Other

Figure 8. Top business-related challenges to SDN adoption

The other major business challenge identified was “security team resistance.” The network team is hitting a roadblock with the security team, which makes it even more critical for them to address the technical security issues we highlighted above.

The days of enterprises complaining that they see no compelling use case for SDN appear to be ending, and this issue sits at the bottom of the list of business-related complaints with only 14% of organizations selecting it. “Too expensive,” “lack of adequate vendor support,” “network team resistance,” and “lack of support/buy-in from IT leadership” are all secondary challenges.

Disaggregated Switching Is Common in Network TransformationLike SDN, disaggregated network switching has enjoyed a wave of hype in recent years, but the industry has also reacted with an equal measure of skepticism. Known also as “bare-metal switches” and “white-box switches,” disaggregated switches are an alternative to the fully integrated hardware and software products traditionally offered by network vendors. As the term implies, these solutions disaggregate network hardware from the operating system software that runs on them.

Forty-five percent (45%) of organizations in this study have installed disaggregated network switches. Another 41% said they were considering it.

These numbers are higher than expected, even among this group of 200 enterprises involved in data center network transformation. Keep in mind that we only asked whether organizations had installed the devices. We did not ask them to elaborate on the nature of these installations. Many of them are probably proofs of concept, pilot projects, etc. This finding may be more indicative of enterprises’ willingness to explore disaggregated switching as an option when they are transforming their data center networks.

Page 12: EMA Research Report: Enterprise Data Center Network ... · IT DATA MANAGEMENT RESEARCH INDSTRY ANALSIS CNSLTING EMA Research Report: Enterprise Data Center Network Transformation

PAGE 10 ©2017 Enterprise Management Associates, Inc. All Rights Reserved. | www.enterprisemanagement.com

EMA Research Report: Enterprise Data Center Network Transformation

The Benefits and Challenges of Disaggregated SwitchingWhile cost reduction and technology flexibility are often mentioned as compelling benefits of switch disaggregation, this research reveals that enterprises see a broad set of potential benefits, particularly with the unification of network teams and systems teams. EMA asked all participants in this research, regardless of whether they were currently using them, to identify what they saw as the primary benefits of disaggregated data center switches. Figure 9 reveals that integrating network and server operations is the most anticipated benefit, followed very closely by integration of network provisioning and server provisioning. We observed almost no variation in response between those that had already installed disaggregated switches and those that hadn’t.

35%

32%

31%

30%

28%

26%

3%

0%

Integration of network operations with server operations

Integration of network provisioning with server provisioning

Enhanced customization options

Accelerated software innovation

Reduced capital expenses

Streamlined software feature set

Do not know

Other

Figure 9. Primary perceived benefits of using disaggregated switches in a data center

The other two leading benefits were “enhanced customization” and “accelerated software innovation.” Reduced capital expenses and streamlined software feature sets were the lowest priorities for organizations overall, but even they weren’t that far from the top of the list.

Page 13: EMA Research Report: Enterprise Data Center Network ... · IT DATA MANAGEMENT RESEARCH INDSTRY ANALSIS CNSLTING EMA Research Report: Enterprise Data Center Network Transformation

PAGE 11 ©2017 Enterprise Management Associates, Inc. All Rights Reserved. | www.enterprisemanagement.com

EMA Research Report: Enterprise Data Center Network Transformation

EMA also asked all research participants, regardless of whether their organization had adopted switch disaggregation, to identify the top barriers to installing these systems. Again we saw very little variation in the responses of organizations that had installed network disaggregation and those that hadn’t. Figure 10 shows that risk was the top reported challenge, with 38% saying their security and compliance teams object to switch disaggregation. Second, these organizations were concerned with the divided support model that some of these disaggregated systems introduce.

38%

34%

22%

20%

20%

16%

12%

11%

3%

0%

Risk - Security and/or compliance team objects

Divided support model (i.e., software and hardware vendors have not unified support)

Lack of a business and/or technical case for adoption

Insufficient software features

Network team lacks the required skills and knowledge

Unreliable hardware

Poor software sales/sales engineering experience

Poor hardware sales/sales engineering experience

Do not know

Other

Figure 10. The biggest barriers to adopting disaggregated data center switches

Hardware reliability appears to be a relatively minor issue. And very few were concerned about the sales and sales engineering experience offered by disaggregated software and hardware vendors.

Page 14: EMA Research Report: Enterprise Data Center Network ... · IT DATA MANAGEMENT RESEARCH INDSTRY ANALSIS CNSLTING EMA Research Report: Enterprise Data Center Network Transformation

PAGE 12 ©2017 Enterprise Management Associates, Inc. All Rights Reserved. | www.enterprisemanagement.com

EMA Research Report: Enterprise Data Center Network Transformation

Load Balancing and Application Delivery Controllers As today’s enterprises virtualize their infrastructure and move applications to public and private cloud environments, large ADC appliances no longer fit every use case. Organizations need ADCs that are flexible, lightweight, capable of migrating with workloads, and integrated with orchestration frameworks. As a result, many organizations are virtualizing load balancers and ADCs.

Figure 11 shows that 70% of data center network transformation projects lead to the virtualization of ADCs and load balancers.

Yes70%

No22%

Do not know8%

Figure 11. Responses to the question: As part of your data center network transformation, are you virtualizing application delivery controllers (ADCs) and/or load balancers?

To understand how extensive ADC virtualization is in these organizations, EMA asked respondents to estimate what percentage of their workloads would be served by virtual ADCs after their data center network transformation initiatives were complete. These organizations reported an average of 58% of their application workloads ultimately being served by virtual ADCs.

Page 15: EMA Research Report: Enterprise Data Center Network ... · IT DATA MANAGEMENT RESEARCH INDSTRY ANALSIS CNSLTING EMA Research Report: Enterprise Data Center Network Transformation

PAGE 13 ©2017 Enterprise Management Associates, Inc. All Rights Reserved. | www.enterprisemanagement.com

EMA Research Report: Enterprise Data Center Network Transformation

The transition from ADC appliances to virtual ADCs will naturally present some difficulty. Figure 12 reveals that enterprises struggle primarily with three issues during these transitions. Their most pressing problem is that their virtual ADCs are incompatible with their cloud or network orchestration tools (42%). This finding suggests that their chosen vendors have inadequate plugins for SDN frameworks or OpenStack and comparable cloud software platforms.

42%

33%

32%

24%

18%

16%

6%

2%

Cloud or network orchestration incompatibility

License management complexity

Service chaining complexity

Hypervisor incompatibility

No deterministic hardware performance

No software feature parity with hardware

Do not know

Other

Figure 12.Top challenges to successful virtualization of ADCs and load balancers

License management complexity (32%) is also a significant challenge. ADC vendors vary in how they license virtual ADCs. Also, many offer native platform management systems designed to manage licenses for hardware appliances. Many ADC vendors are still evolving their licensing models and license management capabilities to be friendlier to a virtual world.

Finally, service chaining complexity is also a major problem. Virtual ADCs offer the flexibility to apply very specialized ADC instances to applications. One application might need Layer 7 load balancing and another might only need Layer 4 load balancing. One might need SSL acceleration and the other will need SSL offloading. Where should a data center operator apply all these application-specific service chains? Enterprises will need guidance with this issue.

Hypervisor incompatibility is a problem for nearly one-quarter of organizations surveyed. However, this problem will probably fade over time as ADC vendors expand the number of hypervisors they support. Finally, the two issues that network engineers may have fretted about when organizations first started virtualizing ADCs seem to actually be minor problems in practice. Very few organizations reported struggling with a lack of deterministic hardware performance, and even fewer said that they lack software feature parity with hardware ADCs.

Page 16: EMA Research Report: Enterprise Data Center Network ... · IT DATA MANAGEMENT RESEARCH INDSTRY ANALSIS CNSLTING EMA Research Report: Enterprise Data Center Network Transformation

PAGE 14 ©2017 Enterprise Management Associates, Inc. All Rights Reserved. | www.enterprisemanagement.com

EMA Research Report: Enterprise Data Center Network Transformation

The Ideal ADC for the Transformed Data CenterFigure 13 charts the importance of ADC product features in relation to data center network transformation. Traditional load balancing (Layer 4 and Layer 7 load balancing and round robin) are the least important ADC features in these data centers. Instead, the top features for these organizations are integrated security (web application firewalls, denial of service protection), identity and access management, data compression, SSL acceleration, and global load balancing.

65% 63% 61% 57% 57% 55% 55% 51% 51% 50% 49% 49% 45% 37% 32%

32% 33% 35% 37% 37% 39% 43% 43% 46% 45% 45% 46% 48%55%

53%

3% 4% 4% 6% 6% 6% 3% 6% 3% 6% 6% 5% 7% 8% 16%

Must have/critical Nice to have Not important

Figure 13. The relative importance of ADC product features

A majority of research participants also identified application acceleration, content routing, core protocol optimization and control plane programmability as critical features. Data plane programmability was slightly less important.

Page 17: EMA Research Report: Enterprise Data Center Network ... · IT DATA MANAGEMENT RESEARCH INDSTRY ANALSIS CNSLTING EMA Research Report: Enterprise Data Center Network Transformation

PAGE 15 ©2017 Enterprise Management Associates, Inc. All Rights Reserved. | www.enterprisemanagement.com

EMA Research Report: Enterprise Data Center Network Transformation

Figure 14 reveals that scalability is top of mind for most organizations. Of course, scalability takes on a different meaning when so many organizations are leveraging virtual ADCs. Vendors need to provide products that can scale in software rather than hardware. And that leads to the second most important product characteristic: resource efficiency. Network teams want ADCs with feature sets that are tuned to specific application requirements. This reduces the amount of resources a virtual ADC will consume on a hypervisor host. It may also affect the scalability of individual ADC instances and the license cost.

34%

27%

22%

22%

21%

20%

17%

14%

4%

0%

Scalability

Resource efficiency - narrow feature set tuned to application requirements

Integration with orchestration frameworks (e.g., OpenStack)

Programmability - data path scripting and automation capabilities

Integration/capability with public cloud environments

Per-application services - instances that support distributed application architectures

Layer 4-7 traffic analytics

Container services integration (e.g., Docker, Kubernetes)

Do not know

Other

Figure 14. ADC characteristics most important to data center network transformation

Page 18: EMA Research Report: Enterprise Data Center Network ... · IT DATA MANAGEMENT RESEARCH INDSTRY ANALSIS CNSLTING EMA Research Report: Enterprise Data Center Network Transformation

PAGE 16 ©2017 Enterprise Management Associates, Inc. All Rights Reserved. | www.enterprisemanagement.com

EMA Research Report: Enterprise Data Center Network Transformation

Transforming Data Center Network Engineering and Operations Automating the Data Center NetworkAutomation is an essential piece of data center network transformation. This research found that 98% of organizations automate at least one aspect of their data center networks as a result of these projects. In fact, the average transformative network team automates three aspects of their network. Figure 15 reveals that network security is a major automation priority. The majority of organizations in this research were automating security incident detection and, to a slightly lesser extent, security incident response.

66%

59%

46%

44%

43%

40%

2%

Security incident detection

Security incident response

Fault and performance detection

Service Orchestration (e.g., change ticket response, cross-domain orchestration)

Provisioning and deployment

Fault and performance remediation

None of the above

Figure 15. Aspects of data center networking automated by transformation projects

All other networking tasks are secondary targets for automation, with “fault and performance detection” being the most popular and “fault and performance remediation” the least popular.

Page 19: EMA Research Report: Enterprise Data Center Network ... · IT DATA MANAGEMENT RESEARCH INDSTRY ANALSIS CNSLTING EMA Research Report: Enterprise Data Center Network Transformation

PAGE 17 ©2017 Enterprise Management Associates, Inc. All Rights Reserved. | www.enterprisemanagement.com

EMA Research Report: Enterprise Data Center Network Transformation

Figure 16 reveals the technologies that organizations use to automate their transformed data center networks. “IT automation/ DevOps software” was the most popular class of tools. This finding is somewhat surprising given that research participants identified DevOps as the second least influential technology initiative driving data center network transformation decisions. While DevOps isn’t driving network transformation it is certainly facilitating it. Network teams identify DevOps and IT automation tools as an important means of network automation for these projects.

55%

46%

40%

37%

33%

32%

31%

27%

IT automation/DevOps software (e.g., Puppet, Ansible)

SDN solutions (e.g., Cisco ACI, VMware NSX, OpenDaylight-based solutions)

Cloud orchestration software other than OpenStack

Third-party network automation software (excluding network change and configuration management)

Open source technology (e.g., NAPALM)

Homegrown scripts

Internally developed network automation software

OpenStack Neutron

Figure 16. Technologies used to automate data center networks

SDN is the second most popular technology for automating networks.

Overall, OpenStack Neutron is the least popular option for network automation among these enterprises, cloud orchestration software other than OpenStack is a popular secondary choice automation, which suggests that many enterprises prefer commercial software to open source. Third-party network automation software is another popular automation tool.

Page 20: EMA Research Report: Enterprise Data Center Network ... · IT DATA MANAGEMENT RESEARCH INDSTRY ANALSIS CNSLTING EMA Research Report: Enterprise Data Center Network Transformation

PAGE 18 ©2017 Enterprise Management Associates, Inc. All Rights Reserved. | www.enterprisemanagement.com

EMA Research Report: Enterprise Data Center Network Transformation

Network Managers Want More From Their Hardware VendorsOpen APIs on Data Center SwitchesIn this research, 55% of organizations required their vendors to provide open APIs for infrastructure programmability on data center switches, and 38% said they don’t require them but they are nice to have (see Figure 17). Only 3% said they had no need for such APIs.

55%38%

3% 4%

Yes

No, but it's nice to have

No, we don't need APIs

Do not know

Figure 17. Respondents were asked, “Do you require your vendors to provide open APIs on data center switches to enable infrastructure programmability?”

Although open APIs are becoming a standard requirement in these data centers, CLI, the traditional means of writing changes to and extracting data from network hardware, isn’t going away. Eighty-two percent (82%) of organizations that require APIs or say they are nice to have intend to maintain both API and CLI access on their switches.

Figure 18 reveals that security is a major driver for open APIs in the transformed data center network. Network teams are leveraging these interfaces to integrate network switches with their security architecture. For instance, this integration could enable switches to act as network security sensors or control points.

61%

50%

46%

44%

43%

43%

Security - integration with security architecture

DevOps - integration with IT automation and infrastructure-as-code tools (Saltstack, Ansible, Puppet, etc.)

Data collection for availability and performance monitoring

Programmatic device provisioning and configuration

Improved access to CLI

Troubleshooting automation

Figure 18. How organizations use open APIs on data center switches

Page 21: EMA Research Report: Enterprise Data Center Network ... · IT DATA MANAGEMENT RESEARCH INDSTRY ANALSIS CNSLTING EMA Research Report: Enterprise Data Center Network Transformation

PAGE 19 ©2017 Enterprise Management Associates, Inc. All Rights Reserved. | www.enterprisemanagement.com

EMA Research Report: Enterprise Data Center Network Transformation

The Rise of Streaming Network TelemetryStreaming network telemetry is a concept in which network devices can stream data about the network continuously and efficiently to network management systems.

This research found that streaming telemetry will be critical to data center network transformation. More than half of the enterprises represented are streaming telemetry from their network devices today, as shown in Figure 19. Nearly all the others were planning to use streaming telemetry in the future.

53%42%

4%

Using today

Planning to use in the future

No plans

Figure 19. Most transformed data center networks use streaming telemetry from their network devices today.

EMA believes that streaming telemetry will be an essential technology for SDN in the future. Efficient and continuous network telemetry streams can combine with the programmatic control enabled by SDN to give network managers the ability to manage their networks more effectively.

The most important use cases for streaming telemetry technology are security related, as Figure 20 reveals. More than one-third of organizations that were using or planning to use streaming telemetry reported applying it to enhanced security monitoring and automated security response.

36%

35%

30%

29%

29%

25%

0%

Enhanced security monitoring

Automated security response

Infrastructure optimization

Network problem detection

Automated network problem remediation

Change control management

Other

Figure 20. Most important use cases for embedded streaming telemetry and analytics

Page 22: EMA Research Report: Enterprise Data Center Network ... · IT DATA MANAGEMENT RESEARCH INDSTRY ANALSIS CNSLTING EMA Research Report: Enterprise Data Center Network Transformation

PAGE 20 ©2017 Enterprise Management Associates, Inc. All Rights Reserved. | www.enterprisemanagement.com

EMA Research Report: Enterprise Data Center Network Transformation

Organizational Factors of Data Center Network TransformationNetworking Life in the Transformed Data CenterNetwork Team Skills for the New Data Center NetworkData center network transformation will require network teams to acquire a diverse set of skills. Cloud expertise is a major need, as Figure 21 reveals. Cloud software such as OpenStack is the top training priority, but not far down the list is expertise with public cloud environments like Amazon Web Services and Microsoft Azure. Server virtualization and cybersecurity round out the top four training priorities.

54%

47%

46%

44%

39%

36%

34%

34%

26%

18%

0%

Cloud software (e.g. OpenStack)

Server virtualization

Cybersecurity

Public cloud environments (Amazon Web Services, Microsoft Azure)

Software engineering (e.g. software planning and design)

Programming (e.g. Java, Python)

DevOps concepts and tools

Soft skills (e.g. interpersonal, business communication)

Process expertise (e.g. ITIL)

Linux expertise

Other

Figure 21. Data center network transformation requires network professionals to require these new skills and knowledge

Secondarily, many networking pros are learning software engineering, programming, and DevOps concepts and tools. Equally important are so-called soft skills (interpersonal skills, business communication, etc.). Process expertise (e.g. ITIL) and Linux skills are low priorities.

Page 23: EMA Research Report: Enterprise Data Center Network ... · IT DATA MANAGEMENT RESEARCH INDSTRY ANALSIS CNSLTING EMA Research Report: Enterprise Data Center Network Transformation

PAGE 21 ©2017 Enterprise Management Associates, Inc. All Rights Reserved. | www.enterprisemanagement.com

EMA Research Report: Enterprise Data Center Network Transformation

Removing CLI From Network Engineering and OperationsFigure 22 shows that 82% of network teams represented in this study were using programmatic tools and interfaces like REST APIs to reduce their reliance on CLI workflows for network management.

Yes82%

No10%

Do not know8%

Figure 22. Research participants were asked, “Does your data center networking team use programmatic tools and interfaces such as REST APIs to reduce reliance on CLI for network device configuration and management?”

Page 24: EMA Research Report: Enterprise Data Center Network ... · IT DATA MANAGEMENT RESEARCH INDSTRY ANALSIS CNSLTING EMA Research Report: Enterprise Data Center Network Transformation

PAGE 22 ©2017 Enterprise Management Associates, Inc. All Rights Reserved. | www.enterprisemanagement.com

EMA Research Report: Enterprise Data Center Network Transformation

The primary driver for reducing CLI use in the data center network is increased network agility, as Figure 23 shows. To truly realize the benefits of technologies like SDN and network automation software, the networking team needs to spend less time on CLI and more time with programmatic tools. Nearly one-third of respondents chose agility as their number one driver.

31%

20%

18%

17%

7%

7%

0%

Increase network agility

Reduce risk

Reduce operational expenses

Enable intent-based networking (i.e., translation of business logic to network design and policy creation)

Reduce network team headcount

Address shortage of network skills

Other

Figure 23. Research participants identified their primary business driver for reducing reliance on CLI

Risk reduction is the second most popular driver. CLI is by its very nature a manual process, which opens opportunities for mistakes. Programmatic tools remove many of those opportunities for error. In a near tie with risk reduction is operational expense reduction. The less time networking pros spend on CLI, the more time they have for more productive tasks.

The fourth most popular driver is enablement of intent-based networking, a relatively new concept being promulgated by several incumbent networking vendors and emerging startups. Definitions vary from vendor to vendor, but simply put, intent-based networking involves the translation of business logic to administrative and engineering tasks like network design, policy creation, and change controls. Programmatic tools are emerging that allow a network administrator to express intent directly on a graphical user interface, such as “only users in the accounting department can access financial management applications” or “this critical application must have a top QoS priority.” An intent-based network interface will then reconfigure the entire network to facilitate that expressed intent.

The primary driver for reducing CLI use in the data center network is increased network agility

Page 25: EMA Research Report: Enterprise Data Center Network ... · IT DATA MANAGEMENT RESEARCH INDSTRY ANALSIS CNSLTING EMA Research Report: Enterprise Data Center Network Transformation

PAGE 23 ©2017 Enterprise Management Associates, Inc. All Rights Reserved. | www.enterprisemanagement.com

EMA Research Report: Enterprise Data Center Network Transformation

ConclusionWith this research, EMA wanted to identify how forward-thinking IT organizations are reinventing the data center network. Our snapshot view of 200 data center network transformation initiatives gives us a look at what the future holds. There is a path toward success, and it is likely to involve some combination of leaf-and-spine fabrics, SDN, ADC virtualization, and, for some, switch disaggregation.

The future data center network will also require network automation technologies, open APIs on devices, streaming telemetry technologies, and much more. Finally, the networking team must develop a new set of skills to complement the valuable expertise they already have. That new skillset begins with private and public cloud expertise, but it may also require cybersecurity skills, software engineering, and much more. This report should serve as an early guide to IT leaders who are preparing for their own network transformation journey. EMA will continue to conduct research in this area, so keep an eye on our research libarary.

Page 26: EMA Research Report: Enterprise Data Center Network ... · IT DATA MANAGEMENT RESEARCH INDSTRY ANALSIS CNSLTING EMA Research Report: Enterprise Data Center Network Transformation

PAGE 24 ©2017 Enterprise Management Associates, Inc. All Rights Reserved. | www.enterprisemanagement.com

EMA Research Report: Enterprise Data Center Network Transformation

Demographics

22%

7%

35%

34%

2%

0%

0%

0%

CIO/CTO (IT executive management)

Vice president (or equivalent)

Director (or equivalent)

Manager

Professional - specialist/subject matter expert

Professional - administrator or other staff

Other

None, I don't work in IT

Figure A. Respondents’ roles in their IT organizations

33%

4%

8%

8%

12%

16%

4%

9%

2%

0%

2%

2%

IT executive suite (CIO, CTO, VP)

Application development

Application management

IT planning/design/engineering/architecture

IT asset management/financial management/IT business analysis

IT project/program management

IT operations - network operations center (NOC)

IT operations - data center

IT service desk/service support/help desk

Cross-domain support organization for IT

IT security/cybersecurity

Other

Figure B. Respondents’ groups within IT

0%

14%

26%

24%

14%

24%

Fewer than 999

1,000 - 2,499

2,500 - 4,999

5,000 - 9,999

10,000 - 19,999

20,000 or more

Figure C. Number of employees worldwide in company

Page 27: EMA Research Report: Enterprise Data Center Network ... · IT DATA MANAGEMENT RESEARCH INDSTRY ANALSIS CNSLTING EMA Research Report: Enterprise Data Center Network Transformation

PAGE 25 ©2017 Enterprise Management Associates, Inc. All Rights Reserved. | www.enterprisemanagement.com

EMA Research Report: Enterprise Data Center Network Transformation

1%

2%

2%

5%

16%

2%

5%

15%

0%

4%

0%

0%

6%

2%

16%

0%

0%

0%

2%

4%

4%

6%

3%

2%

1%

1%

Aerospace/Defense

Consulting - Computer or Networking Related

Consulting - Not Computer or Networking Related

Education

Finance/Banking/Insurance

Government

Healthcare/Medical/Pharmaceutical

High Technology - Software

High Technology - Reseller/VAR/Systems Integrator

High Technology - Application/Cloud/Managed Service Provider

High Technology - Internet/Network Service Provider/Mobile Carrier

Hospitality/Entertainment/Recreation/Travel

Legal

Manufacturing - Computer Hardware or Networking Related

Manufacturing - Not Computer Hardware or Networking Related

Marketing/Advertising/PR Agency/Market Research

Media/Publishing/Broadcasting

Non-Profit/Not-for-Profit

Oil/Gas/Chemicals

Professional Services - Computer or Networking Related

Professional Services - Not Computer or Networking Related

Retail/Wholesale/Distribution

Telecommunications

Transportation/Airlines/Trucking/Rail

Utilities/Energy

Other

Figure D. Primary industry of company

98%

0%

2%

0%

0%

North America

Central & South America (Latin America)

Europe-Middle East-Africa (EMEA)

Asia-Pacific (APAC)

Rest of world

Figure E. Location of company headquarters

Page 28: EMA Research Report: Enterprise Data Center Network ... · IT DATA MANAGEMENT RESEARCH INDSTRY ANALSIS CNSLTING EMA Research Report: Enterprise Data Center Network Transformation

PAGE 26 ©2017 Enterprise Management Associates, Inc. All Rights Reserved. | www.enterprisemanagement.com

EMA Research Report: Enterprise Data Center Network Transformation

100%

0%

0%

0%

0%

North America

Central & South America (Latin America)

Europe-Middle East-Africa (EMEA)

Asia-Pacific (APAC)

Rest of world

Figure F. Respondents’ geographic location

4%

20%

33%

40%

2%

1%

Less than $100 million

$100 million to less than $500 million

$500 million to less than $1 billion

$1 billion or more

Not applicable, I work for a government or non-profit agency

Do not know

Figure G. Organizations’ annual revenues

4%

16%

16%

17%

14%

18%

12%

3%

Less than $5 million

$5 million to less than $10 million

$10 million to less than $25 million

$25 million to less than $50 million

$50 million to less than $100 million

$100 million to $250 million

More than $250 million

Do not know

Figure H. Organizations’ annual IT budgets

Page 29: EMA Research Report: Enterprise Data Center Network ... · IT DATA MANAGEMENT RESEARCH INDSTRY ANALSIS CNSLTING EMA Research Report: Enterprise Data Center Network Transformation

About Enterprise Management Associates, Inc.Founded in 1996, Enterprise Management Associates (EMA) is a leading industry analyst firm that provides deep insight across the full spectrum of IT and data management technologies. EMA analysts leverage a unique combination of practical experience, insight into industry best practices, and in-depth knowledge of current and planned vendor solutions to help EMA’s clients achieve their goals. Learn more about EMA research, analysis, and consulting services for enterprise line of business users, IT professionals, and IT vendors at www.enterprisemanagement.com or blogs.enterprisemanagement.com. You can also follow EMA on Twitter, Facebook, or LinkedIn.

This report in whole or in part may not be duplicated, reproduced, stored in a retrieval system or retransmitted without prior written permission of Enterprise Management Associates, Inc. All opinions and estimates herein constitute our judgement as of this date and are subject to change without notice. Product names mentioned herein may be trademarks and/or registered trademarks of their respective companies. “EMA” and “Enterprise Management Associates” are trademarks of Enterprise Management Associates, Inc. in the United States and other countries.

©2017 Enterprise Management Associates, Inc. All Rights Reserved. EMA™, ENTERPRISE MANAGEMENT ASSOCIATES®, and the mobius symbol are registered trademarks or common-law trademarks of Enterprise Management Associates, Inc.

Corporate Headquarters: 1995 North 57th Court, Suite 120 Boulder, CO 80301 Phone: +1 303.543.9500 Fax: +1 303.543.7687 www.enterprisemanagement.com3621-Pluribus-SUMMARY.100617