View
1
Download
0
Category
Preview:
Citation preview
Summary Results • May 2016
Trends in DevOps, Continuous Delivery
and Application Release Automation
Summary Results • May 2016
Program Overview
Between February and March 2016, Gatepoint Research invited selected IT executives to participate in a survey themed Trends in DevOps, Continuous Delivery & Application Release Automation.
Candidates were invited via email and 146 executives have participated to date.
Management levels represented are predominantly senior decision makers: 5% hold the title CxO, 8% are VPs, 60% are Directors, and 27% are Managers.
Survey participants represent firms from a wide variety of industries financial services, business services, high tech manufacturing, telecom services, general manufacturing, wholesale trade , and media.
81% of survey responders work in Fortune 1000 companies with revenues over $1.5 billion; – 9% work in Large firms whose revenues are between $500 million and $1.5 billion; – 10% work in Small to Mid-Market firms with less than $250 million to $500 million
in revenues.
100% of responders participated voluntarily; none were engaged using telemarketing.
Summary Results • May 2016
Observations and Conclusions
Production application releases are ongoing. Over half of survey respondents (51%) report the frequency of their production application release schedule is weekly - or less. And they usually encounter challenges. 69% of respondents say they run into problems with production application releases occasionally to frequently.
Sticking points: complexity, environment differences. Respondents encounter production problems when the process involves complex dependencies and workflows (61%) or when processes move from development to production (53%).
Missed release dates are fairly common. Although 14% of those surveyed boast that they “never” miss release dates, 36% report missing them occasionally to frequently. There’s a lack of deployment continuity. Asked if development, QA, and production deployments are performed the same way, 37% of respondents said “No.”
Production deployment requests: not an automated process. Only 12% of respondents report their handling of production deployment requests is automated. 17% of those surveyed say it is a manual process.
Release stabilization time is a wide window. 27% of respondents claim that their application releases achieve production stability within minutes. But for the other 72%, production stability takes hours, days, weeks… even months.
Wish List: Reduce delivery time, increase quality, reduce errors. Asked to rate the impact that improving various aspects of software development would have on their business, reducing change delivery time, increasing quality, and reducing errors virtually tie for first place
Big changes are coming soon. Over 40% of those surveyed report they intend to implement initiatives in DevOps, Continuous Integration, and Deployment/App Release Automation within the next six months.
Summary Results • May 2016Copyright © 2015 Gatepoint Research. All rights reserved. The information contained in this report is the sole property of Gatepoint Research and may not be
used, reproduced, redistributed in any form including, but not limited to, print and digital form without the express written consent of Gatepoint Research.
How often do you perform production application releases?
Production application releases are ongoing. Over half of survey respondents (51%) report the frequency of their production application release schedule is
weekly - or less.
27%
24%
27%
14%
4% 4%
0%
5%
10%
15%
20%
25%
30%
More than once aweek
Weekly Monthly Quarterly Yearly N/A
Summary Results • May 2016Copyright © 2015 Gatepoint Research. All rights reserved. The information contained in this report is the sole property of Gatepoint Research and may not be
used, reproduced, redistributed in any form including, but not limited to, print and digital form without the express written consent of Gatepoint Research.
How often do you have challenges with production application releases?
Production application releases usually encounter challenges. 69% of respondents say they run into problems with production application releases
occasionally to frequently.
5%
27%
51%
17%
1%0%
10%
20%
30%
40%
50%
60%
Never Rarely Occasionally Frequently Not sure
Summary Results • May 2016Copyright © 2015 Gatepoint Research. All rights reserved. The information contained in this report is the sole property of Gatepoint Research and may not be
used, reproduced, redistributed in any form including, but not limited to, print and digital form without the express written consent of Gatepoint Research.
What are the top challenges with production application releases?
Sticking points: complexity, environment differences. Respondents encounter production problems when the process involves complex dependencies and
workflows (61%) or when processes move from development to production (53%).
61%
53%
49%
34%
19%
13%
5%
0% 10% 20% 30% 40% 50% 60% 70%
Complex application dependenciesand workflows
Environment differences, e.g., it worked inDevelopment but not in Production
Manual, error-prone steps
Troubleshooting deployment failures
Security compliance
Logging and audit requirements
Other
Summary Results • May 2016Copyright © 2015 Gatepoint Research. All rights reserved. The information contained in this report is the sole property of Gatepoint Research and may not be
used, reproduced, redistributed in any form including, but not limited to, print and digital form without the express written consent of Gatepoint Research.
How often do you miss production application release dates?
Missed release dates are fairly common. Although 14% of those surveyed boast that
they “Never” miss release dates, 36% report missing them occasionally to frequently.
14%
50%
30%
3% 3%0%
10%
20%
30%
40%
50%
60%
Never Rarely Occasionally Frequently Not sure
Summary Results • May 2016Copyright © 2015 Gatepoint Research. All rights reserved. The information contained in this report is the sole property of Gatepoint Research and may not be
used, reproduced, redistributed in any form including, but not limited to, print and digital form without the express written consent of Gatepoint Research.
Are all of your deployments to development, quality assurance testing
and production performed the same way?
Lack of deployment continuity. Asked if development, QA, and production
deployments are performed the same way, 37% of respondents said “No.”
Yes63%
No37%
Summary Results • May 2016Copyright © 2015 Gatepoint Research. All rights reserved. The information contained in this report is the sole property of Gatepoint Research and may not be
used, reproduced, redistributed in any form including, but not limited to, print and digital form without the express written consent of Gatepoint Research.
How are production deployment requests handled?
Production deployment requests: not an automated process. Only 11% of respondents report handling production deployment requests automatically. 17% of
those surveyed say it is a totally manual process.
Mostly manual17%
Mostly automated26%
Both manual and automated
46%
Fully automated with optional
approval gates11%
Summary Results • May 2016Copyright © 2015 Gatepoint Research. All rights reserved. The information contained in this report is the sole property of Gatepoint Research and may not be
used, reproduced, redistributed in any form including, but not limited to, print and digital form without the express written consent of Gatepoint Research.
How long do releases generally take before they are stable in production?
Release stabilization is a wide window. 27% of respondents claim that their application releases achieve production stability within minutes. But for the other
72%, production stability takes hours, days, weeks… even months.
27%
44%
20%
6%3%
0%
5%
10%
15%
20%
25%
30%
35%
40%
45%
50%
Minutes Hours Days Weeks Months
Summary Results • May 2016Copyright © 2015 Gatepoint Research. All rights reserved. The information contained in this report is the sole property of Gatepoint Research and may not be
used, reproduced, redistributed in any form including, but not limited to, print and digital form without the express written consent of Gatepoint Research.
Which of the following software development aspects, if addressed,
would have a significant impact to your business?
Wish List: Reduce delivery time, increase quality, reduce errors. Asked to rate the impact that improving various aspects of software development would have on their business, reducing change
delivery time, increasing quality, and reducing errors virtually tie for first place.
55%
53%
51%
27%
25%
24%
0% 10% 20% 30% 40% 50% 60%
Reducing the time to deliver change
Increase release quality
Reduce deployment errors
Reduce cost of application delivery
Address audit, security and compliance issues
Increase utilization ofexisting infrastructure
Summary Results • May 2016Copyright © 2015 Gatepoint Research. All rights reserved. The information contained in this report is the sole property of Gatepoint Research and may not be
used, reproduced, redistributed in any form including, but not limited to, print and digital form without the express written consent of Gatepoint Research.
Please indicate the time frame in which you plan
to implement the following initiatives.
Big changes are coming soon. More than 40% of those surveyed report they intend to implement initiatives in DevOps, Continuous Integration, and
Deployment/App Release Automation within the next six months.
DevOps
Continuous Integration
Deployment/Application Release Automation
43%
14%
10%
29%
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50%
0 to 6 months
7 to 12 months
13+ months
No plans
42%
16%
8%
33%
0% 5% 10% 15% 20% 25% 30% 35% 40% 45%
0 to 6 months
7 to 12 months
13+ months
No plans
42%
18%
11%
23%
0% 5% 10% 15% 20% 25% 30% 35% 40% 45%
0 to 6 months
7 to 12 months
13+ months
No plans
Summary Results • May 2016Copyright © 2015 Gatepoint Research. All rights reserved. The information contained in this report is the sole property of Gatepoint Research and may not be
used, reproduced, redistributed in any form including, but not limited to, print and digital form without the express written consent of Gatepoint Research.
Profile of Responders:
Industry Sectors
Responders work in a range of industry sectors.
Financial Services42%
Business Services27%
Mfg - High Tech16%
Telecom Services
7%
Mfg - General3%
Wholesale Trade3%
Media2%
Summary Results • May 2016Copyright © 2015 Gatepoint Research. All rights reserved. The information contained in this report is the sole property of Gatepoint Research and may not be
used, reproduced, redistributed in any form including, but not limited to, print and digital form without the express written consent of Gatepoint Research.
Profile of Responders:
Revenue
81% of responders work in Fortune 1000 companies
with annual revenues over $1.5 billion.
>$1.5billion81%
$500 million -
$1.5 billion
9% $250 - 500 million7%
<$250 million3%
Summary Results • May 2016Copyright © 2015 Gatepoint Research. All rights reserved. The information contained in this report is the sole property of Gatepoint Research and may not be
used, reproduced, redistributed in any form including, but not limited to, print and digital form without the express written consent of Gatepoint Research.
Profile of Responders:
Job Level
73% of responders hold executive level positions in their organizations.
Manager, 27%
Director, 60%
VP, 8%
CxO, 5%
Summary Results • May 2016
Electric Cloud is the leader in DevOps Release Automation. We help
organizations developing enterprise web/IT, mobile, and embedded
systems applications deliver better software faster by automating and
accelerating build, deployment, and release processes at scale. Leading
organizations like Cisco, E*TRADE, Gap, GE, HP, Intel, Lockheed Martin,
Sony and Qualcomm use Electric Cloud solutions and services to boost
DevOps productivity and Agile throughput, while providing a scalable,
auditable, predictable, and high-performance pathway to production.
Recommended