Extreme Automation: Software Quality for the Next Generation Enterprise

  • Published on
    19-Jun-2015

  • View
    252

  • Download
    0

DESCRIPTION

Software runs the business. The modern testing organization aspires to be a change agent and an inspiration for quality throughout the entire lifecycle. To be a change agent, the testing organization must have the right people and skill sets, the right processes in place to ensure proper governance, and the right technology to aid in the delivery of software in support of the business line. Traditionally, testing organizations have focused on the people and process aspect of solving quality issues. With the ever-increasing complexity of the software needed to run the enterprise, testing professionals must adopt technology to help solve some of the most challenging quality issues ever. In short, testing organizations must make the move to extreme automation and become proficient with modern tooling and its benefits. Theresa Lanowitz focuses on new and emerging technologiesproven and successfulto add to the workbench of the test professional.

Transcript

  • 1. K4 Keynote 5/8/2014 8:30:00 AM Extreme Automation: Software Quality for the Next Generation Enterprise Presented by: Theresa Lanowitz voke, inc. Brought to you by: 340 Corporate Way, Suite 300, Orange Park, FL 32073 888-268-8770 904-278-0524 sqeinfo@sqe.com www.sqe.com

2. Theresa Lanowitz voke, inc. Founder of voke, inc. Theresa Lanowitz is recognized as a strategic thinker in the application lifecycle, virtualization, cloud computing, and convergence markets. From 19992006 Theresa was a research analyst with Gartner where she pioneered the application quality ecosystem, championed the application security space, and identified new and emerging companies to watch. At Gartner, she was the founder and chairperson of the highly successful Application Development conference. Theresas professional career began with McDonnell Douglas where she worked on the C-17 transport plane. At Borland Software, Theresa shipped the Java development tool JBuilder. At Sun Microsystems, she was responsible for the strategic marketing of the Jini project. 3. 4/29/2014 1 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. Software Quality for the Next Generation Enterprise Theresa Lanowitz, voke Founder STAREAST | Orlando, FL | 8 May, 2014 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. Agenda About voke Global Trends Next Generation Enterprise Extreme Automation - Lifecycle Virtualization - Development Testing - Mobility Embracing Extreme Automation Net/Net 4. 4/29/2014 2 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. About voke 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. About voke Independent industry analyst firm Founded in 2006 by Theresa Lanowitz Firm focuses on the application lifecycle and its transformation including virtualization, cloud computing, embedded systems, mobile and device software Provides strategic, independent, and impartial advice and market observations through quantitative and qualitative research 5. 4/29/2014 3 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. Global Trends 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. Current Reality 6. 4/29/2014 4 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. Goldman Sachs August 20, 2013 An internal system that Goldman Sachs uses to help prepare in meeting market demand for equity options inadvertently produced orders with inaccurate price limits and sent them to exchanges. Goldman Sachs placed four senior technology specialists on administrative leave after a programming error caused the investment bank to send faulty stock-options orders. 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. NASDAQ August 22, 2013 A computer malfunction froze thousands of securities listed on the Nasdaq Stock Market for three hours. Many of the countrys most-traded shares ground to a standstill as brokers were unable to execute orders. 7. 4/29/2014 5 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. Standard & Poors Warning September 20, 2013 A rash of electronic breakdowns could trigger cuts in credit ratings for stock exchanges, warns ratings agency Standard & Poors. The ratings agency expects exchanges to maintain enough liquid capital to cover unexpected losses caused by electronic disruptions. 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. More Software Failures Daily 8. 4/29/2014 6 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. Why Are Software Failures Making Headlines? Economy - Lack of investment during Global Financial Crisis (GFC) Faster, faster, faster - Faster is not equal to better Old technology - Most organizations are not up to date on current software platforms - Most organizations are not leveraging the power of modern solutions 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. YouTube reported a peak of more than 8 million concurrent livestreams of Felix Baumgartners 24-mile/38.6 km fall to Earth. Red Bull Stratos & YouTube October 14, 2012 9. 4/29/2014 7 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. Next Generation Enterprise 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. 10. 4/29/2014 8 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. 11. 4/29/2014 9 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. Parity A Basic Requirement 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. Testing Roadmap Critical for Business Success Chaos Establish Testing Role Dev and Testing Parity IT & Business Alignment Change Agent 12. 4/29/2014 10 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. Next Generation Enterprise 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. Extreme Automation 13. 4/29/2014 11 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. The concept of leveraging modern tools to break through barriers and overcome historic challenges to mitigate risk and manage complexity throughout the software supply chain. Source: voke February 2014 Extreme Automation Definition 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. Factors Driving Extreme Automation Need 1. Composite applications 2. Software supply chain 3. Consumerization of IT 4. Demand for quality 5. Mobile 6. Cloud 7. Competitive business differentiation through software Source: voke February 2014 14. 4/29/2014 12 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. Classic Challenge Deliver All Three Cost Quality Schedule 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. People, Process, Technology Building Blocks People Process Technology Internal skills Trusted partners and providers Customer advocate Relationship manager Process designation Communication Collaboration Optimized Testing platform ? 15. 4/29/2014 13 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. Minimize Risk Move to Extreme Automation How Development Ensures Working Software Technology Companies Enterprise Companies Continuous Integration 61% 47% Code reviews 60% 64% Automated unit tests 63% 38% Manual unit tests 46% 56% Automated functional testing 51% 40% Manual functional testing 59% 64% Performance testing 58% 42% Source code analysis tools used 29% 11% Code refactoring 39% 20% Database refactoring 20% 9% Design patterns 21% 16% Domain-driven design 14% 4% Source: voke Market SnapshotTM Report: Agile Realities July 11, 2012 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. Lifecycle Virtualization 16. 4/29/2014 14 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. Server Desktop Lifecycle (Service and Lab) Market Adoption Phase Mature Trending Evolving Technology Phase Stable and full featured Stable with emerging features Stable and evolving Primary Users Data center Service center Dev, test, and operations Vendors VMware, Microsoft, Citrix Citrix, Microsoft, VMware CA, HP, IBM, Microsoft, Parasoft, Skytap, Tricentis Evolution of Virtualization 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. Service Virtualization Enabling development and test teams to simulate and model their dependencies of unavailable or limited services. Removes constraints and wait times frequently experienced by development and test teams to access components, architectures, databases, mainframes, etc. Source: voke Market SnapshotTM Report: Service Virtualization December 2012 Virtual Lab Management The creation of a virtual instance of a physical environment to enable anyone to access a virtual equivalent of any environment on demand at any time without the need to wait for a physical machine set-up or additional hardware. Source: voke Market SnapshotTM Report: Virtual Lab Management March 2010 Lifecycle Virtualization Definitions 17. 4/29/2014 15 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. Access to Required Systems 33 Average number of systems needed for dev or test 18 Average number of systems with unrestricted access for dev or test Source: voke Market SnapshotTM Report: Service Virtualization December 2012 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. Lab Access Wait Time 96% Wait for access Wait Time to Access Lab Participant Percentages None immediate access 4% 1 hour or less 7% 2-4 hours 14% 5-8 hours 11% 2-4 days 38% 1 week 11% 2-4 weeks 14% 10 weeks 1% Source: voke Market SnapshotTM Report: Service Virtualization December 2012 18. 4/29/2014 16 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. Lab Access Restrictions 69% Time restrictions Lab Access Restrictions Participant Percentages 4 hours or less 31% 5-7 hours 6% 1-2 days 22% 1 week 6% 4-6 weeks 4% No restrictions 31% Source: voke Market SnapshotTM Report: Service Virtualization December 2012 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. Category Metric Reduced Wait Times 64% -achieved a 50% 100% reduction in wait time Greater Availability of Services 75% - achieved a 50% or greater increase in availability of services Decreased Software Cycles 55% - achieved a 25% - 50% reduction in overall software cycle Increased Test Coverage 59% - achieved 50% - 90% increase in test coverage Shorter Test Cycle Times Average 58% decrease in test cycle length Improved Time-to-Market Average 24% faster time-to-market Fewer Production Defects Average 22% reduction of production defects Source: voke Market SnapshotTM Report: Service Virtualization December 2012 ROI Service Virtualization Summary 19. 4/29/2014 17 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. Development Testing 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. Development Testing Definition Complement traditional blackbox functional testing. Transform the software testing activity from reactive to proactive by moving testing upstream to identify and remediate defects earlier in the lifecycle. Source: voke February 2014 20. 4/29/2014 18 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. Development Testing Overview Primary User Tool Types Function Vendors Developers Static code analysis Defect prevention Memory leaks Deadlocks Race conditions Coverity Parasoft Developers Dynamic code analysis Detect dependencies based on system execution Coverity Parasoft Developers Unit testing Smallest testable part of an application to ensure code meets its design and behaves as intended Coverity Microsoft Parasoft Developers QA professionals Application security testing Identify security vulnerabilities through scanning and penetration testing Coverity HP IBM Parasoft Development Managers Policy Management Define consistent coding standards across teams Coverity Parasoft 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. Development Testing Benefits Test at every phase of the application lifecycle Collaborate and communicate with development to increase test coverage Remediate defects earlier in the lifecycle to save time and money Reduce traditional testing cycle by focusing testing on areas that require more thorough testing (increase code coverage) Reduce the number of defects entering production 21. 4/29/2014 19 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. Mobility 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. Evolution of Complexity Testing Challenges Mainframe Client/Server Web Mobile Complexity 22. 4/29/2014 20 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. Pillars of Testing Adding Mobile Does it work? Does it perform? Is it secure? Functional Performance Security Load Stress Endurance Networks Platforms Requirements Manual Regression Exploratory Networks Platforms UserExperience Scans Penetration StaticAnalysis Device Data Compliance = Additive for mobile Infrastructure 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. Mobile Apps Best Practices Mobile testing IS application testing Extend enterprise best practices to incorporate mobile uniqueness - Gestures - Location Leverage existing skills in QA - Platform tooling - Automation - Performance - Security Include new team members with specific mobile skills - Hardware - Infrastructure - OS - Networking 23. 4/29/2014 21 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. Embracing Extreme Automation 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. Extreme Automation Benefits Goal Extreme Automation Automation is critical - Traditional applications - Mobile Reduces risk associated with multi-platform delivery - Mobile demand Reduces overall software cycle time Increases code coverage Assists in managing the dynamic nature of mobility Enhances visibility into the software supply chain and reduces risk Enhances communication and collaboration throughout the entire lifecycle 24. 4/29/2014 22 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. Extreme Automation Getting There People Process Technology Leverage relationships with vendors Select pilot projects for new technology Get current and stay current on existing tools Leverage relationships with professional service providers Form a CoE for new technology Evaluate new tools offered by current suppliers Update internal skills to focus on achieving extreme automation Leverage a CoE model to go from pilot project to department / enterprise use Explore innovation from other vendors 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited. Embrace New Technology Innovate Technology Market Vendor/Product Benefit to Quality Automated Testing...

Recommended

View more >