Embed Size (px)
Citation preview
© 2015 IBM Corporation
IBM DevOps for Enterprise Systems
Test Concepts and Technologies
May 18th 2015
Scott Davis & Dennis Behm
Testing in DevOps …….
Automated Testing
– Test Bucket
– xUnit Component Testing
Continuous Testing
– Build
Big Bang || Virtualization
– API Testing
Shift Left
2
© 2015 IBM Corporation3
IBM DevOps for Enterprise Systems
RDz 1 Click to Generate, Build, and Run test cases
© 2015 IBM Corporation4
IBM DevOps for Enterprise Systems
RDz – Simplified UI Flow
1) Select source code,
invoke Generate Test
Case action from
context menu
2) Entry can be added here
4) Add entry, edit data . . .
3) Press [Edit Test Entry Data]
button to launch editor 6) Choose
stub or real,
press [OK]
5) Press [Generate Test Case]
button to proceed
7) Generating the test case . . .
8) Build test case
© 2015 IBM Corporation5
IBM DevOps for Enterprise Systems
Import Data from Input files
2) Press [Import Data from File] button
1) Press [Edit Test Entry Data]
button to launch editor
3) Specify file, number of
records, and then press
[OK] button to import
4) Work with the
imported data
Test Entry Data Editor
2 Test Entries, Cases
© 2015 IBM Corporation6
IBM DevOps for Enterprise Systems
Standardized Results
© 2015 IBM Corporation7
IBM DevOps for Enterprise Systems
Code Coverage
Theme : zUnit
2015+20152014
Q2 Q4Q3Q3 Q4 Q1 Q2Q1
Planned ConceptualSTATUS: Released
RDz v9.1.1
• Stubbing I/O calls (no
VSAM support )
• Simplified User flow
• Test Entry editor to allow
specification of Input and
Expected output
• Persistence of test data
RDz Next
• PLI Support
• Code coverage
integration
• COBOL ODO support
• UI enhancements
• Handling changes to
Data model after test
case is created
• Stubbing VSAM I/O
Future Roadmap
• DB2 support
• Unit testing of CICS
transaction
• Unit testing of IMS
transaction
• Test Data
Generation
Theme : Test Optimization
2015+20152014
Q2 Q4Q3Q3 Q4 Q1 Q2Q1
Planned ConceptualSTATUS: Released
RDz Next
• Developer role:
• What tests to run for
given set of changes?
• What tests to write to
cover the gaps based
on Code coverage ?
Future Roadmap
• Tester role:
• What is the
optimal set
of tests to
run ?
• What are the
gaps in test
coverage ?
© 2015 IBM Corporation10
IBM DevOps for Enterprise Systems
10
Service Virtualization
Enables the creation of “virtual services”:–Virtual Services simulate the behavior of an entire application or system during testing
–Virtual Services can run on commodity hardware, private cloud, public cloud
–Each build system, developer, tester can easily have their own test environment
–Developer and testers continue to use their testing tools (Manual, Web performance, UI test automation)
Early testing in the product-life-cycle
Additional component and service layer testing
Ability to run end-to-end test scenarios
Identify and fix bugs earlier in the product life cycle.
Shortened release cycles, quicker time to market
Cap
ture
& M
od
el
Heterogeneous Environments
Public CloudPrivate Cloud
Data Warehouse MainframeEnterprise Service Bus
Directory Identity
File systems
Collaboration
App Under TestRouting Service
Third-partyServices
Portals
ContentProviders
EJB
SharedServicesArchives
Business Partners
Messaging Services
Databases Mainframeapplications
App Under Test
Third-partyServices
Packaged apps, messaging services, etc.
Virtual Services
Test Virtualization Concepts
11
•What it’s all about. Inject; observeTEST
•The fastest way to build tests and stubsRECORD
•Observe without consuming (typically in a test)WATCH
•The act of creating a simulation (stub) of a service [for testing reasons]VIRTUALIZE
•The ability for a stub to decide whether to process a message or give it to the real service SIFT-AND-PASS-THROUGH
•Populating Tester with information from external middlewareSYNCHRONIZE
•Transports move messages; content is the messageTRANSPORT VS CONTENT
IBM Solution for Test AutomationA smarter solution for better quality
• Rational Test Workbench is a desktop
solution that enables testers/developers to:– Capture and model virtual services
– Test services and applications long before their
user interfaces becomes available and do integration
testing
• Rational Test Virtualization Server is a
server solution that:– Provides a central environment to virtualize
heterogeneous hardware, software and services to
provide 24x7 testing capabilities
– Reduces infrastructure costs of traditional testing
environments
– Virtual Services can be built from the interface
definition of the system for a wide variety of
protocols, formats or technologies
Unterstütze Technologien
• HTTP/S
• WebSphere MQ
• JMS (multiple)
• REST
• S/MIME
• Java RMI (virtualization only)
• JVM (virtualization only)
• SAP IDoc, BAPI, RFC, XI 3.0
• Software AG’s IB & IS
• TCP/(S), IP, UDP
• CICS TG
• CICS IPIC
• CICS DPL
• IMS Connect
• TIBCO Rendezvous, Smart Sockets & EMS
• ActiveMQ
• Email (SMTP, IMAP) (testing)
• Files
• FTP/S
• WebSphere Application Server
• IBM Integration Bus (WSMB)
• WebSphere MQ
• Websphere SI Bus
• WebSphere RR
• UDDI
• Web Services / REST (WSDL/WADL)
• System z (CICS and IMS)
• Software AG IS, Broker, BPMS
• Oracle Fusion
• TIBCO ActiveMatrix
• BPM
• Databases(JDBC)
• DB2 - EXEC SQL
• Log Files
• CentraSite
• SCA Domain
• XML (XSD, WSDL, WADL)
• SOAP
• JSON
• COBOL Copybook
• PL/I Include
• ASC X12
• UN/EDIFACT
• DFDL
• ISO 8583
• ISO 20022
• Fixed Width
• Java Objects
• AS2
• Software AG Broker Docs
• .Net Objects
• Bytes
• SWIFT
• CHIPS
• FedWire
• TIBCO ActiveEnterprise
• EBCDIC
Messaging Protocols SOA, ESB, Others Message Formats
Content and Schemas
1
4
Mainframe Support
CICS Transactions thru IPIC
CICS to CICS thru DPL within a CICSPLEX
Recording and Virtualization thru the CICS Transaction Gateway,
releasing a mainframe necessity
DB2 Virtualization from CICS COBOL programs
– CLIP (Compiled Language Intercept Processor)
MQ based services w/o changes to the configuration
Built-in Support für COBOL & PLI Copys & Includes
IMS Transactions over SOAP or IMS Connect
Native support for EBCDIC
IBM DevOps for Enterprise Systems
Back Ups
© 2015 IBM Corporation17
IBM DevOps for Enterprise Systems
IBM DevOps for Enterprise Systems
© 2015 IBM Corporation19
IBM DevOps for Enterprise Systems
zUnit Testcase Structure Overview
Develop zUnit Test Case Run zUnit Test CaseBuild zUnit Test Case
