Upload
others
View
27
Download
0
Embed Size (px)
Citation preview
Appium & Selenium in the CloudChallenges and Solutions
2
We will send you a recording of this session after the webinar
Please write your questions in the Q&A pane
Before we start
Start testing for free
www.experitest.com
Speakers
3
Elad Dotan
VP Operations
Ruth Zamir
Director of Marketing
Agenda
4
Why test in the cloud?01 5 min
Summary & Q&A03 10 min
02 Key challenges and solutions 30 min
5
Digital transformation requires
DevOps speed
6
7
Let someone else worry bout logistics
• Its complex
– Build, configure, maintain, manage
• What you need, when you need it
– quick access to large device, OS and browser matrix
• Speed and scale: realize the grid promise
• Team alignment and code reuse
– developers, business users, testers
• Anytime, anywhere global collaboration
• No downtime: availability and utilization
Why test in the cloud?
8
Poll
Agenda
9
Why test in the cloud?01 5 min
Summary & Q&A03 10 min
02 Key challenges and solutions 30 min
10
Low Performance
& Latency1
11
Continuous testing requires feedback within minutes
• False positives
• Low automation reliability
• Low productivity
• User frustration
Speed is your key objective
Your checklist for high performance
12
❑ Local datacenter
❑ Tier 4 datacenter
‒ Redundant capacity components
‒ Dual powered components & Multiple links
‒ All components fault tolerant including
power, uplink, Storage, chillers. HVAC etc.
‒ Staff onsite
❑ Tier 1/2 ISP
‒ More bandwidth
‒ Fewer hops
Datacenter requirements
❑ High availability architecture
❑ Continuous testing in production
❑ Live monitoring
Testing solution
13
Security &
recovery2
14
Deal with perceived and real challenges
Leading security objections:
• Malicious attacks
• Data breach and data loss
• Regulation
Security concerns one of the key barriers to cloud migration
Real security challenges:
• Connection to staging and backend
systems
• User authentication
• Project and user management
• Regulation
Your security checklist
15
• ISO 27001 and SOC 2 certification
‒ Datacenters
‒ Vendor software
• VPC (Virtual private cloud)
‒ Network level - firewall
‒ Application level – IPS, virus detection…
• Network Security
‒ Communication over HTTPS
‒ VPN Site to Site
‒ Whitelisting
‒ Network tunnel
Solution Security
• Hybrid solution: cloud / on-prem
‒ Ability to retain certain applications on premise
• Security Features
‒ Project management
‒ Cleanup procedures
‒ SSO and MFA
• Onsite backup
• Encrypted backup
• CloudOps competency
• Fully isolated environment (not multi-tenant)
Security Features
16
Support for entire
DevOps team3
One team, different tools and needs
17
< / >
Developer TesterBusiness user
XCode, Android Studio,
XCUITest, Espresso,
Live testing, codeless
tools, Cucumber
Appium, Selenium
Development, unit
testing, debugging
Exploratory testing,
acceptance testing
Exploratory testing, test
automation,
performance testing,
API testing
Decision
maker
Quality decisions
Dashboards, reports
18
• Framework support
– Open source, native tools
• Live screen sharing
• Code sharing
– Application / website, test
– Testing code in local / staging environments
• Consolidated reports
• Advanced analytics
Your DevOps team checklist
19
Use case
support 4
20
Use case becoming complex
21
Evaluate your needs and use cases, make sure cloud vendor can support them
• Special device support and availability
– Scanners (Zebra)
– IoT
– SIM switchers
• System and 3rd party apps
– Voice
– Text message generation
– GPS integration
• Complex scenarios that span several devices
– Multi device reports reflecting a single end to end test scenario
• Commitment to latest device, OS, browser support
– Including beta versions
Coverage checklist
22
Scale &
Cost5
23
High scale parallel execution
DevOps speed
More people
testing
wider
device / browser
matrix
Shorter
timeframe* *
=
Thousands of tests
per minute
24
Plan for fast feedback and coverage
• Evaluate vendors’ ability to meet requirements
– Run thousands of tests per minute
– Intelligent test queuing and distribution
– Resource availability
• Calculate your cost structure for growth
Your checklist for scalability
Agenda
25
Why test in the cloud?01 5 min
Summary & Q&A03 10 min
02 Key challenges and solutions 30 min
SeeTest Continuous Testing Cloud for web and mobile applications
Full offering for testers, developers, and executives
26
Digital
LabWeb, Mobile,
IoT
Integrations with CI
• Jenkins
• Bamboo
• TeamCity
• Hudson
• Circle CI
• HP QC
• Jira
Integrations with test env.
IDEs and languages
Test creation:
• Appium studio for Eclipse
• Appium studio for IntelliJ
• Selenium
• Codeless tools
(Tricentis, Worksoft, etc.)
Developer tools:
• Espresso
• XCUITest
• XCode
• Android Studio
• Local testing
• Debugging on remote devices
Non-functional
• Device monitoring
• Performance
• Network virtualization
• Eclipse
• IntelliJ
• JUnit
• TestNG
• Cucumber
• Nunit
• Visual Studio
• C#
• Perl
• Ruby
• Java
• Javascript
• Python
• React
• Angular
• React native
• Ionic
• Phonegap
• Cordova
SaaS datacenters worldwide with real devices & desktop browsers
All datacenters ISO 27001 and SOC 2 certified, additional datacenters planned
27
Fremont, CA
Bracknell, UK
Tel Aviv, Israel
Frankfurt, Germany
New Delhi, India
NYC, NY
Toronto, Canada
Sydney, Australia
Tokyo, Japan
Singapore
Questions?Thank you!