Selenium cloud

Embed Size (px)

DESCRIPTION

State of the art about cloud-computing in the Selenium ecosystem

Citation preview

  • 1. The Selenium Cloud

2. me: Michael Wowro History: database developer, test lead atmmw AG Test Automation Engineer (freelancer) Blog: IT KOSMOPOLIT (www.it-kosmopolit.de) Latest contribution to Selenium Project:blog list (http://bit.ly/UZVbRf) 3. terminology Cloud Selenium Selenium Cloud 4. advantages Focus on test-automation = app coverage(not setting up and maintaining grid) Sophisticated reports support bugtracking Usage fee versus fix costs Add browser/OS combo easily 5. challanges Delay with waiting for free node (rare case) Delay by latency (little: compared tobrowser start/driving) Company politics (for WebAppsunproblematic, as test data shouldnt besensitive) Trust in foreign quality (THE issue aboutcloud computing) Integration 6. For completeness ... TestingBot: http://testingbot.com/ - nomature company yet (rising star?) Website Load Testing History: BrowserMob Neustar Using BrowserMob Proxy (close but not in Selenium Project) Intro for BrowserMob Proxy:http://bit.ly/V5JYPj 7. Sauce Labs History: EC2 Staff: Jason Huggins, Santiago SuarezOrdoez Based in: CA, USA OS/browser combos: 59 Windows, 19 Mac,18 Linux(https://saucelabs.com/docs/browsers) 8. Documentation test = job (in Sauce vocabulary) overview of tests = SauceLabs HOME test report = job info (in Sauce vocabulary) test report: protokoll, screenshots, video,log 9. SauceLabs HOME 10. Test Reporthttp://bit.ly/UZVo9b 11. Integration I RemoteWebDriver Named tests:caps.setCapability("name",Thread.currentThread().getStackTrace()[1].getMethodName()); Behavior of testing framework (Junit,TestNG) not different from Selenium Grid REST-API: http://saucelabs.com/docs/rest Result integration: http://bit.ly/QP3Xq3 12. Integration II Code: https://gist.github.com/4170183 Test report: http://bit.ly/Yuf8q2 13. @manual tests SauceLabs supports them, too: Choose the OS/browser combo on whichthe customer reported the bug. Have video documentation of the way tothe bug. Integration with JIRA 14. Contracthttp://saucelabs.com/pricing Minute-based service Freemium (in total 170 minutes/month free) minute differentiation Win, Linux, Android Mac, iOS Manual testing Key to performance = #parallel instances 15. Questions?http://icant.co.uk/talks/h5/pictures/smashingconf/okay.gif