April 12, 2023

How Spotify Does Test AutomationKristian Karl

The 20 minutes agenda

• Separation of Test Design and Implementation

• Automation of Mobiles, Desktop and Web Clients

• Handling of Test Data and Test Results.• Demos

API Tests

Integration Tests

Component Tests

System Tests

Unit Tests

Performance Tests

GUI Tests

Separation of Test Design and Implementation

Test Automatio

n

Test Implementatio

nTest Design

Ab

stra

ctio

n L

ayer

Model-based testing

• Models are the abstraction layer in the test automation.

• QA uses models to design the tests.

• Devs implements the code executing the tests.

Login dialog

’What’s New’

Login using valid credentials

Client not running

Start client

Log out

Close

Exit

Login using invalid credentials

Toggle ’Remember me’

Start client

public interface SimpleLogin { public void e_Close(); public void e_Exit(); public void e_Init(); public void e_InvalidCredentials(); public void e_Logout(); public void e_StartClient(); public void e_ToggleRememberMe(); public void e_ValidPremiumCredentials(); public void v_ClientNotRunning(); public void v_LoginPrompted(); public void v_WhatsNew();}

Automation of Mobiles, Desktop and Web Clients

• yEd – Editing graphml models [www.yworks.com]

• GraphWalker – Generating test sequences online/offline [graphwalker.org]

• python-graphwalker – Generating test sequences [https://github.com/spotify/python-graphwalker]

• Sikuli – Image recognition (desktop) [www.sikuli.org]• Selenium – Web testing [seleniumhq.org]

• NuRemote – In-process testing (iOS) [github.com/nevyn/NuRemoting]

• TestNG – Unit test framework [testng.org]• Jenkins – Schedules and launches tests 24/7 [jenkins-ci.org]• VirtualBox – Virtualization [www.virtualbox.org]

Handling of Test Data and Test Results.

Done! Demo! Q&A!

Spotify is hiring: https://www.spotify.com/se/jobs/