29
Teaching a Robot to Play Angry Birds Jason Huggins, Sauce Labs Inc

Selenium Conf - Robots

  • Upload
    hugs

  • View
    120

  • Download
    0

Embed Size (px)

DESCRIPTION

Mobile testing is different than desktop web testing. It needs the right tool for the job. In this case, we need robots. Lots of them. Lots of little robot fingers touching lots of little mobile device screens. In this talk, Jason Huggins will bring out some robots from his lab and demonstrate how you, too, can join in the robot revolution that will destroy civilization… and make a decent living testing mobile apps in the process.

Citation preview

Page 1: Selenium Conf - Robots

Teaching a Robot to Play Angry Birds

Jason Huggins, Sauce Labs Inc

Page 2: Selenium Conf - Robots

Jason HugginsCo-creator, The Selenium ProjectCo-founder, CTO, Sauce Labs Inc

twitter: @hugsemail: [email protected]

Page 3: Selenium Conf - Robots

@hugs

Page 5: Selenium Conf - Robots
Page 6: Selenium Conf - Robots
Page 7: Selenium Conf - Robots
Page 8: Selenium Conf - Robots

Motorized Pin Art

Page 9: Selenium Conf - Robots

pinthing.com

Page 10: Selenium Conf - Robots

Maker Faire

Page 11: Selenium Conf - Robots
Page 12: Selenium Conf - Robots

Gridbeam

Page 13: Selenium Conf - Robots
Page 14: Selenium Conf - Robots
Page 15: Selenium Conf - Robots

The “Clicker”

Page 16: Selenium Conf - Robots
Page 17: Selenium Conf - Robots

• Beam width: 5/16 inches

• Distance between holes: 8mm

• Hole diameter: 4.8 mm

LEGO Technic Compatibility

Page 18: Selenium Conf - Robots
Page 19: Selenium Conf - Robots

Hypothesis:

• Selenium is a software-based robot.

• Selenium’s mission is to mimic and automate how users interact with an application.

• For mobile, this means handling real devices.

• To test mobile, could I take Selenium out of the screen and into the real world?

Page 20: Selenium Conf - Robots

•Electronics: Arduino

•Mechanics: Bitbeam- Lego Technic compatible building toy- Made from Basswood- Designed with 3D tool OpenSCAD- Lasercut at TechShop San Francisco

•Software: Python, OpenCV

My unscientific method:

Page 21: Selenium Conf - Robots

BitbeamBot I:The Angry-Birds Playing Functional Testing Robot

Page 22: Selenium Conf - Robots
Page 23: Selenium Conf - Robots

“Too Slow!”

Page 24: Selenium Conf - Robots

“Delta!”

Page 25: Selenium Conf - Robots

BitbeamBot II:The Faster Angry-Birds Playing

Functional Testing Robot

Page 26: Selenium Conf - Robots
Page 27: Selenium Conf - Robots
Page 28: Selenium Conf - Robots

Moar Demos!