Embed Size (px)
Citation preview
通往軟體測試最高殿堂的旅程
Chloe Chen (KKBOX)
ABOUT ME #ChloeChenSET in
KKBOX
Dog Lover Love Puppet Show
FB: chloe.chen.727GMail: chloechen727
ABOUT GTAC 2016● 10th GTAC ● 1400 attendee applications
250 attendance
● 208 speaker proposals, 21 Talks in 10 hrs
○ 1hr Keynote: 2○ 30 min. Presentation: 9○ 15 sec. Lightning Talk: 10
23 SPEAKERS
Subject #1 - Experience Sharing
● Evolution of Business and Engineering Productivity
Some granular metrics we track ● Changlist to production Latency● Code coverage● Presubmit greenness● Dashboard development● Test clusters● Intelligent selection of release candidate
change list● Release process...
Q &A Test Self-Driving?
Automated test : Manual test =
Machine learing software is better test in Production?
How much time was presubmit phase take?
How do we test the test themselves?
Not yet.
95% : 5%
It will make sense to kind of test before it hits production.
It take about 10 days, but I want to say a good 2 or 3 days in the pre-submit phase
We are getting assurance from different ways that your software is behaving correctly.
Subject #2 - Tools
● Developer Experience, FTW!○ Test Lab - Firebase○ Espresso
Test Lab - Robo● Choose Device/
Simulator
● Let you can do Login
Test Lab - Robo● Provide crawl report
○ Log○ Screenshot○ Flowchart○ Record
Test Lab - Run Script on Devices● Upload apk
& test apk
● Choose Device/ Simulator
● Provide devices report○ Cases○ Log○ Record
Test Lab - Run Script on Devices
Test Lab● Crawler is not very
smart, suggest to use your own test script to test
ABOUT MEQ &A
What should small startup needs to start instroducing automation?
Firebase support geo/real purchases/ memory leak tests ?
Firebase support Stress/ Performance/ Security tests?
How to deal with privacy data ?
Keep pre-lauch report for every version submitted?
if you can unit test, unit test it.
No, stay tuned/ in our roadmap.
Yes, but you need to write those test.
It will look for patterns for privacy data and scrumb them out.All tests are fresh install.
No. Because law...
ABOUT MEQ &A
Firebase v.s. Crashlytics, Crittercism
Firebase test with Game app?
再更智能一點嗎？像是撒 seeding
Support Penetration testing?
Support Wi-Fi/ Bluetooth connected device test?
We have a lot of people who also continue to use Crashlytics side by side.
Games has been a very challenging thing for us.
Under working.
We did a whole bunch of basic security crawls.
Not yet. We don't have good hardware solutions.
GTAC 2017 in London (Spring)
Questions?
Thank You
btw, We Need You!
資深自動化軟體測試工程師
軟體測試工程師 (SET)
下午茶免費販賣機
國外旅遊 免費參加演唱會近距離接觸偶像
每年重金送你去 GTAC ! A_Ay
R.G.B95. 96. 98
Reference● GTAC 2016● GTAC 2016 Day 1 Slide● GTAC 2016 Day 2 Slide● FireBase (Android) Getting Started● Firebase in a Weekend: Android
