THE WHAT, WHY & HOW OF (WEB) ANALYTICS TESTING

Anand BagmarSoftware Quality Evangelist

ABOUT ME

@BagmarAnand

about.me/anand.bagmar

Web Analytics

WHAT IS WEB ANALYTICS?

WHY DO WE NEED WEB ANALYTICS?

WEB ANALYTICS SOLUTIONS

Google Analytics

SiteCatalyst

AWStats

WebTrends

….

Testing Web Analytics

TESTING AT THE REPORT LEVEL

Pros

¨ Ensure report is setup correctly

Cons

¨Licensing

¨Reports not yet setup

¨Validate all requests are sent / captured

Biggest Problem

It is TOO LATE!

The Solution

Web Analytics Testing Challenges

MANUAL

REPEATING OVER-AND-OVER AGAIN

The Automation Solution

WAAT - Web Analytics Automation Testing

WHAT DOES WAAT DO FOR ME?

q Plugs into existing Test Automation Frameworkq With minimal changes

q Web Analytic tool independentq UI Driver framework independentq Browser independent

FLAVORS

WAAT-JAVA

q Original flavorq Supports 2 plugins

q Omniture Debuggerq Proxy q HttpSnifferq JsSniffer

q Available on github

Will be eventually available as a Maven Dependency!

WAAT-RUBY

q Ruby gem implemented over WAAT-Javaq Uses RJB – Ruby-Java-Bridgeq Supports 2 plugins

q HttpSnifferq JsSniffer

q Available on github and rubygems.org

Will be changing soon!

WAAT-JAVA

q Original flavorq Supports 3 plugins

q Omniture Debuggerq HttpSnifferq JsSniffer

q Available on github

WAAT-RUBY

q Ruby gem implemented over WAAT-Javaq Uses RJB – Ruby-Java-Bridgeq Supports 2 plugins

q HttpSnifferq JsSniffer

q Available on github and rubygems.org

OMNITURE DEBUGGER

OMNITURE DEBUGGER

Prosq OS independentq Run using the regular test-user

Consq Browser dependent – need to implement ScriptRunner

for the UI-driver in useq Web-Analytic solution dependent – Adobe Marketing

Cloud / Omniture SiteCatalyst

HTTPSNIFFER

Prosq Web-analytic solution independentq Browser independentq UI-driver independent

Consq 3

rdparty libraries are OS Dependent

q HTTPs not supported out-of-the-boxq Run tests as ‘root’

JSSNIFFER

Prosq Web-analytic solution independentq Browser independentq HTTPs supported out-of-the-boxq No dependency on any 3

rdparty library

Consq Need to write JavaScript to get the URL from the browserq UI-driver dependent

@BagmarAnand #waat how can I contribute?

PROXY DEBUGGER

Prosq Web-analytic solution independentq Browser independentq UI-driver dependentq HTTPs supported out-of-the-boxq No dependency on any 3

rdparty library

Consq Making it work for Mobile needs manual setup

ARCHITECTURE

Is that all to

Web Analytics?

The new “kids” in town

IoT & Big Data

Some popular use cases

https://www.kaaproject.org/iot-use-cases/

IOT – INTERNET OF THINGS

Opportunity to

¨ Create new value propositions

¨ Be Innovative & Creative

IOT – HOW TO DELIVER VALUE?

¨ Automate the manual processes

¨ Integrate data capabilities

¨ Collect – integrate from various sources

¨ Repeat collection – automate the collection

¨ Analyze – manual & machine learning

¨ Optimize / Pivot

¨ Repeat

IOT – CHALLENGES

¨ Federated devices,

¨ Different types of networks

¨ Different communication channels

¨ Physical (hardware) & Virtual (software)

IOT – BIGGER CHALLENGES

¨ Too many devices

¨ Lots of data

BIG DATA …. IS GETTING BIGGER

¨ Volumes of data generated¨ A jet engine generates 1TB of data per flight.

¨ A large refinery generates 1TB of raw data per day.

¨ As cars get smarter, the number of sensors is projected to reach as many as 200 per car.

¨ Sensors of all types will generate immense amounts of data. In fact, analysts estimate that by 2020, 40 percent of all data will come from sensors.

¨ IoT leads to massive volumes of data

http://www.cisco.com/web/solutions/trends/iot/docs/iot-data-analytics-white-paper

What does this mean for Testing?

TESTING OPPORTUNITIES

¨ “Testing” of these new integrations & its value propositions

¨ Performance

¨ Reliability

¨ Security

https://www.wired.com/2017/03/medical-devices-next-security-nightmare/?mbid=social_twitter_onsiteshare

TESTING OPPORTUNITIES ...

¨ Build capabilities (and tools) to validate –

¨ Data collection is working well

¨ From all sources

¨ Analyzing data, capturing patterns and trends

¨ Optimize business value

¨ Create new opportunities and value propositions

@BagmarAnand

about.me/anand.bagmar

THANK YOU

RESOURCES

¨ https://github.com/anandbagmar/waat

¨ https://github.com/anandbagmar/waat-ruby

¨ http://essenceoftesting.blogspot.in/search/label/waat

¨ http://www.cisco.com/web/solutions/trends/iot/docs/iot-data-analytics-white-paper

¨ http://www.dezyre.com/article/how-big-data-analysis-helped-increase-walmart-s-sales-turnover/109