If you can't read please download the document
Upload
voanh
View
230
Download
2
Embed Size (px)
Citation preview
User Guide: A/B Testing
Page 1
A/B Testing
Magento Extension User Guide
Official extension page: A/B Testing
Support: http://amasty.com/contacts/
https://amasty.com/magento-ab-testing.htmlhttps://amasty.com/magento-ab-testing.htmlhttp://amasty.com/
Page 2
Table of contents:
1. Notifications and Ignore List settings.....3 2. Experiment Creation..4 3. Reports Display...13 4. CSS Override Settings..15 5. Custom Design.17 6. Frontend Examples19
Support: http://amasty.com/contacts/
User Guide: A/B Testing
http://amasty.com/https://amasty.com/magento-ab-testing.html
Page 3
1. Notifications and Ignore List settings
Support: http://amasty.com/contacts/
To configure Admin notifications and Ignore list settings please go to System ->Configuration -> A/B Testing
User Guide: A/B Testing
Set to Yes to automatically send notifications to admin users when the experiment is complete. Specify sender info and choose email template.
To prevent pages with test variations from indexation and avoid content duplication specify user agents to ignore.
You can exclude particular IP addresses (e.g. admin users addresses) from the experiment to get more precise results.
http://amasty.com/https://amasty.com/magento-ab-testing.html
Page 4
To create a new test or check the results of running experiments please go to Sales -> A/B Testing
Support: http://amasty.com/contacts/
User Guide: A/B Testing
Click here to create a new test.
2. Experiment Creation
Click on one of the launched experiments to see its settings and check reports information.
http://amasty.com/https://amasty.com/magento-ab-testing.html
Page 5 Support: http://amasty.com/contacts/
User Guide: A/B Testing
On the Products to Test tab you can choose necessary products for which you want to run a test. Its possible to specify either one product or launch the experiment for a group of products.
2. Experiment Creation
http://amasty.com/https://amasty.com/magento-ab-testing.html
Page 6
Choose the product attribute which you want to test.
Support: http://amasty.com/contacts/
User Guide: A/B Testing
2. Experiment Creation
You can test either one attribute or specify a couple of attributes to run a multivariate test.
After youve specified which attributes for which products you want to test, please click the Continue Button.
http://amasty.com/https://amasty.com/magento-ab-testing.html
Page 7 Support: http://amasty.com/contacts/
User Guide: A/B Testing
When the experiment is saved you can edit its name and specify the goal type (4 types are available).
NOTE: Click the Run Experiment button only after you specify Variations data.
2. Experiment Creation
http://amasty.com/https://amasty.com/magento-ab-testing.html
Page 8 Support: http://amasty.com/contacts/
User Guide: A/B Testing
If you want to check out how many people came to a particular page (e.g. a subscription page, or thank you for purchase page) right after the product page specified in the Products to test tab, please insert the URL for this page here.
2. Experiment Creation
http://amasty.com/https://amasty.com/magento-ab-testing.html
Page 9 Support: http://amasty.com/contacts/
User Guide: A/B Testing
If youve enabled Test Auto Complete option you can specify the minimal conversion rate change against the original variant that will trigger the test completion.
2. Experiment Creation
http://amasty.com/https://amasty.com/magento-ab-testing.html
Page 10 Support: http://amasty.com/contacts/
User Guide: A/B Testing
In this tab you can check whether youve chose correct products to test.
2. Experiment Creation
http://amasty.com/https://amasty.com/magento-ab-testing.html
Page 11 Support: http://amasty.com/contacts/
User Guide: A/B Testing
In the Variation tab youll find the fields according to the attribute you are going to test. NOTE: In case you test one attribute its data will be copied to the Variation 1 tab automatically as the original variant.
2. Experiment Creation
http://amasty.com/https://amasty.com/magento-ab-testing.html
Page 12 Support: http://amasty.com/contacts/
User Guide: A/B Testing
After all necessary attributes data are specified, please return to the General Tab and click the Run Experiment button.
2. Experiment Creation
Once the experiment is launched, the Report tab will be added.
http://amasty.com/https://amasty.com/magento-ab-testing.html
Page 13 Support: http://amasty.com/contacts/
User Guide: A/B Testing
Right after the experiment launch you can track its results in real time.
3. Reports Display
http://amasty.com/https://amasty.com/magento-ab-testing.html
When the experiment has been running for 4 days already and there is enough data to estimate youll see the detailed report.
Page 14 Support: http://amasty.com/contacts/
User Guide: A/B Testing
3. Reports Display
NOTE: The smart extension algorithm will display the winning variant more often than other variations, to prevent you from sagging sales before test completion.
http://amasty.com/https://amasty.com/magento-ab-testing.html
Page 15 Support: http://amasty.com/contacts/
User Guide: A/B Testing
Choose this option in the Attributes list to customize and test website styles, for example : the size and color of Add
to Cart button; Font changes etc.
4. CSS Override settings
http://amasty.com/https://amasty.com/magento-ab-testing.html
Page 16 Support: http://amasty.com/contacts/
User Guide: A/B Testing
Here weve changed the Add to Cart button color (see page 21).
4. CSS Override settings
http://amasty.com/https://amasty.com/magento-ab-testing.html
Page 17 Support: http://amasty.com/contacts/
User Guide: A/B Testing
5. Custom Design
Test not only product attributes, but custom design and layout as well.
http://amasty.com/https://amasty.com/magento-ab-testing.html
Page 18 Support: http://amasty.com/contacts/
User Guide: A/B Testing
Choose the necessary template from the dropdown. As soon as you define the templates for all variations, theyll be randomly displayed to customers.
5. Custom Design
http://amasty.com/https://amasty.com/magento-ab-testing.html
Page 19 Support: http://amasty.com/contacts/
User Guide: A/B Testing
When you choose Name as a attribute to test, the module will randomly display different variations to store visitors.
6. Frontend Examples
http://amasty.com/https://amasty.com/magento-ab-testing.html
Page 20 Support: http://amasty.com/contacts/
User Guide: A/B Testing
See the example of product description variations displayed to customers.
6. Frontend Examples
http://amasty.com/https://amasty.com/magento-ab-testing.html
Page 21 Support: http://amasty.com/contacts/
User Guide: A/B Testing
See the example Custom CSS override usage (see page 16)
6. Frontend Examples
http://amasty.com/https://amasty.com/magento-ab-testing.html
Thank you!
Your feedback is absolutely welcome!
Should you have any questions or feature suggestions, please contact us at:
http://amasty.com/contacts/
Page 22 Support: http://amasty.com/contacts/
User Guide: A/B Testing
http://amasty.com/contacts/http://amasty.com/contacts/http://amasty.com/https://amasty.com/magento-ab-testing.html