Note
Access to this page requires authorization. You can try signing in or changing directories.
Access to this page requires authorization. You can try changing directories.
Note
The Retail Interest Group by Dynamics 365 Commerce has moved from Yammer to Viva Engage. If you don't have access to the new Viva Engage community, fill out this form (https://aka.ms/JoinD365commerceVivaEngageCommunity) to be added and stay engaged in the latest discussions.
This article explains how to use experimentation in Microsoft Dynamics 365 Commerce to validate hypotheses about the effectiveness of your e-commerce pages.
Use experimentation in Dynamics 365 Commerce to validate hypotheses about the effectiveness of your e-commerce pages and make decisions with data-driven confidence. Commerce supports A/B testing on pages, modules, and fragments to help you measure the impact of proposed changes to your website.
You can create, edit, and manage page and content treatments known as variations in Commerce site builder. Commerce integrates with partner services that you can use to create experiments and treatment assignments. Real-time event streams that Commerce captures enable the analytics that define the experiment results in the partner service. You can then apply these analytics to help support or refute your hypothesis.
Set up prerequisites
- Get the correct version of Commerce - Upgrade your module library, online channel extensibility software development kit (SDK), and Commerce Scale Unit to Commerce version 10.0.13 or later.
- Set up an experimentation connector - An experimentation connector allows Commerce to connect with partner services to retrieve the list of experiments and determine when to show an experiment to a user. You can purchase a partner connector from Marketplace. Follow the setup instructions provided by the publisher. You can alternatively use the sample test connector from Commerce to test the experimentation workflow without needing to configure an external service. For more information, see Configure and enable connectors.
- Turn on the experimentation feature flag in Commerce - You can enable experimentation at the tenant level by going to Tenant Settings > Features, or at the site level by going to Site Settings > Features. Turn on the Experimentation flag to start creating module variations. Disabling this flag stops all experiments from being shown to users and removes all editing functions within site builder.
Experimentation lifecycle
Setting up an experiment, creating variations, and running an experiment is an iterative process. The following diagram illustrates the experimentation lifecycle in Commerce and the partner service.
To learn more about each step in the experimentation process, see the following articles.
- Identify a hypothesis and determine metrics for an experiment
- Set up an experiment
- Connect and edit an experiment
- Preview and publish an experiment
- Run and monitor an experiment
- Promote a variation and complete an experiment
Note
To learn where an experiment is in the lifecycle, select Experiments in the left navigation pane of site builder. A list of experiments is displayed with the status of each experiment in both Commerce and the third-party service. For more information, see Review the status of an experiment.
Next step
Identify a hypothesis and determine success metrics for an experiment