{"id":8521,"date":"2020-08-25T08:00:52","date_gmt":"2020-08-25T15:00:52","guid":{"rendered":"https:\/\/www.rightwave.com\/rwi\/?p=8521"},"modified":"2022-04-25T21:01:55","modified_gmt":"2022-04-25T21:01:55","slug":"championchallenger-vs-ab-testing","status":"publish","type":"post","link":"https:\/\/dev1.rightwave.com\/rwi\/championchallenger-vs-ab-testing","title":{"rendered":"Champion\/Challenger vs. A\/B Testing"},"content":{"rendered":"

Marketo and other systems provide options for determining the most effective marketing content. Companies can use a multitude of tools, including A\/B testing and Champion\/Challenger testing, to optimize such content.<\/p>\n

During A\/B testing, a company tests two different versions of a product, which often consist of emails or web pages, to see which one has more success. The \u201cA\u201d version is that which is expected to heed the best results, and the \u201cB\u201d version is expected to be the next best option. A\/B testing employs each of the two versions to see which receives a better response, with half of the test subjects receiving the \u201cA\u201d version and the other half receiving the \u201cB\u201d version. A\/B testing consists of a single test to determine the winner.<\/p>\n

Champion\/Challenger testing is continuous until a company determines a winner (1). With Champion\/Challenger testing, the \u201cChampion\u201d version is the version thought to be likely to produce the best results, and the \u201cChallenger\u201d version is the version thought to be the second choice option. Thus, after Champion\/Challenger testing is conducted, the \u201cChampion\u201d that is decided upon is utilized in a company\u2019s marketing efforts.<\/p>\n

Within the Marketo marketing automation system, companies can conduct both A\/B testing and Champion\/Challenger testing by sending the \u201cA\u201d or the \u201cChampion\u201d email to one group of people, and sending the \u201cB\u201d or \u201cChallenger\u201d email to another group. Companies can choose which criteria decide the winner of this testing, which can include \u201cOpens,\u201d \u201cClicks,\u201d \u201cClick to Open %,\u201d \u201cEngagement Score,\u201d and \u201cCustomer Conversion\u201d (2). Marketo makes testing straightforward, so that, through Marketo, a company can input the two versions it wants to test, send the emails, and find the results that they need.<\/p>\n

When interpreting the results of A\/B testing and Champion\/Challenger testing, the winner is chosen if the results are statistically significant. If the \u201cA\u201d or the \u201cChampion\u201d option produces similar results to the \u201cB\u201d or \u201cChallenger\u201d option, causing the results to be statistically insignificant, then a company may need to test more campaigns to attain better results. If the testing consistently has statistically insignificant results, then the two options may simply produce similar outcomes. There are many free online statistical calculators available, including the AB Testguide, that companies can utilize to detect whether their testing had results that were statistically significant (3).<\/p>\n

RightWave provides expertise and guidance to its customers for marketing strategies and tactics. For more information, contact RightWave<\/a>.<\/p>\n

 <\/p>\n

Sources:<\/p>\n

    \n
  1. Marketo, \u201cChampion\/Challenger vs A\/B Test in Engagement Program\u201d, 25 September 2019, https:\/\/nation.marketo.com\/t5\/Product-Discussions\/Champion-Challenger-vs-A-B-Test-in-Engagement-Program\/td-p\/193849<\/a><\/li>\n
  2. Marketo, \u201cCreating an A\/B Test program in Marketo\u201d, Undated, https:\/\/nation.marketo.com\/t5\/Product-Documents\/Creating-an-A-B-Test-program-in-Marketo\/ta-p\/248391<\/a><\/li>\n
  3. AB Testguide, \u201cAB Testguide\u201d, Copyright 2018, https:\/\/abtestguide.com\/calc\/<\/a><\/li>\n<\/ol>\n","protected":false},"excerpt":{"rendered":"

    Marketo and other systems provide options for determining the most effective marketing content. Companies can use a multitude of tools, including A\/B testing and Champion\/Challenger testing, to optimize such content. During A\/B testing, a company tests two different versions of a product, which often consist of emails or web pages, to see which one has…<\/p>\n","protected":false},"author":32,"featured_media":77906,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[3],"tags":[],"_links":{"self":[{"href":"https:\/\/dev1.rightwave.com\/rwi\/wp-json\/wp\/v2\/posts\/8521"}],"collection":[{"href":"https:\/\/dev1.rightwave.com\/rwi\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/dev1.rightwave.com\/rwi\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/dev1.rightwave.com\/rwi\/wp-json\/wp\/v2\/users\/32"}],"replies":[{"embeddable":true,"href":"https:\/\/dev1.rightwave.com\/rwi\/wp-json\/wp\/v2\/comments?post=8521"}],"version-history":[{"count":1,"href":"https:\/\/dev1.rightwave.com\/rwi\/wp-json\/wp\/v2\/posts\/8521\/revisions"}],"predecessor-version":[{"id":77907,"href":"https:\/\/dev1.rightwave.com\/rwi\/wp-json\/wp\/v2\/posts\/8521\/revisions\/77907"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/dev1.rightwave.com\/rwi\/wp-json\/wp\/v2\/media\/77906"}],"wp:attachment":[{"href":"https:\/\/dev1.rightwave.com\/rwi\/wp-json\/wp\/v2\/media?parent=8521"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/dev1.rightwave.com\/rwi\/wp-json\/wp\/v2\/categories?post=8521"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/dev1.rightwave.com\/rwi\/wp-json\/wp\/v2\/tags?post=8521"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}