3 Replies Latest reply on Nov 2, 2018 9:36 PM by Mateusz Dabrowski

    How to A/B test time of day?

    Stephany Chang

      My team would like to A/B test the best time of day for our webinar emails. In the A/B test section we know that you can A/B test for total opens, clicks, clickthroughs, etc. but don't see one for time of day. How would one go about testing the time of day?

      Thank you in advance.

        • 1. Re: How to A/B test time of day?
          Mateusz Dabrowski

          I would go for multistep campaign canvas instead of simple mail campaign, create 10 different shared filters - each filtering contacts based on the last digit of their Eloqua Contact ID (ending with 0, ending with 1, etc), put all of them on campaign canvas (connected with No Paths) with evaluation period of, for example 1 hour. Yes Path should be pointing to e-mail you want to send.

           

          Now, if you, for example, activate this campaign at 10 AM, then the first 1/10th of your contacts will receive the mail soon after 10, and each next 1/10 of contacts the copy of that mail after the evaluation period. That way you will cover 10 hours and will be able to easily check which hour send worked best. Of course, you can change the number of filters and length of evaluation to apply the idea to your specific needs.

           

          Best regards,

          Mateusz DÄ…browski

          mateuszdabrowski.pl

          1 person found this helpful
          • 2. Re: How to A/B test time of day?
            Stephany Chang

            Hi Mateusz,

             

            Thanks for your detailed response.

             

            Here's a skeleton of how i would set up the canvas for Invite 1 with evaluation of 1 hour:

             

            Screen Shot 2018-11-02 at 2.14.15 PM.png

            When ready to check which hour performed best, is it best to check by creating a segment? For example:

            Screen Shot 2018-11-02 at 2.25.04 PM.png

            Thank you

            • 3. Re: How to A/B test time of day?
              Mateusz Dabrowski

              As for reporting - either the approach you just showed (easiest and one e-mail asset will do the job) or creation of multiple emails if you prefer to use Insight for this (for example if not only unique opens/clicks are important for you, but also total and forwards).

               

              Best regards,

              Mateusz DÄ…browski

              mateuszdabrowski.pl

              1 person found this helpful