|
Field
Planned Number of Observations
|
Before
The nudge will be rolled out to worldwide users of the company who are eligible for the AI tool. There are approximately 1 million worldwide eligible users.
|
After
The nudge will be rolled out to worldwide users of the company who are eligible for the AI tool. There are approximately 1 million worldwide eligible enterprise users.
Additionally, our firm partner is also providing credits that will allow their consumer users to access the AI tool in a limited way (i.e. consumers receive a specific number of credits per method to access the AI coaching tool in addition to a suite of other AI tools). There are approximately 17 million consumer users, who will be eligible for our randomized nudges for an additional two-week period (Jan 16 to Jan 30, 2025) if they choose to use the email product during this period.
|
|
Field
Sample size (or number of clusters) by treatment arms
|
Before
Users are evenly distributed into each of the seven randomized arms with approximately 145,000 users in each group who are eligible to receive the nudges.
However, the number of users who may receive the nudges is likely smaller than those eligible. Nudges are triggered for users based on specific criteria determined by the product’s code. Based on an initial test of the nudge system, approximately 10,000 nudges were triggered in a two-week period for 30,000 users. Assuming nudges are triggered for users at a similar rate, this means that we can expect to see at least 48,000 nudges in a two-week period per treatment group that is assigned a nudge. (Note that nudges may be triggered several times for the same user.)
We plan to examine outcomes for all users eligible for the nudge as well as the subset who ended up receiving nudges.
|
After
Users are evenly distributed into each of the seven randomized arms with approximately 145,000 enterprise users in each group who are eligible to receive the nudges. Users in the consumer sample will also be evenly distributed into each of the seven randomized arms.
Note that the number of users who may receive the nudges is likely smaller than those eligible. Nudges are triggered for users based on specific criteria determined by the product’s code. Based on an initial test of the nudge system, approximately 10,000 nudges were triggered in a two-week period for 30,000 users. Assuming nudges are triggered for users at a similar rate, this means that we can expect to see at least 48,000 nudges in a two-week period per treatment group that is assigned a nudge. (Note that nudges may be triggered several times for the same user.)
We plan to examine outcomes for all users eligible for the nudge as well as the subset who ended up receiving nudges.
|