[Engineering] new user onboarding default to viewing issue board
Hypothesis
We can increase the stage adoption rate by ensuring users see the onboarding issue board
Supporting Data
Only 2-3% of users in onboarding experiment make it from Group creation to viewing the onboarding issue board - source.
Potential experiment experience
For a cohort of users in the new user onboarding experiment after the experience page instead of having them land on the group overview page where they need to follow the tooltips to the issue board, we instead have them directly land on the onboarding issue board. This experiment enrollment should occur on the Welcome
page so it matches the enrollment experience for the existing onboarding experiment.
Control experience:
- Same as the onboarding experience today where a user selects their experience and then follows tooltips to the issue board
Experiment version:
- After selecting a value on the experience page the user lands directly on the onboarding issue board
Experiment success metric
We will look for a statistically significant increase in the SPU (stages per user) in this experiment vs. the existing onboarding experiment that requires following tooltips to the issue board.
Experiment tracking requirements
In order to track this experiment we will add a new experiment row to the experiments table where we give this a unique experiment ID value. The user will be enrolled in the experiment at the same moment on the welcome page.
- Control: users in this group will receive a
group_type
value of0
and will be given the existing experiment onboarding experience where after the experience page they're given tooltips directing them to the issue board - Experiment: users in this group will receive a
group_type
value of1
after they select a value on the experience page they will be landed on the onboarding issue board