Sample Question: Changing Composer
Explore how to evaluate a product feature change using data analysis and AB testing. Understand key metrics such as posts per active user, drop-off rates, and user engagement to determine if a new UI improves user behavior. Learn how to design tests with proper sample size and random assignment to avoid bias and achieve meaningful insights.
Problem
Try answering this on your own before continuing. Use the hints below if you are stuck.
Solution
Let’s make some initial assumptions. We can guess that we want to try a new user interface to improve certain key ...