A/B Testing Metric Taxonomy

-

A single A/B test metric is rarely enough to have a robust picture of the A/B test. Summarized below are A/B testing Metric Taxonomy, which will be helpful for you to understand what categories of metrics you need to have. 







Comments

Post a Comment

Popular posts from this blog

Cracking Business Case Interviews for Data Scientists: Part 1

-
Image
Image by Minha Hwang Business case study interview questions are often the most difficult part of the interview process, especially for early data scientists without job experience. Even after landing on a job, it is beneficial to have a structured way of formulating and solving business problems from other teams and stakeholders. Based on my learning as an Ex-McKinsey consultant and data scientist over 10 years, I am sharing a “7 steps of problem-solving” approach. This structured business case/problem-solving process and related framework and templates will help you to become more comfortable in approaching and solving new business problems. In this article, I will discuss: (1) Overview of a “ 7 steps of problem-solving ” approach (2) Step 1: Define a problem  — How to avoid Type III error by solving a proper problem (3) Step 2: Structure a problem  — How to break down a problem to manageable sub-problems (4) Step 3: Prioritize issues —  How to prioritize sub-problems to solve Overv
Read more

How The Influence of Multi-Tiered Private Label Brand Architecture Varies Across Retailers

-
Image
Starting from Europe, many retailers now provide more than one quality tier (e.g. premium, standard, and economy) private labels in a specific category. To distinguish different quality tier products, retailers usually use different brand architecture. The examples below show that the actual branding architecture choice in the toilet paper private labels by three supermarket chains in Los Angeles.   Retailers have many choices in the private label branding architecture. As an example, retailer banners (e.g. Vons) can be combined with modifiers (e.g. premium, standard, and economy) in the "endorsed banner brand architecture." Retailers can choose not to use the retailer banner, but still use a common group brand (e.g. Home Life) with modifiers in the "group brand architecture". Finally, different names can be assigned for each quality tier in the "stand-alone brand architecture." Some combinations of these approaches are also possible. The natural
Read more

Cracking Business Case Interviews for Data Scientists: Part 2

-
Image
  Cracking Business Case Interviews for Data Scientists — Part 2 Image by  Minha Hwang Welcome back to “Part 2" of “Cracking Business Case Interviews for Data Scientists.” In this article, I will discuss the remaining parts of the 7 steps of a problem-solving approach. This article will cover: (1)  Step 4: Develop issue analysis and work plan  — Use an issue analysis worksheet and a work plan to “plan” for actions (2)  Step 5: Conduct analyses  — Sample analyses for simple cases (a toy example) (3)  Step 6: Synthesize findings  — Build storyline pyramids (“Grouping” structure vs. “Argument” structure) (4)  Step 7: Develop recommendations  — Convert a storyline pyramid to outline and final presentation (5 )   Wrap-up: Key Takeaways Step 4: Develop an issue analysis and work plan Once we prioritize issues to analyze, we need to (1) design detailed analyses and (2) conduct proper work planning. Step 4 of the 7 steps of a problem-solving approach helps to plan for action. Figure 28 sh
Read more