0:00
/
0:00
Transcript

Joshua Mabry is an experienced professional with a robust foundation in data science and personalization. Starting with a Ph.D. and work in DNA sequencing, he transitioned to consulting roles at Bain & Company, where he became an expert advisor on machine learning and personalization. Now at AlixPartners, he designs AI solutions for different industries also with a focus on personalization strategies. Joshua’s expertise spans experimentation, modeling, optimization, and emerging technologies like MLOps and generative AI.

In our chat, Josh shared tips on when to use personalization and when to avoid it. He explained that companies relying too much on promotions or offering very simple product lines might struggle to make personalization work. Joshua also discussed "incrementality," which measures how much extra value personalization brings, such as encouraging customers to spend more over time.

Joshua presented a simple and practical framework for personalization while noting that keeping these projects running can be challenging because teams change, and priorities may clash.

When it comes to AI, Joshua said it’s not yet a big game-changer for personalization, though it can help with small tasks like checking for mistakes. He recommended starting with easy-to-understand tools instead of diving into complex ones, as simple systems often work just as well when paired with the right data. Overall, Joshua advised staying focused on customers and building a clear, team-wide plan for personalization.

In this episode, we cover:

  • (00:00) Joshua Mabry's Background and Expertise

  • (03:17) Defining Personalization

  • (06:37) What Companies Should Avoid in Personalization

  • (09:17) When to Consider Personalization

  • (10:17) When To and Not To Do Personalization

  • (12:13) The Importance of Incrementality in Personalization

  • (16:58) A Framework For Assessing Your Personalization Readiness

  • (21:50) Personalization Case Studies

  • (25:34) Personalization Research and Benchmarking

  • (30:23) The Role of AI in Personalization Strategies

  • (33:44) Final Thoughts and Resources

Referenced


Interested in sponsoring the newsletter?

Interested in sponsoring or advertising on this newsletter? I’m always looking to partner with brands and businesses that align with my audience. Reach out to me at brian@mammothinsights.io to inquire about sponsorship opportunities!


Upcoming Editions

  • Product Experimentation at Lucid.co

  • Price Testing with Intelligems

  • Experimentation at Comcast


📚 Worth Exploring

Testing Mind Map Series: How to Think Like a CRO Pro

In my interview with Convert.com, I talked about my journey into digital analytics and shared tips on using creativity and data to run better experiments, along with a healthy dose of relationship advice to help build teamwork and gain leadership support. Link to article

Interpreting A/B test results: false positives and statistical significance

This Netflix Technology Blog article examines common pitfalls in interpreting A/B test results, focusing on false positives and the nuances of statistical significance. Link to article

‘Everybody loses their loyalty stamp cards from coffee shops’

The article breaks down the essential components of a strong problem statement, including understanding user pain points, defining scope, and aligning with business goals. Link to post

Your Career is a Startup: Building Sustainable Growth, One Stage at a Time

The article likens building a career to growing a startup, encouraging individuals to treat themselves as a product to develop and scale. It outlines strategies for identifying your unique value proposition, iterating on strengths, and navigating challenges as opportunities for growth. Link to article

What’s in your stack: The state of tech tools in 2025

This article does a great job of breaking down the latest tech tools, especially since it’s hard to keep up with how fast new tools are popping up. It shows how AI tools like ChatGPT are super popular—90% of people are using them—and how new tools like Cursor and Linear are shaking things up, even while classics like Slack are still going strong. Link to article

How to think about Bets, Success Metrics, and Roadmapping

In this article, John Cutler explains how to reframe all product initiatives as “bets”—investments in outcomes under conditions of uncertainty. Link to document


👋 Hi, I’m Brian Poe, Founder and Chief Optimization Officer of Mammoth Insights, a boutique agency with 15+ years of experience helping mid-sized to enterprise companies improve digital strategies through affordable, high-quality Conversion Rate Optimization (CRO) research and experimentation. I’ve had the pleasure of working with leading global brands such as Best Buy, Verizon, Target, Ulta Beauty, Kia Motors of America and more.

Whenever you're ready, there are a few ways I can help you:

1. EXO Field Notes Participation: Want to elevate your personal brand on EXO Field Notes? Here’s how: 1:1 Interviews spotlight top experimentation and product leaders (see Nike example), Micro-Interviews are perfect for newcomers (view archive here), and Roundtable Discussions offer peer-to-peer discussions for 2-3 in-house brands (see roundtable example). Click here to message me on LinkedIn to inquire.

2. Full-Service Experimentation: Looking for an all-in-one solution? Our experimentation service at Mammoth Insights covers everything from crafting the strategy to executing the tests. We’re tool-agnostic, so there’s no need to change your setup. With all team members with 10+ years of experience working with companies like Best Buy and Verizon, we guarantee fast and effective results. Click here to learn more.

3. Conversion Research: Stop guessing and start converting. Our CRO service uses a mix of quantitative and qualitative UX research, including digital analytics and usability tests, to find what works best for your audience. I’ve helped brands like Capella University and Verizon Wireless achieve more with their existing traffic. Click here to learn more.

4. Brand Booster Roadmap: Future proof your brand experience. Work directly with Brian, Chief Optimization Officer, and Jennie, Head of Brand and former Head of Brand Strategy & Management at Wayfair. You’ll receive a comprehensive, tailored audit and brand strategy guide with data-driven recommendations. This includes brand positioning, online experience analysis, omni-channel content analysis, and a detailed brand experience roadmap. Contact us for a free consultation and to learn more.

Thanks for reading EXO Field Notes! Subscribe for free to receive new posts and support my work.