Director, Experimentation, Decision Science

As our Director, Experimentation, Decision Science, you will…

Play a pivotal role on our consulting team, working directly with clients to design, manage, and scale high-impact experimentation and personalization programs. Serving as a trusted advisor across web, digital, and media channels, you will consult on scaling client experimentation programs and drive hands-on program execution. In this role, you will mature client testing capabilities, maximize ROI, and unlock deeper customer insights to drive business growth.

What You’ll Do

• Design comprehensive cross-channel experimentation roadmaps and learning agendas aligned with client business goals across web, app, and paid/owned media channels
• Formulate data-driven hypotheses, determine experiment feasibility, and define primary/secondary KPIs, target audiences, and statistical parameters (sample size, experiment duration, confidence intervals)
• Drive audience segmentation and personalization strategies to deliver tailored user experiences across key digital touchpoints
• Oversee and facilitate the complete experimentation workflow—from ideation, targeting setup, and variant build specs to post-launch quality assurance
• Collaborate closely with engineering, analytics, UX/UI, and media teams to validate tag implementation, audience integration, and parameter tracking prior to test launches.
• Translate multivariate, A/B, and personalization experiment results and insights, into compelling, executive-ready stories and strategic next steps
• Work with analysts to communicate program value through performance measurement and insights Act as a strategic consultant to assess client experimentation programs, benchmark maturity against industry standards, and deliver action plans to elevate client capabilities
• Advise and support clients on maturing their experimentation programs focusing on establishing and/or optimizing experimentation execution processes, governance, documentation, intakes, experimentation methodologies and frameworks and test prioritization.
• Upskill client and internal agency teams on experimentation best practices, statistical literacy, and testing tool capabilities
• Cross-pollinate winning experiment concepts across different media formats, site sections, and client portfolios to maximize output efficiency
• Assist with RFPs, contract renewals, client upsells, and identifying new strategic service opportunities

What You’ll Bring

• Bachelor’s degree in Marketing, Business, Statistics, Psychology, Human Factors, or equivalent practical experience.
• 5+ years of web, digital or media experimentation experience
• Direct experience running A/B, multivariate, and personalization experimentation programs across web, mobile, or digital media platforms.
• Proven track record of managing external client relationships, presenting to key stakeholders, and navigating matrixed organizations.
• Demonstrated history of partnering closely with engineering, UX/UI, analytics, and product teams to execute technical projects.
• Ability to manage multiple client accounts and concurrent test roadmaps independently under tight deadlines
• Hands-on experience with Adobe Target. Experience with other experimentation and personalization platforms, a plus
• Ability to evaluate client testing maturity, build strategic roadmaps, align testing initiatives with business goals
• Exemplary written and verbal communication skills to translate complex data into concise, digestible, and executive-ready recommendations
• Ability to form partnerships with various client-side and agency-side stakeholders
• A self-starter mindset with strong problem-solving skills, high attention to detail, and a desire to continuously learn and share industry trends
• Travel up to 30% (ability and need to travel depends on client needs)

#LI-NT1

#LI-HYBRID

Hybrid Philosophy

For this role, we prioritize hybrid candidates in Raleigh, NC, but may consider candidates near other MERGE hubs based on the role and team’s needs.

Hybrid work is our default approach. We value time together for collaboration, relationship building, and key moments. Managers and team leaders determine in-person expectations based on what best supports their team, clients, and business needs. Some teams and roles require more regular in-person presence than others.

MERGE has hubs in Chicago, New York City, Boston, Kansas City, Raleigh, Denver, Atlanta, and St. Louis. Regardless of work arrangement, team members may be required to travel to a MERGE hub for meetings, team gatherings, events, or other business needs.

Total Rewards

At MERGE, we’re committed to fostering an environment where our team members can thrive in both their careers and personal lives, ensuring they feel supported and empowered to succeed.

MERGE believes in transparency and equity. In accordance with state regulations, we’re proud to include salary ranges in our job postings to ensure fair compensation practices.

The salary range for this role is $114,400 - $145,000, based on the individual’s skills, experience, qualifications, location, and other relevant factors. The salary pay range is subject to change and may be modified at any time.

MERGE is proud to invest in benefits that include meaningful Medical, Dental, Vision, Life Insurance, 401K, Lifestyle Spending Account, Employer Paid Life & Disability Insurance, Flexible Time off & Holidays plus many other benefits and rewards.

Applicants for employment in the US must have work authorization that does not now or in the future require sponsorship of a visa for employment authorization in the United States.