New

Experimentation Manager

Cox
$99,000.00 - $165,000.00 / yr
parental leave, paid time off, paid holidays

Aug 03, 2025
Are you passionate about driving product growth through experimentation? Are you a strategic thinker who enjoys evolving experimentation practice to address ever-changing client and business challenges? Do you thrive in a dynamic environment where you get to partner with diverse teams? Join us in shaping the future of our product offerings through innovative experimentation practices. We are seeking an Experimentation Manager to lead our Experimentation Program that partners with cross-functional teams within the organization to make rapid data-driven product decisions aimed at growth / business optimization. WHAT YOU'LL DO: Grows Company's experimentation culture Champions experimentation and advances a culture that rapidly tests, measures, and iterates, driving continuous improvements to product experience, business KPIs and financials. Promotes and consults across functional teams within the Cox Automotive on how experimentation methodologies and platform capabilities may be leveraged to drive rapid business success with iterative learning. Consults on experiment strategy Partners with stakeholders from various functional teams to understand business objectives and requirements and translate them into experiment strategies and designs. Leverages various data sources to proactively identify and recommend the most impactful experiments to increase user engagement and revenue opportunities. Consults on experiment strategies and test plans by providing thought partnership and recommendations to tackle the learning plan with the most efficient effort while meeting standards/best practices. Explain technical decisions and test executions to non-technical stakeholders. Manages and advances Company's Experimentation Program Owns Experimentation Calendar and Backlog by managing, scheduling and coordinating experiments including organizational communication, supports cross-functional alignment on experiment prioritization by facilitating cross-team impact resolution while advising on the most effective experiment sequencing to maximize the Program's throughput. Establishes experimentation standards by implementing leading industry knowledge and best practices, including proper proper hypothesis development, experiment design, sampling, statistical and analysis methodologies. Ensures various program artifacts are properly maintained, including trainings, checklists, and program scorecard. Provides monthly Program Scorecard readout with insightful explanations to teams and leaders to keep pulse on overall Program Health and for specific teams. Tailors experimentation trainings for teams that are informed by insights from their Scorecard performance. When needed, coaches Engineering or external professional services resources in experiment development and deployment, as well as others in test monitoring. Manages and advances Company's Experimentation Program Responsible for the maintenance of experimentation software, must be able to work directly with vendors and internal software engineers to resolve issues. Works cross-functionally to identify platform gaps/ opportunities as well as to provide recommendations in the supported Product areas based on existing and emerging solutions from our current vendor to continually improve experimentation capabilities and efficiencies. Other operational responsibilities Supports Analytics Leads or other leaders for company initiatives/projects, may lead to drive project execution to meet project milestones and timelines after working closely with Manager or direct line of leaders to establish an aligned project plan. Guides teammates or members of other teams on the proper use of advanced techniques/technologies and validate their work. Works with Manager and direct line of leadership to define priorities, must be able to deliver against business goals working both independently and collaboratively with cross-functional teams. Able to perform the duties above with limited Manager oversight, proactively looking for ways to optimize existing solutions. WHO YOU ARE: Requirements Must live within a commutable distance to the Atlanta GA office and be coming into the office 2-3 times a week BA/BS in related disciplines (including analytics, statistics, mathematics, sciences, marketing, business, etc.) or equivalent experience. Master's Degree in related disciplines (including analytics, statistics, mathematics, sciences, marketing, business, etc.) preferred. 6+ years of business experience, or equivalent combination of education and work-related experience 6+ years of up-to-date experience with the following or related tools: Adobe Target and Optimizely, including tool implementation/maintenance and integration with other software (e.g. analytics tools, audience segmentation tools) that can advance our testing capabilities Technical skills required: Some understanding of front-end technologies (e.g. css, vanilla javascript, REACT), Intermediate knowledge of the Scientific Method, including hypothesis development, experiment design, statistical testing, etc. Web Analytics knowledge (e.g. Google Analytics, Adobe Analytics) preferred. BI Tools (e.g. PowerBI, Tableau, Domo), knowledge of SQL, Previous experience working with AI/GenAI applications in task augmentation or workflow improvement a plus. Must be able to learn and use experimentation and other relevant technologies (e.g. Web analytics tool, work management software, AI/GenAI capabilities). Experience performing A/B testing Must be able to work directly with vendors to resolve issues, to drive technological advances, and on long-termed projects/initiatives. Demonstrated effective relationship building and collaboration skills across teams, ability to consult stakeholders for the best outcomes to drive broad business successes. Ability to anticipate stakeholders' needs and recognize the opportunity to provide proactive solutions that build tight thought partnership. Ability to develop and improve scalable process and standards that drive the efficiency and effectiveness of a program, with previous change management experience. Excellent communication skills, including the ability to clearly and effectively communicate and present findings to stakeholders at all levels. Must be comfortable with translating pieces of findings into a cohesive insight story, as well as articulating experimentation concepts in a concise manner. Ability to develop and improve scalable processes and standards that drive the efficiency and effectiveness of the Team. Ability to translate requests/questions into actionable tasks/project plans with clear timelines. Strong organizational skills and the ability to effectively prioritize in a deadline-driven atmosphere with evolving priorities. Flexible working style; ability to guide the team to switch gears at light speed and thrive in an agile environment. Ability to solve problems with creative solutions, not afraid to challenge assumptions and intuitions, knows how to ask the right questions and prove/disprove hypotheses with data insights and lead the team to do the same. Must be able to travel by land and/or air for same-day or overnight business trips (up to 15%) USD 99,000.00 - 165,000.00 per year Compensation: Compensation includes a base salary of $99,000.00 - $165,000.00. The base salary may vary within the anticipated base pay range based on factors such as the ultimate location of the position and the selected candidate's knowledge, skills, and abilities. Position may be eligible for additional compensation that may include an incentive program. Benefits: The Company offers eligible employees the flexibility to take as much vacation with pay as they deem consistent with their duties, the company's needs, and its obligations; seven paid holidays throughout the calendar year; and up to 160 hours of paid wellness annually for their own wellness or that of family members. Employees are also eligible for additional paid time off in the form of bereavement leave, time off to vote, jury duty leave, volunteer time off, military leave, and parental leave.