Product Experimentation Lead

The Wow

Betsson Group is looking for a Product Experimentation Lead to operationalize, scale, and champion our experimentation program across our global portfolio of digital products. This role is central to ensuring that every customer-facing decision is backed by evidence, rigor, and user insight. 

Sitting at the intersection of product, analytics, UX, and engineering, you will drive evidence-based decision-making through robust A/B testing and live validation frameworks. You’ll execute and interpret high-quality experiments to evangelize a test-and-learn culture and scale the infrastructure that supports it. This includes instilling best practices, improving tools, and ensuring we learn the right things—not just run the right tests.

A taster of what you will be involved with:

Experimentation Platform & Governance:

• Own and optimize the use of experimentation tools (e.g., Optimizely), ensuring robust configuration, scalability, and cost efficiency 
• Develop best practices, playbooks, and governance models to ensure statistical rigor and test hygiene across all markets and brands
• Establish guardrails to prevent test collisions and misleading results 
• Ensure test documentation is consistently captured, tagged, and archived for future reference. Help build and maintain a repository that connects experiments to broader user insights, product decisions, and research learnings
• Support the development of a cross-functional knowledge system to prevent redundant testing, track learnings over time, and accelerate future decision-making

Strategy & Roadmap:

• Develop and maintain a strategic experimentation roadmap aligned with product priorities and market goals
• Partner closely with Analytics and UX Research (UXR) teams to track research insights and ensure continuity from discovery to validation
• Prioritize initiatives based on user needs, business impact, and technical feasibility
• Account for seasonality, test interdependence, and long-term effects on user behavior in planning

Test Design & Execution:

• Collaborate with PMs, researchers, and analysts to define hypotheses, test structure, and success metrics
• Guide test design including traffic allocation, sample sizing, segmentation, and statistical methods
• Manage test execution end-to-end and ensure robust post-test analysis
• Ensure tests are designed to capture both short-term effects and longitudinal impacts (e.g., retention, engagement)
• Pre-test analysis using GA or similar tools, to identify experiment parameters
• Manage or preferably execute robust post-test analysis ensuring all relevant data sources are used to ‘paint the full picture’ and insights/recommendations are clear
• Proactively develops the applicable experiments to run during low-request periods. Identify opportunities for improvements 

What we are looking for:

• 5+ years of relevant experience in product experimentation, CRO, product analytics, or related role
• Hands-on experience running and scaling A/B and multivariate tests across high-traffic digital products
• Expertise with testing platforms (e.g., Optimizely, AB Tasty, VWO) and analytics tools (GA, Amplitude, Adobe Analytics, ContentSquare)
• Strong statistical acumen: understanding of test design, power analysis, segmentation, and validity 
• Experience working cross-functionally with product, analytics, research, design, and engineering teams 
• Clear communicator able to translate test results into actionable insights and strategic recommendations 
• Experience in Data Visualization (through Google Looker Studio, Power BI, Tableau or similar)
• Experience using Business Intelligence and Operational Intelligence tools

What we offer

Much like a rollercoaster, life at Betsson Group is fast-paced, full of twists and turns, and always exciting. With more than 2,800 colleagues representing over 75 nationalities across a global network of offices – including 1,500 at our operational headquarters in Malta – every day brings new challenges and opportunities to grow. It may not be for the faint-hearted, but if you thrive on innovation, enjoy pushing boundaries and want to be part of a diverse, international team, then you’ll fit right in at Betsson.

Challenge accepted?