A/B testing is the art of using controlled experiments to guide decision making. A/B testing is applied throughout the tech industry for developing and refining on-line services and products. Deployment of A/B testing at ever increasing scale drives the demand for testing efficiency. In response, the past decade of scientific results has brought forth a modern testing methodology, with state-of-the-art methods that optimize sample size and confidence by exploiting dynamic allocation, optional stopping and available prior knowledge.
This afternoon workshop at CWI will provide a tour of active topics in A/B testing, with speakers from industry deploying A/B testing methods, and academics working at the forefront of research. The workshop will highlight the CWI specialties of algorithm design and statistical testing methodology, and touch on causality and deployment at scale. The workshop aims at knowledge exchange, and connecting research and industry to explore new collaborations.
The workshop is primarily targeted at executives of companies employing A/B testing, as well as interested data scientists and academics.
The symposium is freely accessible after registration (registration is now closed).
Program
14.00 Christina Katsimerou (Booking.com)
Building a subpopulation-aware A/B experimentation platform at Booking
14.30 Peter Grünwald (CWI & Leiden University) and Rosanne Turner (CWI & UMC Utrecht)
Anytime-valid testing and confidence intervals in contingency tables and beyond
15.00 break
15.30 Wouter Koolen (CWI)
Instance-optimal algorithms for A/B testing
16.00 Alan Malek (Deepmind, formerly Optimizely)
Causality in A/B testing
16.30 drinks
Sander Bohté will be chair of the day.
For more information about the speakers and their presentations, please click here.
We are organizing a hybrid event: onsite in the Amsterdam Science Park Congress Centre and via a live video stream. Please also register when you want to join via the live stream - we will then be able to send you the link on the day of the event.
For inquiries and further details about this workshop, please contact event coordinator Daniëlle Kollerie.