UXNight: AB Marketing and Growth Design

November 26, 2019

at

95 Third Street, 2nd Floor, San Francisco, CA 94103

Product experts will teach you how to run a proper AB test and how to present your experiments to your organization. We have an all-star lineup and a full night of fun. Hope to see you there!

Schedule

5:45pm Doors open, Light food and drinks served

6:40pm Introduction and Announcements

6:50pm "When to Run an AB Test and When Not To" with Jane Davis, Head of Research at Zapier

7:20pm "Testing New Features with Feature Flags and Rollouts" with Justina Nguyen, Developer Evangelist Lead and Jeff Sing, Software QA Engineer at Optimizely

7:50pm Trivia Break

8:10pm "AB Testing Lessons for Product Designers" with Adrian Andrade, Product Design Lead at Eventbrite

8:35pm "How to Build an Experimentation Culture at your Organization and Get Buy-In” with Becca Bruggman, Staff Technical Program Manager, Experimentation at Optimizely

“When to Run an AB Test and When Not To”

Jane Davis, Head of Research at Zapier

Jane Davis, Head of Research at Zapier, helps product teams understand when to do research vs. when to run an experiment. In this talk, Jane will guide us on how to evaluate when to use AB testing and when not to. She’ll cover:

  • How to know if you have enough information to begin an experiment
  • When to run an AB test
  • When not to run an AB test
  • Is an AB test necessary?
  • How to define a hypothesis and understand your goals

"AB Testing Lessons for Product Designers"

Adrian Andrade, Product Design Lead at Eventbrite

Companies that adopt an experimentation culture are more likely to succeed and achieve a product market fit. Lucky for us, Adrian Andrade, Product Design Lead at Eventbrite, has tips on how to leverage experimentation and data driven design to transform assumptions into solutions.

In this presentation, Adrian will walk us through lessons he learned while running AB tests and experiments for digital products. He’ll guide us on proven techniques to make sure you’re effectively implementing an experimentation strategy. He’ll also cover the dos and don'ts of running an AB test.

"How to Adopt a Experimentation Culture and Share your Findings"

Becca Bruggman, Senior Technical Program Manager, Experimentation at Optimizely

Running consistent, thoughtful experiments requires a backlog of great experiment ideas and buy-in from your team, so how do you get that anyway?

Becca Bruggman, Optimizely's Internal Experimentation Program Manager, will take us through how to use design problem solving and visibility tactics to get your whole company excited about experimentation. You will learn:

  • Why experimentation matters, how it can help you get more ideas
  • How to utilize design research foundations to generate experiments
  • How to create a consistent flow of experiment ideas from across your company
  • How to present your experiments across your organization to keep everyone on the same page and get buy in

"Testing New Features with Feature Flags and Rollouts"

Justina Nguyen, Developer Evangelist Lead at Optimizely

Jeff Sing, Software QA Engineer at Optimizely

Feature flags allow companies like Amazon, Facebook, and Google to AB test new features, learn quickly and continuously deploy software to their users. Yet the industry treats feature flags as a technical term which can be confusing to designers.

In this talk, Justina and Jeff from Optimizely will teach product designers how to use feature flags to:

  • Perform gradual feature rollouts
  • Fix bugs in the code without redeploying
  • Experience a more streamlined development cycle
  • Rollback code easily

We aim to get designers comfortable experimenting with feature flags. This talk will not be overly technical. You'll understand the basics and how they apply to your work as a product designer.

Past Events